Skip to content
The blog

Written after the deployment, not before.

Essays on AI architecture, strategy and the org problems in between. Heart what’s useful, argue with me in the comments.

Tagged llmclear ✕


Aug 25, 2026

From Vague Request to Valid Result: A Framework for Prompting AI

Learn a systematic framework for prompt engineering to move from ambiguous requests to precise, reliable AI outputs. This guide covers the core principles, a step-by-step workflow, and the critical trade-offs involved.

Abstract shapes and lines connect, forming a pathway from a question mark to a checkmark.

2 reads

Aug 25, 2026

Debate and Decompose: When a Second Agent Is Worth the Cost

Multi-agent systems add cost and complexity, but are justified for specific use cases like independent verification (debate) or breaking down tasks that exceed a single model's context window (decomposition). This article provides a framework for deciding when to add a second agent.

Two abstract figures debate, one decomposing into smaller parts.

Aug 25, 2026

LLM11 min read

The Model Upgrade Is Not a Drop-In: A Production Migration Guide

A major new foundation model release is not a simple drop-in upgrade. This guide provides a framework for migrating your production pipeline safely, covering re-qualification, prompt auditing, and sequenced rollouts to avoid breaking changes.

Abstract diagram showing a complex pipeline with interconnected nodes and arrows.

Aug 10, 2026

cognitive debt11 min read

Code Churn Doubles: Why Retyping LLM Code Is a 2x, Not 10x, Win

A developer workflow of manually retyping LLM-generated code is gaining traction as a way to combat cognitive debt. This method offers a 2x productivity boost, not the promised 10x, but forces comprehension and helps mitigate the doubling of code churn seen in the AI era.

Developer retypes code on a laptop, illustrating a workflow.

3 reads

Jul 13, 2026

alignment tax9 min read

The Alignment Tax: Why Making LLMs Safer Can Make Them Less Capable

Improving the safety and helpfulness of large language models often comes at a cost to their raw capabilities. This trade-off, known as the 'alignment tax,' is a fundamental challenge in making AI systems that are both powerful and beneficial.

Two gears, one labeled "Safety" and the other "Capability," are misaligned.

1 reads

Jun 11, 2026

LLM12 min read

Stop Fine-Tuning Your LLM: Why Retrieval Is Cheaper, Faster & More Reliable

Developers often try to add knowledge to a large language model by fine-tuning it, a costly and often ineffective approach. A better strategy follows a clear hierarchy: start with the prompt, then use Retrieval-Augmented Generation (RAG) for facts, and only use fine-tuning to change the model's core behavior.

Diagram showing a hierarchy of LLM knowledge integration: prompt, RAG, then fine-tuning.

2 reads

May 14, 2026

LLM11 min read

Your LLM Is a Bug: A 5-Point Test for When Not to Use AI

Large Language Models are powerful but often the wrong tool for the job. This article provides a five-point decision test to identify when a simpler, more reliable solution like a database query, a regular expression, or a classical classifier is the better choice.

A stylized bug with circuit board patterns and a glowing AI eye.

1 reads

May 07, 2026

Your AI Team Is a Bottleneck: Why LLMs Belong on the Platform

Stop creating siloed "AI teams" that become bottlenecks. To scale LLM development, treat AI capabilities as a product built by your platform team, enabling product teams to innovate faster and more safely.

Abstract illustration of interconnected gears and data streams forming a central hub.

1 reads

Apr 23, 2026

rag12 min read

Most Enterprise RAGs Have No Access Control: How to Fix Yours

Vendor research shows most enterprise RAG deployments lack basic access controls, creating major data leak risks. This article details how to fix it by implementing pre-retrieval filtering in your vector database to enforce permissions before data reaches the LLM.

Cover illustration for Most Enterprise RAGs Have No Access Control: How to Fix Yours

1 reads

Apr 02, 2026

LLM12 min read

The 76% Mistake: Why AI Build vs. Buy Is a Layer-by-Layer Choice

The "build vs. buy" decision for LLM applications is no longer a single choice. This article presents a framework for analyzing the AI stack layer by layer—from the model to evaluation—to avoid common pitfalls and focus engineering effort where it creates the most value.

Cover illustration for The 76% Mistake: Why AI Build vs. Buy Is a Layer-by-Layer Choice

1 reads

Mar 06, 2026

LLM11 min read

Failover Amnesia: Why Your LLM Chatbot Forgets During an Outage

Your application successfully fails over to a backup LLM provider during an outage, but your user's conversation is lost. This article explains why stateless failover breaks the user experience and details the stateful abstraction layer required to preserve conversational context, making your AI resilient in a way that users actually notice.

A chatbot icon with a broken connection and a question mark.

Feb 03, 2026

LLM11 min read

How to Log Your LLM: Unlock 99% Automation With Better Data

Traditional logging can't tell you if your LLM is getting worse. This article details the essential fields to log—from costs to verdicts—to debug silent failures, track quality, and automate up to 99% of your AI-driven workflows.

Abstract illustration of data streams flowing into a stylized brain icon.

1 reads

Jan 19, 2026

LLM12 min read

The 100x Cost Gap: When to Replace Your LLM With a Simple Rule

A single powerful LLM is often the most expensive and least reliable way to answer simple questions. This article explains how to build a routing layer that uses deterministic rules for simple queries, saving money and improving reliability, while reserving expensive models for the complex tasks they were built for.

A stylized circuit board with a glowing brain icon at its center.

Jan 06, 2026

ai agent12 min read

The $12 Agent Task: Why Production AI Needs a Harness, Not a Loop

Most AI agent demos are built on a simple loop that is too expensive and unreliable for production. Real-world systems use a "harness" architecture with structured workflows, checkpoints, and budgets to create agents that can survive contact with reality.

A stylized circuit board with a glowing red loop and a sturdy, structured harness.

1 reads

Nov 18, 2025

Fixing Your Recurring Outage: Ask for a Schema, Not for JSON

Stop asking LLMs to "respond in JSON" and hoping for the best. Schema-constrained generation eliminates parsing failures and retries by forcing the model to produce valid output, token by token.

A server rack with a glowing red alert light and a broken circuit diagram.

1 reads

Oct 17, 2025

rag12 min read

Chunking Is a Retrieval Decision: Up to 9% Recall Is on the Line

Most RAG systems fail due to a single, overlooked setting: chunk size. This article explains how rethinking chunking as a dynamic retrieval parameter, not a static preprocessing step, can boost recall by up to 9% and why the optimal size depends entirely on your users' questions.

A diagram shows a graph with a sharp downward dip in recall.

1 reads

Oct 07, 2025

rag11 min read

Why Your RAG Pilot Won't Survive Production

A RAG pilot on 200 curated documents looks magical, but scaling to 200,000 uncurated ones in production causes it to break. This article explains why recall collapses, how to fix a failing RAG pipeline, and what you should be measuring instead.

A graph shows recall dropping sharply as document count increases.

2 reads