Skip to content
The blog

Written after the deployment, not before.

Essays on AI architecture, strategy and the org problems in between. Heart what’s useful, argue with me in the comments.


Aug 25, 2026

From Vague Request to Valid Result: A Framework for Prompting AI

Learn a systematic framework for prompt engineering to move from ambiguous requests to precise, reliable AI outputs. This guide covers the core principles, a step-by-step workflow, and the critical trade-offs involved.

Abstract shapes and lines connect, forming a pathway from a question mark to a checkmark.

2 reads

Aug 25, 2026

Debate and Decompose: When a Second Agent Is Worth the Cost

Multi-agent systems add cost and complexity, but are justified for specific use cases like independent verification (debate) or breaking down tasks that exceed a single model's context window (decomposition). This article provides a framework for deciding when to add a second agent.

Two abstract figures debate, one decomposing into smaller parts.

Aug 25, 2026

LLM11 min read

The Model Upgrade Is Not a Drop-In: A Production Migration Guide

A major new foundation model release is not a simple drop-in upgrade. This guide provides a framework for migrating your production pipeline safely, covering re-qualification, prompt auditing, and sequenced rollouts to avoid breaking changes.

Abstract diagram showing a complex pipeline with interconnected nodes and arrows.

Aug 10, 2026

cognitive debt11 min read

Code Churn Doubles: Why Retyping LLM Code Is a 2x, Not 10x, Win

A developer workflow of manually retyping LLM-generated code is gaining traction as a way to combat cognitive debt. This method offers a 2x productivity boost, not the promised 10x, but forces comprehension and helps mitigate the doubling of code churn seen in the AI era.

Developer retypes code on a laptop, illustrating a workflow.

3 reads

Aug 10, 2026

LLM System Design Architecture: The End-to-End Guide to Building Production AI

A comprehensive guide to end-to-end LLM system design architecture, covering the core patterns like RAG, vector databases, and agentic workflows required to ship production-grade AI applications.

Abstract network diagram with glowing nodes and lines, representing AI system architecture.

4 reads

Aug 10, 2026

llm cost11 min read

The $8,000 Misunderstanding: How to Cut Your LLM Bill by 80%

Facing a surprise LLM bill? Learn how enterprise teams are cutting AI inference costs by 50-80% using a practical framework of model routing, prompt caching, and efficient architecture, without sacrificing quality.

A thick stack of paper clamped and compressed in an iron vice, with loose sheets fallen in a heap beside it.

2 reads

Aug 07, 2026

gitlost13 min read

GitLost: How a GitHub AI Agent Leaked Private Repos from One Public Issue

Security researchers discovered "GitLost," a vulnerability where a GitHub AI agent was tricked by a malicious prompt in a public issue into leaking data from private repositories, highlighting a fundamental security flaw in agentic AI systems.

A key with a maze-shaped head lying inside an open lock box.

2 reads

Jul 28, 2026

open-weights5 min read

Kimi K3: a 2.8-trillion-parameter open model that bets on linear attention

Moonshot's new open-weight flagship isn't chasing a leaderboard — it's a bet that a cheap million-token context changes what we build. What actually changed under the hood, how to run it, and where it sits against the open-weight frontier.

Modernist title card reading Kimi K3 — 2.8T open weights, 1M context, linear attention.

3 reads1 hearts1 comments

Jul 13, 2026

alignment tax9 min read

The Alignment Tax: Why Making LLMs Safer Can Make Them Less Capable

Improving the safety and helpfulness of large language models often comes at a cost to their raw capabilities. This trade-off, known as the 'alignment tax,' is a fundamental challenge in making AI systems that are both powerful and beneficial.

Two gears, one labeled "Safety" and the other "Capability," are misaligned.

1 reads

Jul 06, 2026

HITL That Works: Make Review Faster Than the Original Task

Most human-in-the-loop (HITL) review queues fail because they are slower and more tedious than the manual work they replace. This article details four principles for designing HITL systems that humans will actually use, focusing on making review faster than creation, surfacing model uncertainty, and turning the review process into a continuous evaluation set.

A person reviews data on a computer screen with a magnifying glass.

Jun 30, 2026

ai latency11 min read

Your AI Is Slow: A Latency Budgeting Guide for Sub-Second Agents

Stop thinking about AI latency as a single number. Treat it as a budget to be spent across retrieval, generation, and tool use, and learn how in-process controls can shave 50ms or more from every user interaction.

Abstract visualization of data flow with glowing nodes and connecting lines.

1 reads

Jun 11, 2026

LLM12 min read

Stop Fine-Tuning Your LLM: Why Retrieval Is Cheaper, Faster & More Reliable

Developers often try to add knowledge to a large language model by fine-tuning it, a costly and often ineffective approach. A better strategy follows a clear hierarchy: start with the prompt, then use Retrieval-Augmented Generation (RAG) for facts, and only use fine-tuning to change the model's core behavior.

Diagram showing a hierarchy of LLM knowledge integration: prompt, RAG, then fine-tuning.

2 reads

May 28, 2026

ai vendor10 min read

The Bowling Alley Test: A Sanity Check for AI Vendor Claims

AI vendors promise revolutionary capabilities, but their benchmark claims often hide the true cost and complexity. This article presents a practical framework, inspired by a real-world bowling alley renovation, for cutting through the hype and building a private benchmark that tests what really matters for your business.

Bowling pins and balls on a lane with a renovation blueprint overlay.

May 14, 2026

LLM11 min read

Your LLM Is a Bug: A 5-Point Test for When Not to Use AI

Large Language Models are powerful but often the wrong tool for the job. This article provides a five-point decision test to identify when a simpler, more reliable solution like a database query, a regular expression, or a classical classifier is the better choice.

A stylized bug with circuit board patterns and a glowing AI eye.

1 reads

May 07, 2026

Your AI Team Is a Bottleneck: Why LLMs Belong on the Platform

Stop creating siloed "AI teams" that become bottlenecks. To scale LLM development, treat AI capabilities as a product built by your platform team, enabling product teams to innovate faster and more safely.

Abstract illustration of interconnected gears and data streams forming a central hub.

1 reads

Apr 30, 2026

The Trillion-Parameter Tipping Point: Open-Weight AI Is Now a C-Suite Decision

As of April 2026, open-weight models with over a trillion parameters rival proprietary APIs in capability, forcing a new strategic decision for enterprises. This article breaks down the choice across four critical axes: data control, capability, cost, and the upgrade cycle.

A server rack with glowing blue lights and a digital brain graphic.

1 reads

Apr 23, 2026

rag12 min read

Most Enterprise RAGs Have No Access Control: How to Fix Yours

Vendor research shows most enterprise RAG deployments lack basic access controls, creating major data leak risks. This article details how to fix it by implementing pre-retrieval filtering in your vector database to enforce permissions before data reaches the LLM.

Cover illustration for Most Enterprise RAGs Have No Access Control: How to Fix Yours

1 reads

Apr 07, 2026

ai cost12 min read

Why Your First AI Invoice Is a Trap: A Cost Model for Survival

Most engineering teams learn about their AI costs from a surprise invoice. This article argues for building a cost model based on user actions, not API calls, to prevent margin erosion and build a profitable AI business.

Cover illustration for Why Your First AI Invoice Is a Trap: A Cost Model for Survival

2 reads

Apr 02, 2026

LLM12 min read

The 76% Mistake: Why AI Build vs. Buy Is a Layer-by-Layer Choice

The "build vs. buy" decision for LLM applications is no longer a single choice. This article presents a framework for analyzing the AI stack layer by layer—from the model to evaluation—to avoid common pitfalls and focus engineering effort where it creates the most value.

Cover illustration for The 76% Mistake: Why AI Build vs. Buy Is a Layer-by-Layer Choice

1 reads

Mar 26, 2026

prompt injection12 min read

Role Confusion: The 61% Attack Success Rate Exposing LLM's Core Flaw

Prompt injection isn't just "tricking an AI"; it's a classic authorization vulnerability. New research shows a 61% attack success rate by exploiting 'role confusion,' where models grant authority based on writing style, not source, demanding a shift to architectural security patterns.

Abstract gears and code with a red lock icon.

1 reads