Skip to content
The blog

Written after the deployment, not before.

Essays on AI architecture, strategy and the org problems in between. Heart what’s useful, argue with me in the comments.

Tagged prompt-engineeringclear ✕


Aug 25, 2026

From Vague Request to Valid Result: A Framework for Prompting AI

Learn a systematic framework for prompt engineering to move from ambiguous requests to precise, reliable AI outputs. This guide covers the core principles, a step-by-step workflow, and the critical trade-offs involved.

Abstract shapes and lines connect, forming a pathway from a question mark to a checkmark.

2 reads

Jun 11, 2026

LLM12 min read

Stop Fine-Tuning Your LLM: Why Retrieval Is Cheaper, Faster & More Reliable

Developers often try to add knowledge to a large language model by fine-tuning it, a costly and often ineffective approach. A better strategy follows a clear hierarchy: start with the prompt, then use Retrieval-Augmented Generation (RAG) for facts, and only use fine-tuning to change the model's core behavior.

Diagram showing a hierarchy of LLM knowledge integration: prompt, RAG, then fine-tuning.

2 reads

Feb 10, 2026

llm-as-a-judge13 min read

Your LLM Judge's Secret Drift: Why 80% Agreement Isn't Enough

LLM-as-a-judge provides scalable evaluation but suffers from silent drift as models and rubrics change. This guide explains how to use a human-labeled holdout set to calibrate your judge, diagnose regressions, and prevent your evaluation system from misleading you.

Abstract scales with a judge icon and a downward trending graph.

1 reads

Nov 18, 2025

Fixing Your Recurring Outage: Ask for a Schema, Not for JSON

Stop asking LLMs to "respond in JSON" and hoping for the best. Schema-constrained generation eliminates parsing failures and retries by forcing the model to produce valid output, token by token.

A server rack with a glowing red alert light and a broken circuit diagram.

1 reads

Nov 12, 2025

Prompts Are Production Code: Version Them Like It

A 2025 industry survey found that 30-40% of AI development time is spent on prompt engineering. This article explains why treating prompts as versioned, deployable artifacts is the key to reclaiming that time, improving reliability, and shipping faster.

Team members collaborate around a whiteboard with AI-related diagrams.

1 reads

Oct 29, 2025

llm evaluation10 min read

Your First Eval: Build a 30-Example Test Set This Afternoon

Stop building elaborate evaluation frameworks and start measuring model quality today. Learn how to build a small, effective 30-example evaluation set from real traffic in a single afternoon.

A person's hands typing on a laptop with a graph on the screen.

2 reads