Writing / Tag / 11 of 85
Architecture
Every essay tagged Architecture, newest first.
The architecture essays are about the shape of the system around the model: where state lives, who talks to whom, what happens when a run is cancelled or paused or repeated. They are the ones I would hand to someone drawing the boxes before any prompt is written.
A few patterns come up again and again. Shared state between agents wants to be a designed blackboard, not a blob that grew. Side effects want idempotency keys so a retry is safe. Risky actions want an approval gate that pauses the run and resumes it cleanly. Deadlines want to propagate down the whole tree so nothing keeps burning after the user leaves. Subagents want an explicit return contract instead of a lossy summary.
Start with the blackboard pattern, since it is the piece most multi-agent teams are already half-building by accident. Then human-in-the-loop approval gates for the pause-and-resume mechanics, and deadline and cancellation propagation for tearing down in-flight work the right way.
October 2026
Your MCP Server Borrowed the Host's Model. That Is Ending.
Sampling let an MCP server ask the host's model to do a little reasoning without holding any credentials, paying for any tokens, or choosing a model.Your LLM Gateway Is One Bad Release From Leaking Every Key
Every agent you run talks to the model through one gateway, and that gateway holds every provider key, every proxy credential, every secret the box can read.Your Load Balancer Deletes the Prefix Cache on Every Agent Turn
You self-host inference, you turned on prefix caching, and the cost barely moved.Your Background Agent Wakes Up More Than You Think
A scheduled agent fires every few minutes, a webhook fires on every push, and both land on the same agent with nobody watching.Your Model Router Saves Pennies and Burns Your Prompt Cache
You added a model router to cut costs and the bill went up.
September 2026
Your Agent Is Idle Most of the Time It's Working
A tool-using agent spends a surprising share of its wall clock doing nothing, just waiting for a network round trip while the model has already stalled.Your Subagents Are Hiding the Evidence
Spawning a subagent to keep the parent's context clean is the right instinct, and it is also where a lot of long-running agents quietly go wrong.Your Multi-Agent System Already Has a Blackboard
Wire a few agents together with direct handoffs and it works.
August 2026
Your Agent Retried and Charged the Card Twice
A tool call times out, your agent retries it, and the customer gets billed twice because the first request went through before the response came back.Your Agent Kept Working After the User Left
A user closes the tab and your agent keeps going: three tool calls in flight, two subagents still reasoning, tokens still burning for an answer nobody will read.Let Your Agent Ask Before It Does the Irreversible Thing
Most of what an agent does is safe to let run.