Articles & Resources

Long-form writing on the engineering side of AI systems — architecture, reliability, and cost — plus references I keep coming back to. For a running log of what is shipping in the field, see Trends.

Articles

Designing AI Systems That Hold Under Load

August 2026 · ~12 min read

The hard part of production AI stopped being model quality and became system quality. A working guide to the three constraints that actually bind — memory rather than compute, statistical rather than binary correctness, and the optimization order that pays — with the arithmetic to size each one.

scalabilityfault toleranceinference costKV cachegraceful degradationobservability

Resources

A short list of references I return to rather than an exhaustive bibliography.