Optimization

Technical blog posts and working notes on AI systems, modeling, and production lessons.

Published on
April 30, 2026
llm openai ai-engineering
LLM Routing and Fallback: Preserve the Contract, Measure the Tradeoff
Build model routing and fallback policies that preserve application contracts while measuring quality, latency, and total cost.
Published on
January 5, 2026
llm optimization cost-reduction
Prompt Caching: Optimizing LLM API Costs and Latency
Learn how prompt caching can reduce LLM API costs by up to 90% and improve latency. Covers implementation strategies for Anthropic, OpenAI, and custom caching solutions.
Published on
July 30, 2025
llm quantization optimization
LLM Quantization: GPTQ, AWQ, GGUF and When to Use Each
A practical guide to LLM quantization techniques for running large models on consumer hardware with minimal quality loss.