Technical deep-dives, AI strategy, and engineering perspectives from the team building autonomous systems.
Local agents on Apple Silicon collapse the moment the model emits a malformed tool call. Outlines, llama.cpp grammars, and MLX logit bias are the three constrained decoding paths that actually work today, and the choice shapes throughput, schema fidelity, and how brittle the agent loop is to model upgrades.
The cheap tier is where coding agent unit economics live or die. Haiku 4.5 and Gemini 3.5 Flash are the two contenders most teams actually deploy under the frontier, and on SWE-Bench Verified they sit a few points apart on pass rate but very far apart on cost per resolved issue and on the failure modes that matter for agentic loops.
Marketing automation is the layer where a headless storefront either earns its CAC back or sinks under it. Klaviyo, Bloomreach, and Attentive cover three very different shapes of the personalization problem, and the right pick depends on whether the binding constraint is email volume, on site personalization, or SMS conversion velocity.
Embeddings are the unglamorous half of every RAG stack, and the model choice quietly determines whether retrieval feels intelligent or like a fuzzy keyword search. We measured nomic-embed-text-v2, bge-m3, and Qwen3-Embedding-8B on an M5 Max across throughput, retrieval quality on BEIR, and memory footprint to map where each model earns its slot in a production local stack.
GPQA Diamond is the benchmark that pushes a model into genuine graduate level science, where prior knowledge matters less than a careful chain of reasoning. Sonnet 4.6 and Fable 5 are the two best mid tier models on the benchmark in June 2026, separated by under three points on the aggregate but with strikingly different per domain behavior and a roughly 2x cost gap.
Prefix caching is the throughput lever that converts repeated system prompts and stable RAG contexts from a recurring prefill tax into a one time cost. We measured MLX 0.21 prefix caching on an M5 Max across agent loops, code review pipelines, and RAG workloads to map hit rates, memory budgets, and the eviction policies that actually move tokens per second.
Headless CMS selection for composable commerce sits at the intersection of merchandiser experience, developer ergonomics, and CDN economics. Storyblok, Sanity, and Contentful solve different shapes of the problem, and the right pick depends on who edits, how often, and how tightly the CMS has to wire into the commerce platform.
KV cache quantization is the single biggest throughput lever on Apple Silicon at long context, and almost nobody benchmarks it carefully. We ran MLX 0.21 on an M5 Max across Q8, Q4, and FP16 KV cache settings on Llama 3.3 70B and Qwen 3.6 27B to map where the quality drops, where the throughput wins arrive, and which configuration belongs in production.
Aider Polyglot is the benchmark that exposes how a model behaves outside its comfort language. Opus 4.8 and Gemini 3.5 Pro both land in the high 70s on the aggregate score, but the per language breakdown decides which model belongs in a polyglot codebase, and the cost per task math diverges sharply.
Shipping API selection is the headless commerce decision most teams treat as commoditized until they hit international rates, return labels, or pickup scheduling. ShipStation, ShipEngine, and EasyPost solve different shapes of the multi carrier fulfillment problem, and the right pick depends on the warehouse architecture, carrier mix, and how much branding control the brand wants over the post purchase experience.
Apple Silicon batched inference is the question nobody benchmarks because the marketing throughput numbers all assume batch 1. We ran an M5 Ultra Mac Studio under MLX and llama.cpp at batches up to 32 to find out where the curve actually flattens, and whether a single Mac Studio can serve a real workgroup.
Anthropic now ships two top tier coding models in parallel: Opus 4.8 for deep reasoning, Fable 5 for long horizon agentic loops. Both score in the low 80s on Terminal-Bench 2.0, but the failure modes are different and the per task economics diverge sharply. We ran a head to head to find out which Claude is the right pick for a production coding agent.