Insights, engineered.

Technical deep-dives, AI strategy, and engineering perspectives from the team building autonomous systems.

Jul 12, 2026 AI Engineering

Q4 vs Q8 vs FP16: How Much Quality You Lose Quantizing Local LLMs on M5 Max (2026)

Everyone runs 4-bit weights on Apple Silicon because they fit, but almost nobody measures what the compression cost them. We quantized the same models to FP16, 8-bit, and 4-bit on an M5 Max and scored each build three ways: perplexity on held out text, KL divergence against the full precision logits, and pass rates on real tasks. The headline is that the average 4-bit build looks fine on perplexity and quietly loses ground on the reasoning and code tasks that made you want the big model in the first place. Here is where the cliff sits, why perplexity hides it, and which layers are worth keeping at higher precision.

Jul 12, 2026 Headless Commerce

Recharge vs Ordergroove vs Stripe Billing: Headless Subscriptions on Shopify Plus (2026)

Subscriptions are the feature that punishes you hardest for going headless, because the recurring charge lives outside the storefront session and has to survive on its own for years. Recharge, Ordergroove, and Stripe Billing solve that from three different starting points: one grew up inside Shopify, one is a retention platform that happens to bill, and one is a billing primitive that knows nothing about your catalog. We compare where each puts the transaction of record, how they behave once the checkout is decoupled, and what the migration actually costs when you already have live subscribers.

Jul 11, 2026 Headless Commerce

Avalara vs TaxJar vs Vertex: Sales Tax Automation for Headless Shopify Plus (2026)

Going headless quietly breaks a thing you never thought about: sales tax. Shopify's native tax engine assumes the checkout it ships, and the moment you decouple the storefront or move the transaction of record into your own stack, you own the calculation call, its latency, and its failure modes. We compared Avalara, TaxJar, and Vertex on the questions that matter once you are outside the native checkout: where the API call fits, what happens when it times out at the worst moment, how deep the jurisdiction accuracy goes, and how far each reaches into registration and filing.

Jul 11, 2026 AI Engineering
vs vs

GPT-5.6 Sol vs Fable 5 vs Grok 4.5: Long Horizon Agents, Reasoning, and Cost Tested (July 2026)

OpenAI shipped the GPT-5.6 family, Sol, Terra, and Luna, on July 9, and the flagship Sol tier posts the kind of numbers that force a re-evaluation: a new high on Agents Last Exam, the top score on Terminal-Bench, and general intelligence one point behind Claude Fable 5 at roughly a third of the cost. We put Sol against Fable 5 and Grok 4.5 on the axes that decide real agent deployments, long horizon task completion, reasoning depth, and blended cost, and separate the launch benchmarks from what actually changes your build.

Jul 11, 2026 AI Infrastructure

GPU vs Apple Neural Engine for Local LLM Inference on M5 Max: Why the Runtimes Skip the ANE (2026)

Your M5 Max ships with a Neural Engine that Apple markets for machine learning, and yet every local LLM runtime you can name loads the model onto the GPU and leaves that accelerator idle. This is not an oversight. The Neural Engine is a fixed shape matrix machine built for CoreML graphs, and autoregressive token generation, with its growing KV cache and one token at a time decode, is close to the worst case for it. We walk through what the ANE actually is, why llama.cpp and MLX both target Metal instead, and the narrow cases where routing part of the pipeline through the Neural Engine still earns its power budget.

Jul 11, 2026 AI Engineering
vs

Grok 4.5 vs Opus 4.8: Agentic Coding on SWE-Bench Pro and Terminal-Bench Tested (July 2026)

The headline is that Opus 4.8 wins SWE-Bench Pro and Grok 4.5 wins Terminal-Bench, but the score line is the least interesting part of this matchup. The number that should change how you route work is token efficiency: on the same SWE-Bench Pro tasks Grok 4.5 spent roughly a quarter of the output tokens Opus 4.8 did, at less than a third the output price. We break down where each model actually wins, why the benchmark split is real rather than noise, and how to think about cost per completed issue instead of leaderboard rank.

Jul 11, 2026 AI Engineering
vs

Grok 4.5 vs Sonnet 5: Production Cost, the Sonnet Tokenizer, and Throughput at Volume (July 2026)

On the price sheet Grok 4.5 and Sonnet 5 look close, roughly a couple of dollars in and single digits out per million tokens. In production they are not close, because Sonnet 5 ships a new tokenizer that maps the same English text to about 40 percent more tokens, and you pay per token, not per word. Add throughput and the effective cost gap widens further. We work through the real per word economics and where each model still earns its place in a high volume system.

Jul 11, 2026 AI Engineering
vs vs

Opus 4.8 vs GPT-5.5 vs Gemini 3.5 Pro: Prompt Caching and Cost per Million Tokens at Scale (July 2026)

Every model comparison ranks capability and then quotes a headline price per million tokens as if that number were your bill. It is not. In any real agent or RAG workload you send the same long system prompt and tool schema thousands of times, and whether that repeated context costs full price or a tenth of it is the difference between a viable product and one that bleeds margin. We compared Opus 4.8, GPT-5.5, and Gemini 3.5 Pro on input and output rates, prompt caching mechanics, cache write overhead, and throughput, then modeled the blended cost of a caching heavy workload so you can see which sticker price survives contact with production.

Jul 8, 2026 AI Engineering
vs vs

GPT-5.5 vs Claude Opus 4.8 vs Qwen3-Coder: Frontend UI Code Generation Tested (WebDev Arena, July 2026)

Frontend code generation is where the model that tops the coding leaderboards and the model that produces a UI a designer accepts are often not the same one. WebDev Arena scores web builds on human preference rather than a unit test, which rewards visual coherence and prompt adherence over raw algorithmic skill. We put GPT-5.5, Claude Opus 4.8, and Qwen3-Coder through it and measured Elo, render success, and cost per component, because the model you put behind a design to code feature has to render on the first try and stay inside a per request budget, not just win a benchmark.

Jul 8, 2026 AI Infrastructure

Fine Tuning LLMs Locally on M5 Max: LoRA and QLoRA with mlx-lm (2026)

You do not need a rented cluster to specialize an 8B or 14B model. On an M5 Max with 128GB of unified memory, mlx-lm turns LoRA and QLoRA fine tuning into an overnight job you run on the same laptop that later serves the adapter. We measured peak memory, training throughput, and wall clock across a few model sizes, because the interesting question is not whether local fine tuning works on Apple Silicon, it clearly does, but where the memory ceiling and the throughput floor decide the model size you can actually train before renting a GPU pays off.

Jul 8, 2026 Headless Commerce

Shopify Plus B2B vs BigCommerce B2B Edition vs Custom Headless Wholesale (2026)

B2B commerce looks like B2C with a login until you hit customer specific price lists, net terms, multi buyer accounts, and an ERP that owns the truth about pricing and stock. At that point the platform's B2B model either fits your business or fights it. We compare Shopify Plus B2B, BigCommerce B2B Edition, and a custom headless build on the four things that actually decide a wholesale project: how each models catalogs and price lists, how it handles account hierarchy, how cleanly it integrates the ERP, and where each one breaks under real complexity.

Jul 7, 2026 AI Engineering
vs vs

Claude Fable 5 vs GPT-5.5 vs Grok 4.3: AIME 2026 Hard Math Reasoning Tested (July 2026)

AIME rewards a model that can hold a long chain of exact arithmetic and case analysis without dropping a sign, and the single accuracy number every leaderboard prints hides how much compute each model spent to get there. We ran Claude Fable 5, GPT-5.5, and Grok 4.3 across the AIME 2026 problems and scored pass@1 against self consistency, then priced each solve by the reasoning tokens it burned, because on hard math the model that tops the accuracy chart is often the one that spends the most to do it, and that trade decides whether you can afford to run it at volume.