All Posts
AI Infrastructure September 4, 2026

Kimi K3 vs GPT-6 Astra: Open Weights Against the Flagship on GPQA and Cost (2026)

OpenAI released GPT-6 Astra on September 3, 2026, and it currently leads the field on GPQA Diamond at 96.0 percent, the highest abstract reasoning score OpenAI has published. It costs 10 dollars per million input tokens and 50 per million output, with a Fast mode at roughly double that. The interesting comparison is not another flagship, it is Kimi K3, the open weights model from Moonshot AI that posts 93.5 percent on the same GPQA Diamond benchmark while charging 2.50 and 14 dollars per million tokens on its hosted API and shipping weights you can run yourself. This post puts the two side by side on the benchmark that actually compares cleanly, walks through why the Terminal-Bench numbers do not compare across versions, and works out the cost gap that decides which model belongs in which part of your stack.

Kimi K3 vs GPT-6 Astra: Open Weights Against the Flagship on GPQA and Cost (2026)

OpenAI shipped GPT-6 Astra on September 3, 2026, and it currently holds the top score on GPQA Diamond at 96.0 percent, the highest abstract reasoning result OpenAI has ever published. The reflex is to compare it to another closed flagship. The more useful comparison is Kimi K3, the 2.8 trillion parameter open weights model Moonshot AI released in July, because K3 posts 93.5 percent on the same benchmark at a fraction of the price and ships weights you can run on your own hardware. When an open model lands within three points of the best closed model on a hard reasoning test, the question stops being which one is smarter and becomes which one you should be paying for.

Attribute GPT-6 Astra Kimi K3
Vendor OpenAI Moonshot AI
Released September 3, 2026 July 16, 2026 (weights July 27)
Weights closed, API only open, custom Kimi K3 License
GPQA Diamond 96.0 percent 93.5 percent
Context window 1,000,000 tokens 1,000,000 tokens
Input price 10 dollars per million tokens 2.50 dollars per million tokens
Output price 50 dollars per million tokens 14 dollars per million tokens
Cache read (Fast mode roughly 2x list) 0.29 dollars per million tokens

GPQA Diamond is the number that compares cleanly

GPQA Diamond is a set of graduate level science questions written to be hard for both search and pattern matching, so it is a reasonable proxy for how a model handles unfamiliar, reasoning heavy work. Astra at 96.0 and K3 at 93.5 are close enough that for most workloads the gap will disappear into prompt quality and retrieval. That 2.5 point spread is real, and if your work is genuinely at the frontier of scientific reasoning it may matter, but it is not the difference between a model that can do the job and one that cannot. Both are in the band where the bottleneck is your context and your evaluation harness, not the model's raw reasoning.

The reason GPQA is worth anchoring on is that it is one of the few numbers in this matchup you can actually compare. Astra reports Terminal-Bench 4.0 at 57.7; K3 reports Terminal-Bench 2.1 at 88.3. Those are different versions of the benchmark with different tasks and different scoring, so reading 88.3 as better than 57.7 is a mistake. Benchmark version drift is the single most common way model comparisons go wrong in 2026, and vendors are not always loud about which version they ran. When you see two agentic scores that look wildly far apart, check the version before you conclude anything. On the numbers that do line up, these two models are peers.

The cost gap is the actual story

Astra lists at 10 dollars per million input tokens and 50 per million output, with a Fast mode at roughly double for latency sensitive work. Kimi K3 on Moonshot's hosted API is 2.50 and 14, with cache reads at 0.29. On output tokens, the part of the bill that dominates for generation heavy and agentic workloads, K3 is about 72 percent cheaper. On input it is 75 percent cheaper. For a workload that produces a lot of tokens, an agent that writes code, a summarizer running over large corpora, a pipeline generating structured output at scale, that is not a rounding difference. It is the difference between a feature that pencils out and one that does not.

The output rate is where this bites hardest, because output tokens are billed at five times the input rate on Astra and a smaller multiple on K3. Any architecture that generates long completions is an output token machine, and at 50 dollars per million that adds up fast. We walked through why the output rate and the tokenizer together, not the sticker input price, decide the real bill in Grok 4.5 versus Sonnet 5 on production cost, tokenizer, and throughput, and the same logic applies here: model the cost on your actual input to output ratio, not on the headline input number.

Open weights changes the calculus beyond price

Kimi K3 is open weights, which means the 2.50 and 14 dollar API rates are a convenience, not a lock in. The weights shipped on Hugging Face as 96 shards, roughly 1.56 TB, under a custom Kimi K3 License rather than something permissive like MIT, so read the license before you build a business on it. K3 uses MXFP4 weights with MXFP8 activations, a low bit format chosen for broad hardware compatibility, which is a signal that Moonshot expects people to actually run it rather than only call the API.

Running a 2.8 trillion parameter model yourself is not a laptop exercise. It is a serious infrastructure commitment: multi node serving, real GPU memory, and an inference stack that can shard a model this size. But for an organization with data residency requirements, a compliance boundary that forbids sending prompts to a third party, or enough volume that self hosting beats per token pricing, the option to run the model at all is the whole point. Astra gives you no such option. You use it on OpenAI's terms or not at all. That is a fine trade for many teams and a dealbreaker for some, and it is the axis that open weights adds to the comparison that a closed model can never match. We took the open versus closed cost question apart in more depth in Kimi K3 versus Claude Opus 5 on coding cost per task.

Where Astra still earns its price

None of this makes Astra a bad buy. It holds the top GPQA score, it posts the strongest reasoning, math, and cybersecurity numbers OpenAI has shipped, and if your work sits at the absolute frontier of those domains the 2.5 point edge on GPQA plus whatever Astra specific tuning buys you can justify the rate. Astra also comes with OpenAI's operational maturity: uptime, tooling, ecosystem, and a support surface that a self hosted open model does not give you for free. For a team that wants the best available reasoning with no infrastructure to run and no license to vet, Astra at 10 and 50 is a clean answer, and the Fast mode covers the latency sensitive path. We compared Astra to its own predecessor stack in GPT-6 Astra versus GPT-5.6 Sol, is the upgrade worth it.

FAQ

Is Kimi K3 as good as GPT-6 Astra? On GPQA Diamond, the benchmark that compares cleanly between them, K3 scores 93.5 and Astra 96.0. That is close. On agentic benchmarks the reported numbers use different versions and do not compare directly. For most production work the models are peers and the deciding factor is cost and deployment model rather than raw capability.

Why can I not compare the Terminal-Bench scores? Astra reports Terminal-Bench 4.0 and K3 reports Terminal-Bench 2.1. Different versions have different tasks and scoring, so a higher number on an older version does not mean a better model. Always check the benchmark version before comparing agentic scores.

How much cheaper is Kimi K3? On Moonshot's hosted API, K3 is roughly 75 percent cheaper on input tokens and 72 percent cheaper on output tokens than Astra's list price. Output savings dominate for generation heavy and agentic workloads.

Can I actually self host Kimi K3? Yes, the weights are public, about 1.56 TB across 96 shards, under a custom license. Running a 2.8 trillion parameter model requires multi node GPU serving, so self hosting only makes sense at real volume or under a compliance constraint that forbids third party APIs.

When this applies to your stack

If you are choosing between these two, start by modeling cost on your real input to output token ratio, because the output rate is where the gap lives. If your reasoning workload is at the frontier and you want zero infrastructure, Astra is defensible. If you generate a lot of tokens, run at volume, or have a data boundary that rules out sending prompts to OpenAI, Kimi K3 is the model that gives you both a cheaper API and the option to run it yourself. Contra Collective helps teams make exactly this call, benchmarking candidate models on their own workloads and building the routing and cost controls that keep AI features profitable as they scale. If you are deciding where an open weights model fits against a closed flagship, we can help you run the numbers on your actual traffic.

External references: OpenAI's GPT-6 Astra launch coverage at simonwillison.net, the Vellum GPT-6 Astra benchmark writeup, and the Kimi K3 model card on OpenRouter.

[ 02 ] — Keep Reading

More from the lab.

Nov 7, 2026 AI Infrastructure

Gap and Christie's Are Running Production AI on Mac Minis: What Apple's Q4 Call Actually Revealed About Enterprise Local Inference

On its fiscal Q4 earnings call on November 2, 2026, Apple named two enterprise customers doing something more specific than the usual AI PC talking point: Gap runs AI loss prevention models across hundreds of stores entirely on Mac minis, which CFO Kevan Parekh described specifically as eliminating cloud token costs, and Christie's runs pricing estimate models on Mac Studio. Apple's pitch is that a few thousand dollar Mac can produce inference value worth tens of thousands over its life. That math is directionally right for a narrow set of workloads, and it is not a general argument against cloud inference, even though the earnings call framing invites you to read it that way.

Nov 6, 2026 AI Infrastructure

Kimi K3.1 Pro: Moonshot's Open Weight Model and What a 1M Token Context Actually Changes

Kimi K3.1 Pro went live in Moonshot's API on October 23, 2026, priced at 2 dollars per million input tokens and 10 dollars per million output tokens, with a 1 million token context window. Moonshot promised open weights by November 4. The model inherits Kimi K3's reported 2.8 trillion total parameters and 104 billion active parameters per token, which means the real question for most teams is not whether it is open but whether anything they own can actually run it.

Oct 29, 2026 AI Infrastructure

oMLX on Apple Silicon: What the SSD KV Cache Actually Buys Coding Agents

oMLX search interest has climbed fast this year, and the pull is a specific engineering claim: a coding agent's time to first token dropping from 90 seconds to as little as 3 once a long prompt's key value cache is already sitting on SSD instead of being recomputed from scratch. The architecture is real and the restore speed is measurable. The claim is also softer than the headline number suggests, and this post works through both halves.

Ready when you are

Want to discuss this topic?

Start a Conversation