Skip to content
←Back to Applications

APPLICATION

LLMDevelopmentTop

Jev: TypeSafe's first System One Model types decisions and prices them two orders of magnitude lower

typesafe-jev

TypeSafe's first System One Model: outputs are type-safe structured values under three question primitives (Noul/Choice/Score) rather than strings, trained with RLCD for calibrated decision probabilities. The official 13-question parallel experiment makes one synthesized call ~12.2x cheaper and ~10.0x faster than 13 separate calls; four-workflow mean accuracy 67.8% at /tmp/run_ingest2.sh.0004 and 0.4s per instance - opus 5 / sol tier accuracy at almost two orders of magnitude less cost; input $0.042/M tokens, output free. Ships an OpenJev local reproduction path and an eight-item caveats list.

C
CONFIDENCE
Vendor Claim
Official model card or keynote only, no independent re-test
67.8%
KEY METRIC
Mean accuracy across four workflows (vendor eval)
Vendor Claim · 2026-09
MATURITY
Product
research → demo → product → production
Editor's take

Reading: Jev carves "decisions" out of generation - type-safe outputs plus calibrated probabilities - a rare shape innovation at the base-model layer, and its ~2-order-of-magnitude cost gap makes it the default tier for high-frequency small decisions (routing, classification, next-action). The gap is equally clear: 67.8% four-workflow mean versus 73-74% for opus 5 / sol means long-horizon work still belongs to sequential flagships, and the official eval's reference labels come from competitor high-thinking tiers, so read it with a methodology discount. Confidence C (vendor claim): an OpenJev local reproduction path exists, but the in-house harness comparison is not finished.

System 1 ModelDecision ModelRLCDTypeSafe

Jev is TypeSafe's first commercial System One Model: instead of free-form strings it returns type-safe structured values under three question primitives (Noul / Choice / Score), so type errors are impossible at the protocol layer. Its training objective is not RLHF or RLVR but RLCD - strictly proper scoring rules that train decision probabilities into calibrated confidences callers can route on directly.

Its context accounting differs from sequential models: the whole state is read once and every question is answered in parallel. The official parallelism handbook runs 13 questions (8 Noul, 2 Choice, 3 Score) over a pinned GDPR Wikipedia full text: one synthesized call is about 12.2x cheaper and 10.0x faster than 13 separate calls, with identical answers; the quickstart page cites 11.5x and 9.6x for the same experiment, same order of magnitude. State plus all questions totals 64k tokens; state plus the longest single question, 32k.

The official eval decomposes tasks into questions plus code rules, with reference labels taken as the mean answer of the two strongest models at the time (GPT-6 Astra and Fable 5.1, both at high thinking). Across four workflows Jev averages 67.8% accuracy at $0.0004 and 0.4s per instance; the opus 5 workflow baseline is 73.1% / $0.1761 / 37.8s and sol is 74.1% / $0.0836 / 23.3s. Accuracy lands in the sonnet 5 / terra tier while cost sits almost two orders of magnitude away from everyone. The homepage's "193.6x faster, 444.6x cheaper" comes from this eval, and TypeSafe concedes it is the optimistic end of the real gain.

The bill is its hardest edge: $0.042 per million input tokens ($42 per billion), output free - 238x cheaper than Claude Fable 5.1's input price. The Doom demo at 10 queries per second costs about $7 per hour. Limits are 250k tokens/s and 1200 requests/min, explicitly dynamic during the early stage. Caveats matter too: on an open parallel constrained-decoding model (same calibrated-probability mechanism) we ran 30 gold-labeled decision cases and saw mean confidence 0.82 against actual accuracy 0.70 - calibrated confidences from this family cannot be consumed as accuracies.

More in LLM

4
LLMDevelopmentTopC

GLM-5.3: the open-weights coding flagship bought with post-training alone

Z.ai post-trained the very same base as GLM-5.2 and nothing else, producing the 744B-A40B GLM-5.3: 50 percent over 5.2 on the in-house Z.ai Code Bench, open-weights first on Terminal Bench 3.0 at 28.3 and Agents' Last Exam at 28.5, while AutomationBench 48.2 and GDPVal-AA v2 1769 beat every closed-source comparison on the official chart; CyberGym vulnerability discovery is SOTA and the exploitation-chain gains emerged without dedicated training. The companion 320B-A18B Flash starts from a new base and is the first GLM to mix sparse with linear attention, attacking long-context serving cost. Weights ship in FP8 and BF16, deployable on SGLang, vLLM, KTransformers and the Ascend stack.

28.3Terminal Bench 3.0 (top open-weight, vendor chart)Vendor Claim · 2026-08
ProductZ.ai (Zhipu AI)SiteRepo
GLM-5.3: the open-weights coding flagship bought with post-training alone
ReasoningDevelopmentTopA

Claude Fable 5.1: the long-horizon agentic tier that tops the ladder on a different ruler

The fixed version Anthropic positions for demanding reasoning and long-horizon agentic work (claude-fable-5-1, retirement no earlier than 2027-09-01): default thinking effort high at $10/$50 per million tokens, 2.5x sibling Opus 5.5, and default-high is itself a default cost behaviour. Its standing only holds once you switch rulers: #1 on net_improvement in the Arena Agent board (13.71, confirmed_success 19.83, praise 31.83) ahead of GPT-6 Astra (11.54/17.70/32.79), while Opus 5.5 misses the top eight; #2 on Terminal-Bench 4.0 at 57.88% (n=330), 0.3 points behind Astra at 58.18% but with pass@5 of 0.7879 against 0.7121, lower single-shot and more robust over five attempts; #4 on the intelligence index at 53.35 (max), below Opus 5.5. The picture is consistent: not first on composite intelligence, first on pushing a real task forward. A separate praise column means the board carries a human or judge component and is not an objective benchmark. Choose by whether the workload is hard from reasoning or from long-horizon consistency. Closed, API only. Graded A (confirmed); no long-task comparison on a standard harness.

13.71Arena Agent net improvementConfirmed · 2026-09
ProductAnthropicSite
Claude Fable 5.1: the long-horizon agentic tier that tops the ladder on a different ruler
ReasoningDevelopmentTopA

GPT-6 Astra: first on terminal engineering tasks, third tier on composite intelligence

The OpenAI flagship tier, officially positioned for hardest end-to-end work (gpt-6-astra): 1.05M-token context, 128K-token single output, knowledge cutoff 2026-04-30, with Functions, Web search, File search and Computer use built in, so search, retrieval and interface control ship with the model instead of an outer agent framework. Reasoning effort runs low to max in five steps while price stays fixed at $10/$50, so the cost lever is token consumption; siblings Sol ($2/$10) and Luna ($0.1/$0.5) make a 100x spread, so load splitting can stay inside one vendor. Readings (2026-09-22): #1 on Terminal-Bench 4.0 at 58.18% (n_trials=330, pass@5 0.7121), the protocol closest to a coding agent's daily life; #2 on Arena Agent with net_improvement 11.54 and confirmed_success 17.70, both below leader Fable 5.1, but the field's highest praise at 32.79; #6 and #7 on the intelligence index (max 52.67). The cutoff is nearly five months older than this page, so version numbers and API changes must go through Web search; computer-use reliability appears on no board; closed, API only. Graded A (confirmed); not independently benchmarked.

58.18%Terminal-Bench accuracyConfirmed · 2026-09
ProductOpenAISite
GPT-6 Astra: first on terminal engineering tasks, third tier on composite intelligence
LLMDevelopmentTopA

MiMo-V2.6: Live RL as an auditable ledger of 30 steps, 750k trajectories, and dollars

Xiaomi's open-source MiMo-V2.6 Pro/Flash: 30 steps of Live RL, roughly 750k trajectories, public cost of $850k/$2.62M, and 7k+ RL environments released in the same batch; tops the open-weights camp on the Artificial Analysis intelligence index at 46 with +17/+14 points out-of-sample on DeepSWE v1.1; four demo lines (Vibe World, CUA, research, content creation) all open. Self-improvement becomes an auditable ledger - steps, trajectories, and dollars on the table for third-party recomputation.

46Artificial Analysis Intelligence Index (top open-weight)Confirmed · 2026-09
ProductXiaomiSiteRepo
MiMo-V2.6: Live RL as an auditable ledger of 30 steps, 750k trajectories, and dollars

As an Amazon Associate, we earn from qualifying purchases.