LLMDevelopmentC
Laya: a 421M non-autoregressive System 1 decision model at 33 ms per forward pass
Convai Innovations' open-source non-autoregressive System 1 decision model: 421M parameters, ModernBERT backbone with [MASK] option extraction, one 33 ms forward pass per calibrated decision, Apache-2.0; trained with RLCD strictly proper scoring rules for honest probabilities; the model card ships a real benchmark against Jev plus an honest limitations list. Positioned for edge and high-concurrency small decisions (game NPCs, dialogue policy, request routing), not long reasoning or open generation.
33 ms单次前向延迟(421M,官方)Vendor Claim · 2026-09
Laya: a 421M non-autoregressive System 1 decision model at 33 ms per forward pass