#Code Models (1)

Pretraining at Scale Without a Pretraining Team: One Researcher, 3.5 Months, Under $10M

Mirendil-Base, the first pretrained coding model built by one researcher with agents in 3.5 months and under $10M compute, beats several 100B+ MoE bases on held-out code bits per byte.

BLOG