The whole dayThu 15 Oct 2026
AI Compass

Microsoft AI finishes pre-training MAI-Base-2, a 2.8T-parameter model

The unreleased base model beats every open-weight model Microsoft AI tested on its own held-out evaluations and is now being post-trained.

“Frontier Pre-training at Microsoft AI” in cream serif letters over soft, grainy pink and orange clouds in a blue sky
Image: Microsoft AIMicrosoft AI’s share image for the post

Microsoft AI has finished pre-training MAI-Base-2, a mixture-of-experts model with 2.8T parameters, 80B of them active per token. Its predecessor, MAI-Base-1, has 1T parameters with 35B active and underlies MAI-Thinking-1, which the lab announced in June 2026. A base model is the raw result of pre-training, before the post-training that shapes it into a usable assistant.

The lab tested it on held-out code, question answering, STEM and maths sets kept out of its training data, scoring bits per byte, where lower is better. MAI-Base-2 beat DeepSeek-V4-Pro-Base, the strongest open base model, and three post-trained open models, a comparison the lab says post-training may affect.

MAI-Base-2 has the lowest bits per byte on all four held-out tests, such as 0.2203 on code against 0.2264 for Kimi K3 and 0.2370 for DeepSeek-V4-Pro-Base
Figure 1 of the post, held-out bits per byte, where lower is betterImage: Microsoft AI

It also estimates that DeepSeek-V4-Pro-Base used 4.2 to 12.3 times the training compute that its own recipe would need for the same scores.

Scaling curves put DeepSeek-V4-Pro-Base at 4.2 to 12.3 times the training compute Microsoft AI’s recipe needs for the same score, and MAI-Base-1 at 6.3 to 12.7 times
Figure 3 of the post, the compute each model needed against Microsoft AI’s recipeImage: Microsoft AI

Training ran on 16k GB200 GPUs for 38 days in August and September 2026, on a 50T-token mixture with a March 2026 knowledge cutoff. The lab says it used no distillation from other models, and unlike its predecessor, MAI-Base-2 learned from images from the start.

Microsoft AI plans to use the model first in Microsoft’s own products and to license the weights to trusted partners through Foundry. It hasn’t given a release date or price.

The rest of the day

Read the whole day

Spotted an error? Email aiforsuccess.in+compass@gmail.com or tag @ai_for_success on X