Nvidia's Nemotron 4 aims for one trillion parameters, a scale Chinese labs already surpassed

Nvidia is building Nemotron 4, a new open-weight model designed to compete with the best freely available models in the world. According to The Information, the largest model in the family will have at least one trillion parameters, twice the size of Nemotron 3 Ultra. Nvidia has tripled its cloud spending on in-house model training to $28 billion through 2031. The earliest possible release would be this fall.

Even at one trillion parameters, Nvidia would only be reaching a scale that Chinese labs already occupy. Moonshot AI's Kimi K3 has 2.8 trillion parameters, and DeepSeek V4 Pro has 1.6 trillion. At launch in June, Nemotron 3 Ultra was the strongest open US model on the Artificial Analysis Intelligence Index, but still trailed Kimi K2.6. On the current version of the index, Nemotron 3 Ultra scores 38 points and Kimi K3 around 60.

Nvidia is also among the signatories of a petition against regulating open models, even as the Trump administration considers targeted bans on specific Chinese models. The more companies self-host open models, the more GPUs Nvidia sells. But Nemotron 4 would also put Nvidia in direct competition with its own major customers like OpenAI.

AI News Without the Hype – Curated by Humans

Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.