Microsoft Finishes Pre-Training MAI-Base-2, a 2.8-Trillion-Parameter Model

Microsoft’s MAI-Base-2 Model Microsoft spent 38 days and 16,000 Nvidia GB200 chips building an AI model it has