Microsoft CEO Satya Nadella on Thursday tweeted a video of his companyโs first deployed massive AI system โ or AI โfactoryโ as Nvidia likes to call them. He promised this is the โfirst of manyโ such Nvidia AI factories that will be deployed across Microsoft Azureโs global data centers to run OpenAI workloads.
Each system is a cluster of more than 4,600 Nvidia GB300 rack computers sporting the much-in-demand Blackwell Ultra GPU chip and connected via Nvidiaโs super-fast networking tech called InfiniBand. (Besides AI chips, Nvidia CEO Jensen Huang also had the foresight to corner the market on InfiniBand when his company acquired Mellanox for $6.9 billion in 2019.)
Microsoft promises that it will be deploying โhundreds of thousands of Blackwell Ultra GPUsโ as it rolls out these systems globally. While the size of these systems is eye-popping (and the company shared plenty more technical details for hardware enthusiasts to peruse), the timing of this announcement is also noteworthy.
It comes just after OpenAI, its partner and well-documented frenemy, inked two high-profile data center deals with Nvidia and AMD. In 2025, OpenAI has racked up, by some estimates, $1 trillion in commitments to build its own data centers. And CEO Sam Altman said this week that more were coming.
Microsoft clearly wants the world to know that it already has the data centers โ more than 300 in 34 countries โ and that they are โuniquely positionedโ to โmeet the demands of frontier AI today,โ the company said. These monster AI systems are also capable of running the next generation of models with โhundreds of trillions of parameters,โ it said.
We expect to hear more about how Microsoft is ramping up to serve AI workloads later this month. Microsoft CTO Kevin Scott will be speaking at TechCrunch Disrupt, which will be held October 27 to October 29 in San Francisco.
