A.I. Chips

With Maia 300, Microsoft Wants to Break Free From Nvidia

Microsoft's Azure Maia 300 A.I. chip on a blue-lit surface
Microsoft’s Azure Maia 300 A.I. chip. © Microsoft

Set Trending Topics as a preferred source on Google.

Microsoft is tired of paying Nvidia for every A.I. answer: The company plans to deploy its in-house Maia chips at scale starting in 2027 and make them the main system for A.I. inference across its own products. “We will scale our Azure Maia family to multi-gigawatt deployments starting in 2027,” Scott Guthrie, Microsoft’s head of cloud, announced in a blog post. At the same time, Microsoft introduced the Maia 300, the third generation of its A.I. accelerator.

What the Maia 300 Is Supposed to Do

The new chip was built from the ground up for inference, meaning running A.I. models rather than training them. Microsoft names long-context reasoning, conversational apps that need fast responses and A.I. agents that carry out many steps in a row as its main uses. The key specs:

  • Manufacturing: The compute chiplets are made with TSMC’s 2-nanometer N2P process.
  • Memory: Each chip has eight HBM4 stacks with 288 gigabytes and 18 terabytes per second of bandwidth, 2.5 times as much as its predecessor, the Maia 200.
  • Rack: 96 accelerators share a rack drawing 167 kilowatts, with 27.6 terabytes of HBM memory. Such a rack is supposed to deliver up to seven times as many tokens as a Maia 200 rack.
  • Efficiency: Microsoft promises 40 percent more tokens per megawatt than “leading GPU-based systems.” The company does not mention Nvidia by name.

The first production deployments are planned for 2027. According to The Information, Microsoft has asked TSMC for manufacturing capacity for more than 300,000 Maia 300 chips for 2027.

Maia 200 Already Runs Copilot

Its predecessor, the Maia 200, made with a 3-nanometer process, has been in use since January, first in a data center in Iowa and now also in Europe and Australia. It already serves Microsoft Copilot and supports model development by Microsoft’s in-house A.I. team, MAI, while GitHub Copilot and the developer platform Foundry are set to follow by the end of the year. The chips run models from OpenAI, Microsoft’s own MAI models and popular open-source models. For A.I. features in Teams and Copilot, Microsoft cites up to 1.7 times as many tokens per watt as on GPU infrastructure.

Why Microsoft Builds Its Own Chips

The math behind the project is simple. Nvidia is making a fortune from the A.I. boom: Its data center business alone recently brought in $89 billion in revenue (about €79 billion) in a single quarter, at a gross margin of 75 percent. Hyperscalers like Microsoft pay a large share of that. With its own chips for inference, which grows with every Copilot user and every A.I. agent, Microsoft wants to keep that margin for itself and free up its expensive Nvidia systems for paying Azure customers.

Microsoft is not alone in this strategy. Google has relied on its TPUs for years, Amazon on its Trainium chips, and OpenAI is bringing its first inference chip, Jalapeño, developed with Broadcom, into its own data centers. Nvidia, for its part, showed how seriously it takes the inference market with its $20 billion deal (about €17.8 billion) with the chip start-up Groq.

A Bumpy Road So Far

Whether Microsoft can noticeably reduce its dependence on Nvidia remains to be seen. The chip program has long made slow progress: The first Maia 100 was deployed only in small numbers, and the Maia 200 arrived late and, according to The Information, was recently running in just two U.S. data centers. All efficiency figures for the Maia 300 come from Microsoft itself and refer to unnamed GPU systems. There are no independent benchmarks yet, and Nvidia is already shipping its next chip generation, Vera Rubin, while the Maia 300 is not supposed to go into operation until 2027. Microsoft plans to share more details at its Ignite conference.

Rank My Startup: Erobere die Liga der Top Founder!
Advertisement
Advertisement

Specials from our Partners

Top Posts from our Network

Deep Dives

© Wiener Börse

IPO Spotlight

powered by Wiener Börse

Europe's Top Unicorn Investments 2023

The full list of companies that reached a valuation of € 1B+ this year
© Behnam Norouzi on Unsplash

Crypto Investment Tracker 2022

The biggest deals in the industry, ranked by Trending Topics
ThisisEngineering RAEng on Unsplash

Technology explained

Powered by PwC
© addendum

Inside the Blockchain

Die revolutionäre Technologie von Experten erklärt

Trending Topics Tech Talk

Der Podcast mit smarten Köpfen für smarte Köpfe
© Shannon Rowies on Unsplash

We ❤️ Founders

Die spannendsten Persönlichkeiten der Startup-Szene
Tokio bei Nacht und Regen. © Unsplash

🤖Big in Japan🤖

Startups - Robots - Entrepreneurs - Tech - Trends

Continue Reading

Newsletter

Founders Dispatch

Zwei Mal pro Woche kostenlos in die Inbox: die wichtigsten Startups, Deals und Tech-Entwicklungen aus Europa, handgeschrieben von der Redaktion.

Jederzeit abbestellbar. Mehr über den Newsletter