Microsoft Boosts HBM Bandwidth by 2.5x with Maia 300 Accelerator
Microsoft increases memory throughput to 18 TBps on custom Maia 300 inference accelerator

Microsoft has revealed its Maia 300 AI accelerator, increasing high-bandwidth memory throughput to 18 terabytes per second from 7.1 TBps on the earlier Maia 200. The 2.5-fold increase in memory bandwidth is engineered to process AI inference workloads more efficiently whilst decreasing energy expenditure on a per-token basis. Cloud and AI executive vice president Scott Guthrie presented the silicon update as part of the group's ongoing custom infrastructure roadmap.
Original source
This summary was written by the GPU Data Hub desk from reporting published by HPCwire on 12 Oct 2026, 22:46. Read the full article at the original publisher.
Read Original Source →Companies