AMD Doubles Down on AI with Instinct MI350 Series and ROCm 7

AMD unveiled its next-generation Instinct MI350 series AI accelerators, boasting double the AI performance of its predecessor, the MI300X, thanks to the new CDNA 4 architecture. The MI350 series supports FP6 and FP4 formats for increased throughput and features 288GB of HBM3E memory with 8TB/s bandwidth. Complementing the hardware is ROCm 7, delivering performance improvements and day-0 support. AMD also announced turnkey rack-scale AI solutions integrating AMD CPUs, GPUs, and networking, and laid out a roadmap targeting a 20x increase in rack-scale energy efficiency by 2030. The MI355X, the flagship model, offers up to 5 PFLOPS of FP16 performance.