AMD unveils Helion as agentic AI fuels demand for data center CPUs
Article excerpt
Highlighted: the sentence this signal was extracted from
AMD has introduced Helion, an open blueprint for data center racks that aims to give CPUs a larger role in running AI agents while allowing customers to configure GPU resources around their inference requirements. Based on Open Compute Project (OCP) specifications, the architecture supports different combinations of computing hardware. AMD cited examples including CPU-only racks for hyperscalers, powered by sixth-generation EPYC processors with up to 32,768 cores, and all-in-one enterprise racks accommodating up to 16 Instinct MI350P GPUs. AMD has listed networking bandwidth of up to 102 Tbps for Helion, although the company has not specified how that figure is calculated. The specification represents a planned rack capability rather than demonstrated performance in customer environments. An integrated token router is intended to direct AI agents' requests to different models, allowing enterprises to use cloud-hosted frontier models alongside open-source models running within the rack. AMD said the design supports both air and liquid cooling. The company plans to contribute the Helion specification to OCP for further development by the industry. The chipmaker has published statements of support from infrastructure vendors, including Cisco, Dell Technologies, HPE, and Lenovo. Rack configurations developed with ecosystem partners are expected to become available in November...
Keep reading with a free account
The rest of this article, and every signal for AMD, is in your free account.
