SambaNova Eyes 10-Trillion Parameter Models for Agentic AI with New Chip
Article excerpt
Highlighted: the sentence this signal was extracted from
SambaNova eyes 10-trillion parameter models for agentic AI with new chip. Press play to listen to this content SambaNova has unveiled its latest chip, the SN50, which it says is five times faster than Nvidia Blackwell and offers 3X the throughput, enough oomph to run agentic AI models exceeding 10 trillion parameters. It also announced the deployment of SN50s into Japan's SoftBank, a new partnership with Intel, and a $350 million fundraising round. SambaNova is one of the new chipmakers looking to capitalize on the AI boom and the insatiable demand for data processing that it has unleashed. The company developed its Reconfigurable Data Unit (RDU) architecture, which implements custom processing pipelines where data flows through the complete computation graph, to address the inefficiencies in data movement experienced by instruction set architecture (ISA) used by traditional CPUs and GPUs. Like the SN40, the SN50 features a tiered memory architecture that combines 64GB of high-bandwidth memory (HBM), 432 MB of static random-access memory (SRAM), and 256 GB to 2 TB of DDR5. SambaNova says this memory architecture allows it to host the largest AI models, including models with up to 10 trillion parameters. "Models residing in HBM and SRAM can be hot swapped in milliseconds, a capability that is essential for agentic workloads switching frequently between multiple models,"...
Keep reading with a free account
The rest of this article, and every signal for SambaNova, is in your free account.
