Etched raises $300M at a $10.3B valuation on a bet that transformer-only chips will displace Nvidia at the inference layer
Article excerpt
The three Harvard dropouts behind Etched just closed a $300M Series C at a $10.3B valuation, doubling their worth in seven months, on a single architectural wager: that hardwiring the transformer into silicon beats running it on a general-purpose GPU every time. The round closed July 23, led by Sequoia in what the firm has described as its highest-valued Series C investment ever, with a16z, Jane Street, SK Hynix, and Diffusion joining alongside. That number alone would make Etched a remarkable story. What makes it a significant one is what the company is actually building, and why the math behind it is hard to dismiss. Etched's chip, the Sohu ASIC, does exactly one thing: run transformer model inference. There are no general-purpose compute paths, no fallback modes. The transformer architecture is literally hardcoded into the silicon, fabricated on TSMC's 4nm process node. The company claims an eight-chip Sohu server hits over 500,000 tokens per second on Llama 70B. An equivalent eight-GPU Nvidia H100 setup produces around 23,000 to 25,000 tokens per second. That's roughly a 20x throughput advantage, and if it holds in production, it reshapes the cost calculus of AI inference entirely. Those figures haven't been independently verified. Etched hasn't published batch-size numbers at the scale production environments typically require, and no third-party benchmarks exist yet...
Keep reading with a free account
The rest of this article, and every signal for Etched, is in your free account.
Extracted from this sentence
Etched has also moved fast on manufacturing infrastructure: a Taiwan facility is already operational, and the company recently opened an 80,000 square-foot facility 15 minutes from its office in Milpitas, California, a 10-megawatt site built to house an NPI lab, an in-house SMT line, and expanded deployment capacity.
