Nvidia and Cerebras are selling performance their customers will (probably) never see

Shots were fired at the Hot Chips conference in California this week as Nvidia announced its new Groq-3-based LPX racks had entered production, with early tests showing the systems churning an eye-watering 3,400 tokens a second in Gemma 4 31B. That's four times faster than rival Cerebras. A day later, Cerebras fired back, touting nearly equivalent performance from its next-gen CS-4 accelerators revealed last week. These top-line performance figures make inference feel instantaneous relative to t