A clear look at how AI performance depends on moving data efficiently across the stack.
Jeff Dean's conversation reads less like a victory lap than a compact lesson in hardware and systems tradeoffs. It stays grounded in specifics: SRAM versus HBM, the cost of moving a parameter compared with the multiply itself, and the appeal of batch size one for latency even…






