OpenAI CEO Sam Altman said on the Cheeky Pint podcast that it is quite terrible, from a global allocation view, for people to hold limited DRAM in their own computers and use it about 5% of the time. He was discussing local AI inference. His comments drew ridicule online.
OpenAI CEO Sam Altman appeared on Stripe cofounder John Collison's Cheeky Pint podcast. He said that, from a global allocation perspective, it is quite terrible for everybody to have a bunch of the world's limited supply of DRAM sitting in their own computer and used 5% of the time. Altman said the memory in personal computers gets used just 5% of the time.
The local inference context
Altman was specifically talking about local inference, meaning running AI models on one's own computer. He said many people want local inference and assume open-source models running on their own computers mean data center capacity won't be needed. Altman argued that scarce memory belongs in cloud servers rather than spread across home machines. He said that in a very supply-constrained environment you want maximum utilization in the cloud, and that many people's intuition is the opposite. According to Altman, DRAM belongs in data centers running flat out, making local AI a terrible allocation of scarce resources.
Memory shortage and reaction
AI data centers are soaking up so much DRAM that the shortage is raising prices on everyday electronics. AI data centers have consumed so much of the world's RAM supply that prices of memory and of electronic devices containing it have skyrocketed. Altman's comments sparked widespread ridicule and backlash online, including among gamers, with many memes and AI-generated videos mocking him.
