Sam Altman says it’s better for RAM to be in a data center than on your desk
Sam Altman argues that concentrating scarce DRAM in data centers for maximum utilization is better than having it sit idle in personal computers.Summary
In an interview on the Cheeky Pint podcast, OpenAI CEO Sam Altman addressed the ongoing RAM shortage and the push for local AI inference. He stated that while many people want to run open-source models on their own computers, from a global allocation perspective it is “quite terrible” to have the world’s limited DRAM supply sitting in personal PCs and being used only five percent of the time. Altman stressed that maximum utilization in the cloud is necessary in a supply-constrained environment. His remarks come as memory makers Samsung and SK Hynix have signed long-term deals with cloud operators and projects like OpenAI’s Stargate, reserving much of the world’s RAM output for years and driving up prices for consumer devices.
(Source：The Verge)