But wouldn’t you rather hbm prices come down first ? Memory makers will be fine. There is practically infinite demand.
Unless you get china style rationing of compute per person world wide.
The real issue is everyone wanting to upgrade to hbm, ddr5, and nvme5 at the same time.
Where are you getting hourly costs for private models ? The rate limits are pretty arbitrary. If you max out by api tokens it would be like $10k / hour
Batch inference is much more efficient. Using the hardware round the clock is much more efficient. Cloud can absolutely pay more for hardware and still make money off you.
Cloud can pay more for RAM until all the RAM producers withdraw from the consumer market, then prices will go back down.
End users will still get access to RAM. The cloud terminal they purchase from Apple, Google, Samsung, or HP will have all the RAM it will ever need directly soldered onto it.
Doesn’t Apple place RAM directly into the SoC package? We aren’t even talking about soldering it to mother boards anymore, it is coming in with the CPU like it would as a GPU.
The next step, I think, will be a "cash for clunkers" program to permit people to trade in old computer hardware to the government—especially since operating systems that do not collect KYC data on their users will soon be illegal to operate.
Silicon Valley valuation numbers are entirely made up to boost their IPO. Actual value is only determined after these companies go public.
Allbirds, the shoe brand, went public at $4bn in 2021 and sold its assets last week for $39 million.
> Neil Saunders, the managing director of the consultancy and market analysis firm GlobalData said: “Allbirds has gone from being a high flyer to a dead parrot.” He said its early success “was driven by Silicon Valley hype, more than deep popularity with consumers in the American hinterland”.
reply