Demand from AI data centers drives up computer memory prices

4 hours ago

AI data center demand is causing computer memory prices to skyrocket, doubling or more for some products.
This price surge contradicts Moore's law, which predicted that technology would become cheaper and more powerful over time.
Moore's law faces physical limits at the nanometer scale, requiring more creativity and investment to maintain progress.
Supply and demand dynamics are driving the price increase, with AI companies like OpenAI needing massive amounts of memory—such as 40% of the world's supply for the Stargate project.
The long-term viability of Moore's law is uncertain, as technological breakthroughs must keep pace with surging AI demand.

Tech companies are increasing prices for older devices and consoles, reversing the trend of decreasing costs over time.
Apple and Microsoft are among the firms raising prices, citing rising component costs due to high AI demand for chips like RAM.
AI data centers are driving up demand for memory chips, leading to shortages and price surges, with RAM prices more than doubling recently.

AI compute demand is exploding, with GitHub commits up ~14x annualized, indicating massive inference growth.
AI companies are compute-starved, leading to usage limits, outages, and a domino effect as users switch between services.
Supply constraints include delayed GB200 rollout due to liquid cooling challenges, labor shortages, and geopolitical tensions.

Compute is becoming an indispensable resource akin to 'spice' in Dune, powering AI and constraining growth due to supply chain bottlenecks.
AI workloads, especially agentic systems, now consume 100x to 1,000x more tokens than traditional chatbots, accelerating demand.
Multiple simultaneous bottlenecks exist: GPU scarcity, memory price surges, TSMC capacity sold out, and power infrastructure constraints.

AI compute supply is seriously struggling to meet demand, with Anthropic recently experiencing severe uptime issues and degrading product features to free up compute.
Alibaba Cloud also reports inability to keep pace with customer demand, showing extreme contention for inference resources.
Agentic AI models are accelerating token demand as they handle complex tasks, with penetration still in low single digits among knowledge workers.

AI companies are creating a shortage of high-end computer memory, driving up prices for computer hardware and threatening the availability of affordable computers.
Generative AI does not scale efficiently; it suffers from quadratic scaling, leading to exorbitant costs and resource consumption as models grow larger.
Despite diminishing returns and inefficiency, tech companies continue to invest heavily in large models, prioritizing brute-force approaches over more efficient AI methods.

Tech companies are increasing prices for older devices and consoles, reversing the trend of decreasing costs over time.
Apple and Microsoft are among the firms raising prices, citing rising component costs due to high AI demand for chips like RAM.
AI data centers are driving up demand for memory chips, leading to shortages and price surges, with RAM prices more than doubling recently.

AI compute demand is exploding, with GitHub commits up ~14x annualized, indicating massive inference growth.
AI companies are compute-starved, leading to usage limits, outages, and a domino effect as users switch between services.
Supply constraints include delayed GB200 rollout due to liquid cooling challenges, labor shortages, and geopolitical tensions.

Compute is becoming an indispensable resource akin to 'spice' in Dune, powering AI and constraining growth due to supply chain bottlenecks.
AI workloads, especially agentic systems, now consume 100x to 1,000x more tokens than traditional chatbots, accelerating demand.
Multiple simultaneous bottlenecks exist: GPU scarcity, memory price surges, TSMC capacity sold out, and power infrastructure constraints.

AI compute supply is seriously struggling to meet demand, with Anthropic recently experiencing severe uptime issues and degrading product features to free up compute.
Alibaba Cloud also reports inability to keep pace with customer demand, showing extreme contention for inference resources.
Agentic AI models are accelerating token demand as they handle complex tasks, with penetration still in low single digits among knowledge workers.

AI companies are creating a shortage of high-end computer memory, driving up prices for computer hardware and threatening the availability of affordable computers.
Generative AI does not scale efficiently; it suffers from quadratic scaling, leading to exorbitant costs and resource consumption as models grow larger.
Despite diminishing returns and inefficiency, tech companies continue to invest heavily in large models, prioritizing brute-force approaches over more efficient AI methods.

Hasty Briefsbeta