$2 H100s: How the GPU Bubble Burst - by Eugene Cheah
www.latent.space/p/gpu-bubble
What Jamie wrote
Where there is demand the market is going to react. It is hard to see a future where Nvidia has a lock on GPU capabilities that lasts for a long time. Even if AMD and Intel are slow to the game they should be close enough?
We are looking at a >= 40% price drop per year, especially for small clusters. NVIDIA's marketing projection of $4 per GPU hour across 4 years, has evaporated away in under 1.5 years.
It is interesting that part of this demand loss seems to be the biggest workloads going private because they need even larger clusters. There was also a fun callout to crypto having less demand in part due to transitions away from proof-of-work.
Overall an incredible dynamic market with super high capital requirements.