Why GPU Server Prices Are Unpredictable

Soaring demand for a limited supply of memory chips and other components has quickly pushed up prices for the Nvidia AI servers those chips go into, particularly over the last few months. 

That’s made it more difficult for cloud providers that buy the servers to create budgets and predict future costs, and has prompted many of them to raise prices for their AI developer customers, according to conversations with server rack sellers, cloud provider executives and public pricing data.