AFAIK, it’s not “confirmed”, but there’s supposed to be warehouses full of GPUs, RAM, and storage that were pre-bought for datacentre usage, but they still have nowhere to plug them in.
For last 5 quarters, Nvidia has sold much more GPUs than get installed. On 3 year depreciation schedule, 8xh200s are $1.50/hour per card just sitting there. B200s are $2/hr. (Nvidia changes network cable each generation). Very expensive to do what you are suggesting is happening, but only other explanation is smuggling into China, or secret sovereign/military purchases.
It’s also possible that they are lent to tier 2/3 datacenters in revenue share deals.
AFAIK, it’s not “confirmed”, but there’s supposed to be warehouses full of GPUs, RAM, and storage that were pre-bought for datacentre usage, but they still have nowhere to plug them in.
For last 5 quarters, Nvidia has sold much more GPUs than get installed. On 3 year depreciation schedule, 8xh200s are $1.50/hour per card just sitting there. B200s are $2/hr. (Nvidia changes network cable each generation). Very expensive to do what you are suggesting is happening, but only other explanation is smuggling into China, or secret sovereign/military purchases.
It’s also possible that they are lent to tier 2/3 datacenters in revenue share deals.