It’s not a question of how good or bad the LLM is, it’s a question of watt hours and bandwidth. It takes a certain amount of electricity to run so your prices and profit margins are directly correlated with the price of electricity.
LLMs run out of data centers with cheap electricity and cheap bandwidth are going to be the cheapest ones on the market. For electricity this would typically be places with cheap renewables nearby like large hydroelectric plants. Bandwidth is a little trickier as there’s not as obvious an indicator of where bandwidth is cheap and plentiful but typically it’s going to be near major population centers. Putting those together there’s probably only a small handful of locations in the world where it’s economically viable to run these data centers.
Yep, this person did not take DeepSeek into account.
I wouldn’t put it past them banning it once they see how much it’s kicking their asses though
It’s not a question of how good or bad the LLM is, it’s a question of watt hours and bandwidth. It takes a certain amount of electricity to run so your prices and profit margins are directly correlated with the price of electricity.
LLMs run out of data centers with cheap electricity and cheap bandwidth are going to be the cheapest ones on the market. For electricity this would typically be places with cheap renewables nearby like large hydroelectric plants. Bandwidth is a little trickier as there’s not as obvious an indicator of where bandwidth is cheap and plentiful but typically it’s going to be near major population centers. Putting those together there’s probably only a small handful of locations in the world where it’s economically viable to run these data centers.
That’s not a constant across all LLMs. There are big differences between LLMs in how much inference you get per watt-hour.