AI inference servers shrink to fit the air-cooled racks enterprises already run
SiliconAngle reports that power-efficient AI inference chips are becoming the entry price for enterprises that want to run AI on hardware they own, with inference servers now fitting the air-cooled racks companies already operate. The outlet says that as AI shifts from building models to running them daily, the cost of graphics processing unit racks and the liquid cooling they require has kept many companies renting compute instead. It adds that this gap is opening room for challengers.
Based on SiliconAngle's report - only one outlet has covered this so far. Read the original.Coverage 1 source · 1 report
Chronological.
-
AI inference servers shrink to fit the air-cooled racks enterprises already run
Power-efficient inference chips are becoming the entry price for enterprises that want to run AI on hardware they own. As AI shifts from building models to running them every day, costly graphics processing unit racks and the liquid cooling they demand keep many companies renting compute instead. That gap is opening room for challengers to […] The post AI inference servers shrink to fit the air-cooled racks enterprises already run appeared first on SiliconANGLE .
Discussion 0 comments