CRAYON
Every story · every side  ·  est. 1995
Technology

AI inference servers shrink to fit the air-cooled racks enterprises already run

Photo: SiliconAngle
CRAYON summary

SiliconAngle reports that power-efficient AI inference chips are becoming the entry price for enterprises that want to run AI on hardware they own, with inference servers now fitting the air-cooled racks companies already operate. The outlet says that as AI shifts from building models to running them daily, the cost of graphics processing unit racks and the liquid cooling they require has kept many companies renting compute instead. It adds that this gap is opening room for challengers.

Based on SiliconAngle's report - only one outlet has covered this so far. Read the original.
▲ Sign in to vote stories up

Coverage 1 source · 1 report

Chronological.

  1. SiliconAngle FIRST 2h ago AI inference servers shrink to fit the air-cooled racks enterprises already run

    Power-efficient inference chips are becoming the entry price for enterprises that want to run AI on hardware they own. As AI shifts from building models to running them every day, costly graphics processing unit racks and the liquid cooling they demand keep many companies renting compute instead. That gap is opening room for challengers to […] The post AI inference servers shrink to fit the air-cooled racks enterprises already run appeared first on SiliconANGLE .

Discussion 0 comments