Sonntag, Juli 31, 2022
StartVirtual RealityNvidia's new liquid-cooled GPUs are heading to knowledge facilities

Nvidia’s new liquid-cooled GPUs are heading to knowledge facilities

Nvidia is taking some notes from the fanatic PC constructing crowd in an effort to cut back the carbon footprint of information facilities. The corporate introduced two new liquid-cooled GPUs throughout its Computex 2022 keynote, however they gained’t be making their manner into your subsequent gaming PC.

As a substitute, the H100 (introduced at GTC earlier this 12 months) and A100 GPUs will ship as a part of HGX server racks towards the tip of the 12 months. Liquid cooling isn’t new for the world of supercomputers, however mainstream knowledge middle servers haven’t historically been in a position to entry this environment friendly cooling methodology (not with out attempting to jerry-rig a gaming GPU right into a server, that’s).

Nvidia A100 liquid-cooled data center GPU.

Along with HGX server racks, Nvidia will provide the liquid-cooled variations of the H100 and A100 as slot-in PCIe playing cards. The A100 is coming within the second half of 2022, and the H100 is coming in early 2023. Nvidia says “not less than a dozen” system builders could have these GPUs obtainable by the tip of the 12 months, together with choices from Asus, ASRock, and Gigabyte.

Information facilities account for round 1% of the world’s whole electrical energy utilization, and practically half of that electrical energy is spent solely on cooling every part within the knowledge middle. Versus conventional air cooling, Nvidia says its new liquid-cooled playing cards can cut back energy consumption by round 30% whereas decreasing rack area by 66%.

As a substitute of an all-in-one system such as you’d discover on a liquid-cooled gaming GPU, the A100 and H100 use a direct liquid connection to the processing unit itself. All the pieces however the feed traces is hidden within the GPU enclosure, which itself solely takes up one PCIe slot (versus two for the air-cooled variations).

Information facilities take a look at energy utilization effectiveness (PUE) to gauge vitality utilization — primarily a ratio between how a lot energy a knowledge middle is drawing versus how a lot energy the computing is utilizing. With an air-cooled knowledge middle, Equinix had a PUE of about 1.6. Liquid cooling with Nvidia’s new GPUs introduced that all the way down to 1.15, which is remarkably near the 1.0 PUE knowledge facilities goal for.

Energy usage for Nvidia liquid-cooled data center GPUs.

Along with higher vitality effectivity, Nvidia says liquid cooling gives advantages for preserving water. The corporate says thousands and thousands of gallons of water are evaporated in knowledge facilities every year to maintain air-cooled techniques working. Liquid cooling permits that water to recirculate, turning “a waste into an asset,” in accordance with head of edge infrastructure at Equinix Zac Smith.

Though these playing cards gained’t present up within the huge knowledge facilities run by Google, Microsoft, and Amazon — that are possible utilizing liquid cooling already — that doesn’t imply they gained’t have an effect. Banks, medical establishments, and knowledge middle suppliers like Equinix compromise a big portion of the info facilities round immediately, they usually might all profit from liquid-cooled GPUs.

Nvidia says that is simply the beginning of a journey to carbon-neutral knowledge facilities, as nicely. In a press launch, Nvidia senior product advertising supervisor Joe Delaere wrote that the corporate plans “to assist liquid cooling in our high-performance knowledge middle GPUs and our Nvidia HGX platforms for the foreseeable future.”

Editors‘ Suggestions


Most Popular

Recent Comments