News
EveryDatacenter

GPU density

How many GPUs, and so how much power and heat, are packed into each rack or hall.

Also: AI density, rack density

AI systems work best when GPUs are packed close together, because shorter links between them are faster. That drives density up. Nvidia's GB200 NVL72 puts 72 GPUs in a single rack drawing about 120 kW, more than ten times the load of a typical server rack of the 2010s, and later designs aim higher. Such racks need direct liquid cooling, heavy power feeds and strong floors, which older data centres often cannot provide.

See also

Find data centres that mention GPU density

The weekly digest

Every Monday: the data centre of the day, new pages on EveryDatacenter, and the conferences and anniversaries of the week ahead.