News
EveryDatacenter

AI training and inference

Training and serving large AI models. 119 data centres on EveryDatacenter so far.

AI data centres train and serve machine-learning models. Training a large language model uses tens of thousands of GPUs or other accelerators for weeks or months in one place; serving it ("inference") runs in many data centres closer to users. Both need far more power per rack than ordinary servers, and AI is now the main driver of new data centre building.

Training and inference

Training needs the largest single clusters, joined by very fast networks, so it goes to gigawatt campuses such as Stargate at Abilene, Colossus in Memphis and Meta's Hyperion in Louisiana. Inference needs less power in one place but runs all the time and grows with users, so it spreads into cloud regions and colocation halls. The IEA expects AI to be the main reason data centre power use doubles by 2030.

National AI capacity

Many governments now fund AI computing at home. India's IndiaAI Mission, approved in 2024, rents tens of thousands of GPUs from Indian firms such as Yotta, E2E Networks and others for start-ups and researchers. Saudi Arabia set up Humain in 2025, the UAE is building a 5 GW AI campus in Abu Dhabi, and Europe funds AI factories at its supercomputer centres.

Famous AI training and inference data centres

Further reading

NJFX 馃嚭馃嚫 United StatesNJFX Wall Township campus pairing colocation with a subsea cable landing stationColocation 路 Grid power 路 2017 馃嚘馃嚭 Australia and 1 moreNextDC Australian data centre operator and developer listed on the ASX.Operator 路 Grid power 路 2010 STT GDC Kolkata campus 馃嚠馃嚦 IndiaSTT GDC Kolkata campus Two enterprise data centres in Kolkata, India, run by STT GDC.Colocation 路 Grid power 路 2009 DataBank 馃嚭馃嚫 United StatesDataBank US colocation operator with 70+ facilities across 25 metro marketsColocation 路 Grid power Element Critical 馃嚭馃嚫 United StatesElement Critical US data centre operator focused on enterprise and AI colocationColocation 路 Grid power 路 2014 Sify Chennai campus 馃嚠馃嚦 IndiaSify Chennai campus Two data centre sites in Chennai run by Sify Technologies.Hyperscale 路 Grid power 路 2024 Pi Datacenters 馃嚠馃嚦 IndiaPi Datacenters Indian hyperscale data centre and cloud provider with Tier IV certificationHyperscale 路 Grid power IXAfrica Data Centres 馃嚢馃嚜 KenyaIXAfrica Data Centres Hyperscale data centre campus in Nairobi, KenyaHyperscale 路 Wind and solar 路 2021 Chindata Group 馃嚚馃嚦 China and 2 moreChindata Group Asian data centre operator with facilities in China, Malaysia and ThailandHyperscale 路 Grid power 路 2015 EDGE2 Jakarta 馃嚠馃嚛 IndonesiaEDGE2 Jakarta AI-ready data centre in downtown Jakarta with 23 MW capacity.Colocation 路 Grid power 路 2024 CtrlS Navi Mumbai campus 馃嚠馃嚦 IndiaCtrlS Navi Mumbai campus Hyperscale data centre campus in Navi Mumbai with renewable power.Hyperscale 路 Grid power NTT Tokyo Inzai campus 馃嚡馃嚨 JapanNTT Tokyo Inzai campus 50 MW colocation campus in Shiroi City for AI and cloud workloads.Colocation 路 Grid power 路 2027 Yotta G1 馃嚠馃嚦 IndiaYotta G1 Colocation and cloud data centre in GIFT City, GujaratColocation 路 Grid power 路 2024

Photo credits on this page

The small pictures above come from Wikimedia Commons under free licences. Some are cropped to fit.

The weekly digest

Every Monday: the data centre of the day, new pages on EveryDatacenter, and the conferences and anniversaries of the week ahead.