ModularDC

What happens when the grid fails

When the utility supply to an AI data center fails, the racks keep running. A chain of machines takes over in a fixed order: batteries at once, diesel generators within 10 seconds, chillers within minutes. Scroll, and the clock runs.

The diagram is a simplified example site. Figures come from the standards and vendor documents listed under Sources. Typical values are marked as typical, and the temperatures are illustrative.

Chapters
  1. Normal operation
  2. The grid fails
  3. The generators start
  4. Transfer and walk-in
  5. Cooling rides through
  6. Running on generators
  7. What if a generator fails to start?
  8. What AI loads change
  9. The grid comes back
Power and cooling chain of a simplified example AI data centerUtility grid, transformer, three generators, a transfer switch, a switchboard, UPS A and UPS B with batteries, busways A and B feeding four liquid-cooled racks, a coolant distribution unit with pumps on the UPS, and chillers on the switchboard. The text next to the diagram describes each change.GRID · ONUtility13.8 kVTransformerto 480 VSTANDBYG1STANDBYG2STANDBYG3Generators0 rpm0 VLoad 0%Fuel 12 hABSwitchboardTRANSFER SWITCHgridgenUPS AGRIDBattery 100%UPS BGRIDBattery 100%CHILLERSRUN100%coolingnot on UPSGPU racks, liquid-cooledCDUPUMPS ON35.0 °Cto rackspumps on UPS

Normal operation

Before the outage

Power comes in from the utility at medium voltage, 13.8 kV in a typical US design. Transformers step it down to 480 V for the building (EC&M). Three diesel generators wait on standby at the top right.

Next comes the transfer switch, which connects the building to either the grid or the generators, and then the UPS. In a double-conversion UPS the rectifier turns AC into DC, the DC bus keeps the batteries charged, and the inverter turns DC back into AC. The racks always run from the inverter, never straight from the grid.

Each rack has two feeds, A and B, from separate UPS units and busways, and either one can carry it (ModulEdge). Inside an Open Compute rack, power shelves convert that to 48 to 50 V DC on a busbar; one current shelf delivers 33 kW (Advanced Energy).

Cooling is a second chain. A coolant distribution unit (CDU) pumps liquid through cold plates on the GPUs. The heat goes into a facility water loop and out through chillers. In this example the CDU pumps run from the UPS and the chillers do not. Keep an eye on both.

The grid fails

t = 0 to 50 ms

A fault on the utility line, and the site's voltage collapses. The racks notice nothing. The inverter was already carrying them, so nothing had to switch: a double-conversion UPS has no transfer time when its input fails (Schneider Electric).

50 ms to 1 s

The rectifiers have no input, so the batteries feed the DC bus. The chillers lose power and coast down. The CDU pumps keep turning, because they run from the UPS.

The transfer switch has seen the voltage drop, but it waits. NFPA 110 asks for a start delay of at least 1 second, so that a short dip does not start the engines for nothing (Nixon Power).

The generators start

t = 1 s to 4 s

The start signal goes out and the diesel engines crank. Each set has to reach 1,800 rpm, the speed that gives 60 Hz (CSE), and build up its voltage before it can take any load.

t = 4 s to 10 s

NFPA 110 calls an emergency system Type 10 when the load has acceptable power back within 10 seconds, with that first second of delay counted inside (ACHR News). This example site is Type 10. A single generator usually reaches rated voltage and frequency in about 10 seconds or less (Schneider Electric). Watch the battery gauge: it falls the whole time.

Transfer and walk-in

t = 10.00 s to 10.10 s

The generators are ready, and the transfer switch moves to the generator side. An open-transition switch breaks one connection before it makes the other, which takes 3 to 5 cycles, about 50 to 80 ms (Cummins). The UPS hides that gap the same way it hid the first one.

t = 10 s to 30 s

The UPS does not drop the full load on the engines in one step. Its rectifiers walk the load in over 10 to 20 seconds, and can be set to take up to about 30 (EC&M). As they take over, the batteries stop discharging. They have used a few percent of their charge.

Cooling rides through

t = 30 s to 85 s

The chillers got power back at 10 seconds, but a chiller cannot simply switch on again. A standard machine can take 10 to 15 minutes to restart (Trane). Quick-start models are faster: Daikin quotes a restart in 35 seconds and 80% load at 75 seconds (Daikin). The diagram uses those quick-start figures.

t = 85 s to 3 min

The coolant never stopped moving, because the CDU pumps are on the UPS. Without chillers the water warms; once they are back it cools down again. Vertiv notes that a high-power chip can reach its thermal limit in under a second if the coolant stops (Vertiv).

The temperatures here are illustrative. How fast the water warms depends on the loop's volume and the load, and we found no published figure for it.

Running on generators

t = 3 min to 1 h

The site now runs on diesel. The rectifiers recharge the batteries, and the operators watch the fuel. Published summaries of the Uptime Institute Tier standard give 12 hours of on-site fuel at design load as the minimum (POWER). ANSI/BICSI 002 uses 96 hours, and many operators design for 24 to 96 hours.

t = 1 h to 4 h

Large sites run many generators in parallel. Sets built for data centers start at about 1.5 MW, the most common size is 2 to 2.5 MW, and the largest reach about 4 MW (TechTarget). A 10 MW load needs five 2 MW sets, or six for N+1 (CSE). That sixth set is the subject of the next chapter.

What if a generator fails to start?

Again from t = 0, with N

Run the outage again, and this time generator 1 fails to start. With N redundancy the site has exactly as many generators as the load needs: two here, so generator 3 is not installed. One set alone cannot carry the hall, so the transfer switch stays put and the UPS stays on battery.

t = 12 s to 5 min 30 s

UPS batteries are sized for minutes. The Green Grid gives design runtimes of 1 to 2 minutes for hyperscale sites, about 5 minutes for colocation and 10 to 15 minutes for financial users (The Green Grid). This example has 5 minutes. When the battery is empty, the racks go dark. A real site might shed part of the load to keep the rest running.

Again from t = 0, with N+1

Now the same failure with N+1: three generators where two are needed. Generator 1 fails, generators 2 and 3 start, and the transfer happens at 10 seconds as before. The racks never see the failure. Uptime Institute's 2025 outage analysis still finds power the most common cause of impactful outages (Uptime Institute), with UPS failures a frequent source (DCK).

2N

2N doubles the whole chain: two independent systems, A and B, each able to carry the full load. Every rack has an A and a B feed, so a whole side can fail and the other side carries the racks, as B does here when UPS A fails. Tier III asks for concurrent maintainability, Tier IV for fault tolerance (POWER).

None fails: load lost
N+1one fails: load carried
2None side fails: load carried
Units needed for the load: two. A crossed unit has failed.

What AI loads change

Inside an AI rack

AI racks carry energy storage of their own. Some Open Compute racks add battery backup units in the power shelf format, rated for a few minutes; published ratings conflict, so take about 4 minutes as an example (Analog Devices). NVIDIA's GB300 NVL72 puts 65 joules of capacitors per GPU in its power shelves (NVIDIA).

Training load swings

A training job makes thousands of GPUs compute and then exchange data in step, so the whole hall's draw rises and falls together. NVIDIA smooths this with those capacitors, a power cap at start-up and a "power burner" that keeps GPUs drawing power as a job winds down, and reports up to 30% lower peak demand from the grid (NVIDIA). The storage smooths the load. It does not back it up.

The swing in the diagram is illustrative: first without smoothing, then with it.

10 July 2024, Northern Virginia

A lightning arrester failed on a 230 kV line, and repeated reclosing caused a series of voltage dips. About 60 data center load points at 25 substations saw the dips and switched to backup, most of them at the third dip. About 1,500 MW of load left the grid in one event (NERC).

About 1,500 MW moved to backup. Each square is one load point; the split between dips is illustrative.

What it did to the grid

Each site did what this page describes, and the grid suddenly carried 1,500 MW less. Operators removed shunt capacitors to keep the voltage from rising too far, and the load did not come back for hours (APPA). It happened again on 17 February 2025, about 1,500 MW, and on 22 July 2026, about 3,800 MW (APPA).

NERC's response

NERC has issued a Level 3 alert on large data center loads (Renewable Energy World). Under a FERC order of 16 July 2026, NERC must file the first phase of enforceable standards by 31 December 2026, and ride-through requirements are expected in 2027 (APPA). Ride-through means a site stays on the grid through a short dip instead of leaving it.

The grid comes back

t = 4 h: utility back

Back to the first outage. Hours later the utility returns, and the transfer switch does not jump straight over. It waits until the supply has been stable for a set time, and if the supply wobbles, the timer starts again (Cummins). Operators choose that time; this example uses 5 minutes.

t = 4 h 05 min: retransfer

Then it retransfers. A closed-transition switch connects the utility before it lets go of the generators, with less than 100 ms of overlap, so even the UPS sees no break (Siemens). The generators run unloaded for a few minutes to cool down, then stop; this example uses 5 minutes. The batteries finish charging, and the site is back where it started.

Try it in the lab

Cut the grid, trip a UPS or stop a pump in a simplified teaching model of a 2.4 MW example hall, and watch the backup take over.

Open the lab

Sources

Three documents could not be read in full here. Their figures come from the publisher's summary or a search extract, and they are marked "read via summary".

  1. EC&M High-availability electrical design for today's data center13.8 kV medium voltage, 2,500 kVA unit substation to 480Y/277 V
  2. ModulEdge Data center power distributionUPS at 480 V, IT distribution at 415/240 V or 208/120 V, 2N
  3. Schneider Electric White Paper 1: The different types of UPS systemsDouble conversion: no transfer time on input failureread via summary
  4. Advanced Energy ORv3 HPR power shelf and PSU datasheet50 V DC busbar, 33 kW in a 1OU shelf
  5. Vertiv Why your liquid cooling investment needs dedicated power protectionChip thermal limit in under 1 s without cooling; CDU pumps on UPS
  6. Nixon Power Services NFPA 110 generator requirements for data centers and hospitalsType 10: power back within 10 s; minimum 1 s start delay
  7. ACHR News Standby power: behind the 10-second startNFPA 110 start delay counted inside the 10 s
  8. The Green Grid UPS battery runtime by customer typeHyperscale 1-2 min, colocation about 5 min, finance 10-15 min
  9. Schneider Electric Design considerations for the deployment of UPS systems in data centersBattery runtime must exceed generator start time; single generator about 10 s or less
  10. Consulting-Specifying Engineer Paralleled generator system considerations1,800 rpm diesels rarely exceed 2,500 kW; 10 MW = five 2 MW sets, six for N+1
  11. TechTarget Data center backup generators for mission-critical loadsSets from 1.5 MW; 2-2.5 MW most common; up to 4 MW
  12. Cummins Transfer switch technical paper PT-7016Open transition 3-5 cycles; retransfer timer; generator cool-down
  13. Siemens (Russelectric) RTS-03 automatic transfer switchClosed transition with less than 100 ms of paralleling
  14. EC&M Working in harmony: generator and UPS compatibilityRectifier walk-in over 10-20 s, up to about 30 s
  15. Trane CenTraVac chiller sales literature CTV-SLB033Standard chiller restart up to 10-15 min (vendor figure)
  16. Healthcare Facilities Today Daikin Magnitude chillers with RapidRestoreRestart in 35 s, 80% load at 75 s (vendor figure)
  17. Data Center Knowledge Speeding up those chiller restartsYork quick start: 13 min down to under 3 min
  18. Upsite Technologies ASHRAE fifth edition thermal guidelines, liquid cooling chapterFacility water classes W17 to W45 and W+
  19. POWER Understanding Uptime Institute's Tier III standard12 h on-site fuel minimum; N+1; 2N+1; Tier III and IV
  20. Uptime Institute Annual outage analysis 2025Power remains the most common cause of impactful outages
  21. Data Center Knowledge Data center outages decline for fourth straight year, but issues persistUPS failures particularly problematic
  22. Analog Devices Smart battery backup for uninterrupted energy, part 1ORv3 battery backup shelf, about 4 min; published ratings conflict
  23. NVIDIA How new GB300 NVL72 features provide steady power for AI65 J of capacitors per GPU; up to 30% lower grid peak
  24. NERC Incident review: large load loss (published 8 January 2025)10 July 2024, about 1,500 MW, 60 load points, 25 substationsread via summary
  25. American Public Power Association NERC incident review examines risks tied to integration of large loads
  26. American Public Power Association PJM, Dominion review large load transfer eventAbout 1,500 MW on 17 Feb 2025; about 3,800 MW on 22 Jul 2026; FERC and NERC timeline
  27. Renewable Energy World NERC issues Level 3 alert on data center loadsread via summary

Questions

Do the servers lose power when the grid fails?

Not if the chain works. In a double-conversion UPS the inverter already feeds the racks, so the transfer time on a grid failure is zero (Schneider Electric, White Paper 1). Batteries carry the load until the generators take it over, within 10 seconds for an NFPA 110 Type 10 system.

How long do data center UPS batteries last?

Minutes. The Green Grid gives design runtimes of 1 to 2 minutes for hyperscale sites, about 5 minutes for colocation sites and 10 to 15 minutes for financial users. Flywheel systems give about 15 to 20 seconds at full load. The battery only has to bridge the gap until the generators carry the load.

How fast do backup generators start?

NFPA 110 Type 10 requires acceptable power at the transfer switch within 10 seconds. That time includes a start delay of at least 1 second, so a short voltage dip does not start the engines for nothing. A paralleled system with many generators can take longer to synchronize.

How long can a data center run on generators?

As long as it has fuel. Published summaries of the Uptime Institute Tier standard give 12 hours of on-site fuel at design load as the minimum. ANSI/BICSI 002 uses 96 hours, and many operators design for 24 to 96 hours.

What do N, N+1 and 2N mean?

N is exactly enough capacity for the load. N+1 adds one spare unit, so one unit can fail or be out for maintenance. 2N is two complete, independent systems, each able to carry the whole load alone. 2N+1 adds a spare to that.

Why are AI data centers a concern for the grid?

On 10 July 2024 a fault on a 230 kV line in Northern Virginia caused repeated voltage dips, and about 1,500 MW of data center load at 60 sites switched to backup power during the same event (NERC). Grid operators had to remove shunt capacitors to keep the voltage in range. Similar events followed in February 2025 and July 2026, and NERC is now writing ride-through standards for large loads.