Research · Compute × Power · Measurement
The denominator problem — what a GPU-hour actually costs in kilowatt-hours
Every compute-to-energy model in circulation runs on the same multiplication: nameplate TDP × hours × PUE. For an H100 that produces 0.91 kilowatt-hours per GPU-hour. That number is the denominator underneath data-center demand forecasts, interconnection studies, compute economics, and every energy-normalized compute index currently being designed.
It was also the denominator underneath four dashboards on this site.
A public dataset from the National Laboratory of the Rockies measured H100 training, fine-tuning, and inference workloads at 0.1-second resolution, then scaled those profiles into year-long facility demand. We rebuilt our compute energy layer on it. The short version: the nameplate denominator is wrong in three different ways, because a facility rating gets asked three different questions and only one of them is about energy.
The six terms this turns on
Most of the confusion in compute-energy estimates is terminological rather than mathematical. These six are not interchangeable, and picking the wrong one is what produces a forecast that is off by 40%.
Nameplate
700 W · 10 MWThe manufacturer's rated power under specified conditions. A capability, like a car's top speed — not the average speed of every trip.
Use for: ceilings, cooling design, protection
Duty factor
0.795 – 0.880Measured average workload power ÷ nameplate, across the busy period. 0.839 means the workload averages 83.9% of nameplate while active.
Use for: device energy, the GPU-hour
Peak derate
73.2% · 80.3%Maximum facility IT power ÷ rated IT power. A 10 MW facility peaking at 7.32 MW reaches 73.2% of rating.
Use for: interconnection, transformers
Capacity factor
59.1% · 66.3%Average IT power ÷ rated IT power over the period — the load-side analogue of the generator term. 5.91 MW average on 10 MW rated is 59.1%.
Use for: annual energy, cost, emissions
Node utilization
20 – 80% targetShare of facility nodes running workloads. Not GPU power ÷ TDP — 80% occupancy does not mean 80% of rated power.
An input, not an adjustment factor
PUE
1.3 typicalTotal facility power ÷ IT power. The source simulations exclude cooling, so PUE is applied as an external layer, never baked in.
Use for: IT energy → total site energy
Nameplate is a ceiling. Capacity factor is the energy forecast.
The infrastructure ceiling used to describe the facility.
Highest modelled IT demand, 80% utilization colocation case.
The power level that determines annual IT energy.
One rating, three questions
Before choosing a denominator, ask what you are estimating. The rating is the same; the correct adjustment is not.
How much power can the equipment demand?
NameplateStress testing and electrical design limits. In the source paper an H100 under gpu-burn reached 668.2 W against its 700 W rating — a 4.5% gap, because gpu-burn is built to push the device toward maximum sustained draw.
Use forComponent ratings, protection systems, cooling design, worst-case engineering.
How high can the facility actually peak?
Peak derateIn the year-long simulations the 10 MW colocation facility reached about 7.32 MW and the 1 MW inference facility about 0.80 MW. Both hit full node occupancy without reaching full rated IT power.
Use forInterconnection, transformer sizing, grid connection, demand charges.
How much energy will the facility consume?
Capacity factorAt 80% target node utilization the simulated capacity factors were approximately 59.1% for the 10 MW colocation case and 66.3% for the 1 MW inference case.
Use forEnergy procurement, emissions, cost, hedge sizing, generation and transmission planning.
Do not multiply all three factors together.
The measured workload profiles are already embedded in the facility simulation. Capacity factor already reflects workload draw, idle consumption, node occupancy, scheduling, and temporal demand patterns. Multiplying it by duty factor or peak derate counts the same effect twice. The calculator below enforces this — it asks which question you are answering, then shows only the denominator that belongs to it.
What are you estimating?
rated IT MW × capacity factor × 8,760 hours × PUECapacity factor is average IT power ÷ rated IT power — the load-side analogue of the generator term. It already contains workload draw, idle consumption, node occupancy, and the annual load shape.
Difference: 35.8 GWh per year before PUE, or 40.9% below the continuous-nameplate estimate. The unused energy is not spare capacity available in every hour — it is the gap between a theoretical 24×7 ceiling and the modelled annual load shape.
Capacity factor already reflects workload draw, idle consumption, node occupancy, scheduling, and the annual load shape. Multiplying it by duty factor or peak derate counts the same effect twice.
An energy-normalized compute index is structurally compute price ÷ modelled energy content. The price may be observable from transactions. The denominator is a stack of choices:
Two facilities running identical H100 hardware can deliver different energy per unit of compute because workload mix, batching, request rate, and operating policy differ. Any benchmark normalizing compute by energy should disclose all six layers and its update process as hardware and software change.
Methodology, sources, and which values are published vs derived
Published values — H100 SXM nameplate TDP (700 W); facility simulation tables (rated capacity, mean and peak power, peak-to-average ratio, queue time, request completion) at 20/40/60/80% target node utilization; workload mean busy power. Source: Vercellino et al., arXiv:2604.07345, and the associated dataset, DOI 10.7799/3025227.
Derived on this page — duty factors and their p10/p90 bands (sustained power ÷ 2800 W node GPU nameplate, computed across each trace’s busy period); capacity factors (mean IT power ÷ rated IT power); annual energy; nameplate overstatement (1 − duty factor, or 1 − capacity factor at facility level); hours above a share of peak; all cost figures.
Formulas — device: TDP × duty × hours × PUE; peak: rated IT MW × peak ratio; annual: rated IT MW × CF × 8,760 × PUE.
Boundaries — H100 SXM only, no H200 / B200 / B300 / GB200 NVL, no liquid-cooled or HVDC rack architecture. The facility simulations exclude cooling and non-IT load, so PUE is applied externally. Utilization shapes come from external workload datasets rather than direct observation of a commercial hyperscale site. Electricity prices are illustrative. CC-BY-4.0; derived figures published with attribution. Research and education only — not investment advice.
Real workloads are not stress tests
The paper reports an H100 stress-test result of 668.2 W against a 700 W TDP. That is only a 4.5% gap — and it is the wrong comparison for a GPU-hour energy denominator.
gpu-burn is designed to push the device toward maximum sustained draw. Real jobs include loading, evaluation, checkpointing, communication, batching changes, and pauses between phases. Across the full busy period the five published traces produce duty factors from 0.795 to 0.880 — real workload energy running roughly 12% to 21% below nameplate, averaging about 16%. Anyone quoting the 4.5% figure as an energy correction is quoting a ceiling as if it were an average.
| Workload | Mean busy power, 4-GPU node | Duty factor | Nameplate overstatement |
|---|---|---|---|
| Offline inference — Llama-3 70B | 2,463 W | 88.0% | 12.0% |
| Llama-2 70B LoRA fine-tuning | 2,440 W | 87.3% | 12.7% |
| Online rate inference — Llama-3 70B | 2,382 W | 85.1% | 14.9% |
| Stable Diffusion training | 2,261 W | 79.8% | 20.2% |
| Online finite inference — Llama-3 70B | 2,225 W | 79.5% | 20.5% |
The workload mix is not a detail. It changes the denominator.
At facility scale the correction gets larger
The device-level denominator is off by 12–21%. The facility-level one is off by more.
Take the simulated 10 MW colocation facility at 80% target node utilization: rated IT load 10.0 MW, maximum simulated IT load 7.32 MW, average simulated IT load 5.91 MW, capacity factor 59.1%. A nameplate-based annual forecast assumes 10 MW × 8,760 hours = 87.6 GWh. The measured-profile simulation implies 10 MW × 59.1% × 8,760 = 51.8 GWh — a difference of 35.8 GWh per year before PUE, or 40.9% below the continuous-nameplate estimate. For the 1 MW inference facility, annual IT energy is roughly 5.81 GWh rather than 8.76 GWh.
Announced megawatts describe infrastructure. Capacity factor determines megawatt-hours.
That gap propagates into utility load forecasts, generation and transmission planning, energy procurement, emissions estimates, behind-the-meter sizing, demand-charge expectations, and the valuation of any power hedge attached to compute.
One nuance worth carrying: capacity factor is an annual ratio produced by an hourly load shape, so raising it is an operating decision rather than a free improvement. At high utilization the load flattens — easier for a grid to serve — but the colocation case reaches mean queue times above six hours and the inference case leaves a material share of requests unserved. The operating frontier is drawable inside the calculator above. Higher utilization is not automatically better.
What this changed in our own numbers
This site’s energy-normalized compute analysis says it plainly in its own footer: “GPU TDP figures are nameplate.” The Compute × Power workbench used the same convention, as did the compute supply-curve work behind it. Every energy figure those tools produced inherited the 0.91 kWh denominator.
Rebuilt on measured duty factors, the same calculation gives roughly 0.76 kWh per GPU-hour at a 1.3 PUE — about 16% lower. Across one million GPU-hours that is 910 MWh on the old denominator against 763 MWh measured, a 147 MWh difference worth about $7,350 at $50/MWh or $29,400 at $200/MWh. The second tab of the calculator runs both conventions side by side against real hub prices, so the correction is inspectable rather than quietly patched.
Worth stating directly: the direction of that error is not intuitive, and it reverses depending on what you are computing. A lower energy denominator reduces the estimated energy cost of a GPU-hour — but it raises the implied compute heat rate, because the same rental is now supported by less electricity. One measurement correction, two headline numbers moving in opposite directions. That is precisely why a denominator has to be published rather than assumed.
What this means for an energy-normalized index
ICE and NATIVX have announced compute futures on the COIL Index, which tracks tokenized, energy-normalized compute — designed, in ICE’s framing, to “strip out the noise introduced by regional power cost disparities.” Normalizing by energy makes the index structurally a ratio:
compute price ÷ modelled energy content
The numerator is observable from transactions. The denominator is a methodology choice — and it is the same denominator this entire page is about.
A nameplate-derived denominator overstates device energy by 12% to 21% across the measured H100 workloads. A single fixed kWh-per-GPU-hour also misses a finding from the inference traces: as request rate rises, power flattens while throughput keeps improving, so energy per token falls even when server power barely moves. Two operators running identical H100 hardware can deliver genuinely different energy per unit of compute because their workload mix, batching, request rate, and utilization policy differ.
So the critique is not that energy normalization is wrong. It is that normalization does not remove the regional power-cost assumption — it relocates it into workload mix, where it is harder to see and nobody is quoting it. Whatever a benchmark treats as noise becomes basis that somebody else can own.
Energy normalization does not eliminate assumptions. It makes the assumptions tradable.
That is a fair question to put to any benchmark administrator, and it maps cleanly onto IOSCO’s benchmark principles — Principles 6 and 7 on design and data sufficiency, and Principle 11 on methodology content. Does a denominator derived from nameplate ratings adequately reflect the underlying interest? Six things would need disclosing before that question can be answered from the outside:
We ask having just corrected the same error in our own published work. The COIL methodology document is not out yet; if it already uses measured or transaction-derived energy content, this becomes corroboration rather than critique and the underlying point stands either way — the denominator deserves to be published, whatever it turns out to be.
The caveat that matters
This is an H100 calibration point, not a universal GPU law. The measurements do not cover H200, B200, B300, GB200 NVL, liquid-cooled rack systems, high-voltage DC architectures, or every training and inference workload. The facility model excludes cooling and other non-IT loads, and its utilization shapes come from external workload datasets rather than direct observation of a commercial hyperscale site.
Use it as measured evidence for H100 workloads, as a better calibration than nameplate-only arithmetic, and as a framework for asking the right question — not as a forecast for every AI data center. The dataset and tooling are open, which makes the next step available to anyone: repeat the measurement on newer hardware, more workload types, and real commercial operating profiles.
Use the right denominator
For equipment and infrastructure ceilings, start with nameplate. For a realistic facility peak, use the measured peak ratio. For annual energy, use capacity factor. For a GPU-hour, use a measured workload duty factor. And never multiply factors that already contain the same workload effect.
The rating tells you how large the machine is. The capacity factor tells you how much electricity it becomes.
Data and methodology. Primary workload and facility data derived from Vercellino, Willard, Campos, da Silva Pereira, Hull, Selensky & Mueller, “Measurement of Generative AI Workload Power Profiles for Whole-Facility Data Center Infrastructure Planning”, arXiv:2604.07345, and the associated public dataset, DOI 10.7799/3025227 (CC-BY-4.0). The paper measured NVIDIA H100 training, fine-tuning, and inference workloads at 0.1-second resolution and scaled them through the DIPLOEE discrete-event facility model; the colocation and inference simulations cover one year at one-minute resolution and exclude cooling and auxiliary loads. Duty factors, capacity factors, nameplate comparisons, and derived energy examples on this page are analytical transformations of the published traces and facility tables, reproducible via scripts/nlr/build_nlr_data.py. Hourly power prices from ERCOT MIS and PJM Data Miner 2. Electricity-price examples are illustrative. Research and education only — not investment advice.