Kinetic Alpha

Research · Compute × Power · Measurement

The denominator problem — what a GPU-hour actually costs in kilowatt-hours

Every compute-to-energy model in circulation runs on the same multiplication: nameplate TDP × hours × PUE. For an H100 that produces 0.91 kilowatt-hours per GPU-hour. That number is the denominator underneath data-center demand forecasts, interconnection studies, compute economics, and every energy-normalized compute index currently being designed.

It was also the denominator underneath four dashboards on this site.

A public dataset from the National Laboratory of the Rockies measured H100 training, fine-tuning, and inference workloads at 0.1-second resolution, then scaled those profiles into year-long facility demand. We rebuilt our compute energy layer on it. The short version: the nameplate denominator is wrong in three different ways, because a facility rating gets asked three different questions and only one of them is about energy.

0.91 kWh
the assumed denominator
700 W × 1 h × 1.3 PUE
0.76 kWh
the measured denominator
at the 0.839 average duty factor
59.1%
colocation capacity factor
10 MW case, 80% node utilization
66.3%
inference capacity factor
1 MW case, 80% node utilization

The six terms this turns on

Most of the confusion in compute-energy estimates is terminological rather than mathematical. These six are not interchangeable, and picking the wrong one is what produces a forecast that is off by 40%.

Nameplate

700 W · 10 MW

The manufacturer's rated power under specified conditions. A capability, like a car's top speed — not the average speed of every trip.

Use for: ceilings, cooling design, protection

Duty factor

0.795 – 0.880

Measured average workload power ÷ nameplate, across the busy period. 0.839 means the workload averages 83.9% of nameplate while active.

Use for: device energy, the GPU-hour

Peak derate

73.2% · 80.3%

Maximum facility IT power ÷ rated IT power. A 10 MW facility peaking at 7.32 MW reaches 73.2% of rating.

Use for: interconnection, transformers

Capacity factor

59.1% · 66.3%

Average IT power ÷ rated IT power over the period — the load-side analogue of the generator term. 5.91 MW average on 10 MW rated is 59.1%.

Use for: annual energy, cost, emissions

Node utilization

20 – 80% target

Share of facility nodes running workloads. Not GPU power ÷ TDP — 80% occupancy does not mean 80% of rated power.

An input, not an adjustment factor

PUE

1.3 typical

Total facility power ÷ IT power. The source simulations exclude cooling, so PUE is applied as an external layer, never baked in.

Use for: IT energy → total site energy

Nameplate is a ceiling. Capacity factor is the energy forecast.

The same 10 MW rating, three different answers
Rated IT load
10.0 MW
100%

The infrastructure ceiling used to describe the facility.

Measured simulated peak
7.32 MW
73.2%

Highest modelled IT demand, 80% utilization colocation case.

Measured annual average
5.91 MW
59.1%

The power level that determines annual IT energy.

Annual at nameplate
87.6 GWh
Annual at 59.1% CF
51.8 GWh
Difference
35.8 GWh · 40.9%

One rating, three questions

Before choosing a denominator, ask what you are estimating. The rating is the same; the correct adjustment is not.

01

How much power can the equipment demand?

Nameplate

Stress testing and electrical design limits. In the source paper an H100 under gpu-burn reached 668.2 W against its 700 W rating — a 4.5% gap, because gpu-burn is built to push the device toward maximum sustained draw.

Use forComponent ratings, protection systems, cooling design, worst-case engineering.

02

How high can the facility actually peak?

Peak derate

In the year-long simulations the 10 MW colocation facility reached about 7.32 MW and the 1 MW inference facility about 0.80 MW. Both hit full node occupancy without reaching full rated IT power.

Use forInterconnection, transformer sizing, grid connection, demand charges.

03

How much energy will the facility consume?

Capacity factor

At 80% target node utilization the simulated capacity factors were approximately 59.1% for the 10 MW colocation case and 66.3% for the 1 MW inference case.

Use forEnergy procurement, emissions, cost, hedge sizing, generation and transmission planning.

Do not multiply all three factors together.

The measured workload profiles are already embedded in the facility simulation. Capacity factor already reflects workload draw, idle consumption, node occupancy, scheduling, and temporal demand patterns. Multiplying it by duty factor or peak derate counts the same effect twice. The calculator below enforces this — it asks which question you are answering, then shows only the denominator that belongs to it.

Start here

What are you estimating?

Use this formula
rated IT MW × capacity factor × 8,760 hours × PUE

Capacity factor is average IT power ÷ rated IT power — the load-side analogue of the generator term. It already contains workload draw, idle consumption, node occupancy, and the annual load shape.

Facility type
Target node utilization
Annual IT energy — continuous nameplate vs measured profile, GWh
Nameplate running 24×7
87.6
GWh
Measured profile (CF 59.1%)
51.75
GWh

Difference: 35.8 GWh per year before PUE, or 40.9% below the continuous-nameplate estimate. The unused energy is not spare capacity available in every hour — it is the gap between a theoretical 24×7 ceiling and the modelled annual load shape.

Capacity factor
59.1%
avg IT ÷ rated IT
Average IT load
5.91 MW
of 10 MW rated
Annual IT energy
51.8 GWh
excludes cooling
Annual site energy
67.3 GWh
at PUE 1.30
Nameplate overstates
40.9%
vs 24×7 rated
Annual energy cost
$3.4M
at $50/MWh
Do not stack overlapping factors

Capacity factor already reflects workload draw, idle consumption, node occupancy, scheduling, and the annual load shape. Multiplying it by duty factor or peak derate counts the same effect twice.

What this means for an energy-normalized index

An energy-normalized compute index is structurally compute price ÷ modelled energy content. The price may be observable from transactions. The denominator is a stack of choices:

Hardware generationH100 SXM measured; H200 / B200 / GB200 not covered
Workload mixduty factor 0.795 – 0.880 across five traces
Request ratepower flattens while throughput rises → energy per token falls
Node utilizationcapacity factor 23.8% – 66.3% across the simulated cases
Facility overheadPUE applied externally — the simulation excludes cooling
= Energy-normalized unitevery layer above is a methodology choice

Two facilities running identical H100 hardware can deliver different energy per unit of compute because workload mix, batching, request rate, and operating policy differ. Any benchmark normalizing compute by energy should disclose all six layers and its update process as hardware and software change.

Methodology, sources, and which values are published vs derived

Published values — H100 SXM nameplate TDP (700 W); facility simulation tables (rated capacity, mean and peak power, peak-to-average ratio, queue time, request completion) at 20/40/60/80% target node utilization; workload mean busy power. Source: Vercellino et al., arXiv:2604.07345, and the associated dataset, DOI 10.7799/3025227.

Derived on this page — duty factors and their p10/p90 bands (sustained power ÷ 2800 W node GPU nameplate, computed across each trace’s busy period); capacity factors (mean IT power ÷ rated IT power); annual energy; nameplate overstatement (1 − duty factor, or 1 − capacity factor at facility level); hours above a share of peak; all cost figures.

Formulas — device: TDP × duty × hours × PUE; peak: rated IT MW × peak ratio; annual: rated IT MW × CF × 8,760 × PUE.

Boundaries — H100 SXM only, no H200 / B200 / B300 / GB200 NVL, no liquid-cooled or HVDC rack architecture. The facility simulations exclude cooling and non-IT load, so PUE is applied externally. Utilization shapes come from external workload datasets rather than direct observation of a commercial hyperscale site. Electricity prices are illustrative. CC-BY-4.0; derived figures published with attribution. Research and education only — not investment advice.

Real workloads are not stress tests

The paper reports an H100 stress-test result of 668.2 W against a 700 W TDP. That is only a 4.5% gap — and it is the wrong comparison for a GPU-hour energy denominator.

gpu-burn is designed to push the device toward maximum sustained draw. Real jobs include loading, evaluation, checkpointing, communication, batching changes, and pauses between phases. Across the full busy period the five published traces produce duty factors from 0.795 to 0.880 — real workload energy running roughly 12% to 21% below nameplate, averaging about 16%. Anyone quoting the 4.5% figure as an energy correction is quoting a ceiling as if it were an average.

WorkloadMean busy power, 4-GPU nodeDuty factorNameplate overstatement
Offline inference — Llama-3 70B2,463 W88.0%12.0%
Llama-2 70B LoRA fine-tuning2,440 W87.3%12.7%
Online rate inference — Llama-3 70B2,382 W85.1%14.9%
Stable Diffusion training2,261 W79.8%20.2%
Online finite inference — Llama-3 70B2,225 W79.5%20.5%

The workload mix is not a detail. It changes the denominator.

At facility scale the correction gets larger

The device-level denominator is off by 12–21%. The facility-level one is off by more.

Take the simulated 10 MW colocation facility at 80% target node utilization: rated IT load 10.0 MW, maximum simulated IT load 7.32 MW, average simulated IT load 5.91 MW, capacity factor 59.1%. A nameplate-based annual forecast assumes 10 MW × 8,760 hours = 87.6 GWh. The measured-profile simulation implies 10 MW × 59.1% × 8,760 = 51.8 GWh — a difference of 35.8 GWh per year before PUE, or 40.9% below the continuous-nameplate estimate. For the 1 MW inference facility, annual IT energy is roughly 5.81 GWh rather than 8.76 GWh.

Announced megawatts describe infrastructure. Capacity factor determines megawatt-hours.

That gap propagates into utility load forecasts, generation and transmission planning, energy procurement, emissions estimates, behind-the-meter sizing, demand-charge expectations, and the valuation of any power hedge attached to compute.

One nuance worth carrying: capacity factor is an annual ratio produced by an hourly load shape, so raising it is an operating decision rather than a free improvement. At high utilization the load flattens — easier for a grid to serve — but the colocation case reaches mean queue times above six hours and the inference case leaves a material share of requests unserved. The operating frontier is drawable inside the calculator above. Higher utilization is not automatically better.

What this changed in our own numbers

This site’s energy-normalized compute analysis says it plainly in its own footer: “GPU TDP figures are nameplate.” The Compute × Power workbench used the same convention, as did the compute supply-curve work behind it. Every energy figure those tools produced inherited the 0.91 kWh denominator.

Rebuilt on measured duty factors, the same calculation gives roughly 0.76 kWh per GPU-hour at a 1.3 PUE — about 16% lower. Across one million GPU-hours that is 910 MWh on the old denominator against 763 MWh measured, a 147 MWh difference worth about $7,350 at $50/MWh or $29,400 at $200/MWh. The second tab of the calculator runs both conventions side by side against real hub prices, so the correction is inspectable rather than quietly patched.

Worth stating directly: the direction of that error is not intuitive, and it reverses depending on what you are computing. A lower energy denominator reduces the estimated energy cost of a GPU-hour — but it raises the implied compute heat rate, because the same rental is now supported by less electricity. One measurement correction, two headline numbers moving in opposite directions. That is precisely why a denominator has to be published rather than assumed.

What this means for an energy-normalized index

ICE and NATIVX have announced compute futures on the COIL Index, which tracks tokenized, energy-normalized compute — designed, in ICE’s framing, to “strip out the noise introduced by regional power cost disparities.” Normalizing by energy makes the index structurally a ratio:

compute price ÷ modelled energy content

The numerator is observable from transactions. The denominator is a methodology choice — and it is the same denominator this entire page is about.

A nameplate-derived denominator overstates device energy by 12% to 21% across the measured H100 workloads. A single fixed kWh-per-GPU-hour also misses a finding from the inference traces: as request rate rises, power flattens while throughput keeps improving, so energy per token falls even when server power barely moves. Two operators running identical H100 hardware can deliver genuinely different energy per unit of compute because their workload mix, batching, request rate, and utilization policy differ.

So the critique is not that energy normalization is wrong. It is that normalization does not remove the regional power-cost assumption — it relocates it into workload mix, where it is harder to see and nobody is quoting it. Whatever a benchmark treats as noise becomes basis that somebody else can own.

Energy normalization does not eliminate assumptions. It makes the assumptions tradable.

That is a fair question to put to any benchmark administrator, and it maps cleanly onto IOSCO’s benchmark principles — Principles 6 and 7 on design and data sufficiency, and Principle 11 on methodology content. Does a denominator derived from nameplate ratings adequately reflect the underlying interest? Six things would need disclosing before that question can be answered from the outside:

01Hardware generation
H100 SXM here; H200, B200, B300, and GB200 NVL will differ and are not covered by this measurement.
02Workload basket and weights
Duty factors run 0.795 to 0.880 across five traces. The mix chosen sets the denominator.
03Utilization assumptions
Capacity factor moves from 23.8% to 66.3% across the simulated cases. This is the single largest lever.
04Request-rate assumptions
Inference power flattens while throughput rises, so energy per token falls with load.
05Facility overhead treatment
Whether PUE is inside or outside the denominator, and at what value.
06Update process
How the denominator is revised as hardware generations and inference software change.

We ask having just corrected the same error in our own published work. The COIL methodology document is not out yet; if it already uses measured or transaction-derived energy content, this becomes corroboration rather than critique and the underlying point stands either way — the denominator deserves to be published, whatever it turns out to be.

The caveat that matters

This is an H100 calibration point, not a universal GPU law. The measurements do not cover H200, B200, B300, GB200 NVL, liquid-cooled rack systems, high-voltage DC architectures, or every training and inference workload. The facility model excludes cooling and other non-IT loads, and its utilization shapes come from external workload datasets rather than direct observation of a commercial hyperscale site.

Use it as measured evidence for H100 workloads, as a better calibration than nameplate-only arithmetic, and as a framework for asking the right question — not as a forecast for every AI data center. The dataset and tooling are open, which makes the next step available to anyone: repeat the measurement on newer hardware, more workload types, and real commercial operating profiles.

Use the right denominator

For equipment and infrastructure ceilings, start with nameplate. For a realistic facility peak, use the measured peak ratio. For annual energy, use capacity factor. For a GPU-hour, use a measured workload duty factor. And never multiply factors that already contain the same workload effect.

The rating tells you how large the machine is. The capacity factor tells you how much electricity it becomes.

Data and methodology. Primary workload and facility data derived from Vercellino, Willard, Campos, da Silva Pereira, Hull, Selensky & Mueller, “Measurement of Generative AI Workload Power Profiles for Whole-Facility Data Center Infrastructure Planning”, arXiv:2604.07345, and the associated public dataset, DOI 10.7799/3025227 (CC-BY-4.0). The paper measured NVIDIA H100 training, fine-tuning, and inference workloads at 0.1-second resolution and scaled them through the DIPLOEE discrete-event facility model; the colocation and inference simulations cover one year at one-minute resolution and exclude cooling and auxiliary loads. Duty factors, capacity factors, nameplate comparisons, and derived energy examples on this page are analytical transformations of the published traces and facility tables, reproducible via scripts/nlr/build_nlr_data.py. Hourly power prices from ERCOT MIS and PJM Data Miner 2. Electricity-price examples are illustrative. Research and education only — not investment advice.