Daily data viz

Before Uri, ERCOT's forecast missed by under 3%; during the storm, by 18%

How did the day-ahead forecast fail, hour by hour, when Winter Storm Uri hit Texas? Each row is one hour of January and February 2021 on the ERCOT grid, with the electricity served and the forecast made the day before. For six weeks the two lines are hard to tell apart. Then, from February 14, generators froze, the grid shed load for days, and the forecast and the reality came apart by tens of thousands of megawatt-hours. Three sheets: the two months, the storm week on its own, and the same hours sorted by the clock.

Interactive chart available when JavaScript loads.

Two months

Six quiet weeks, then a week apart

Served and forecast electricity on one scale. Before February 14 the lines overlap; the forecast's mean absolute miss was 2.65% of the forecast. Inside the shaded week the forecast climbs toward 77,000 MWh while the grid serves 45,000.

Interactive chart available when JavaScript loads.

The difference puts the storm on its own axis

Subtract the forecast and the six quiet weeks flatten onto zero. Before the storm the grid ran a little above forecast, by 646 MWh an hour on average; during the storm week it ran 11,109 MWh an hour below it, and after the storm it was still 2,918 MWh below.

Interactive chart available when JavaScript loads.

Before the storm, half the hours were within 2%

Set time aside and count the quiet weeks' hours by how far they missed. 51.4% of the hours before February 14 missed by 2% of the forecast or less, and nine in ten by under 6%.

Interactive chart available when JavaScript loads.

The storm week

Demand rose, then the grid fell

The forecast expected the cold to push demand to a record: it peaked at 76,783 MWh for the hour of 21:00 UTC on February 15. The grid never got there. Served load peaked at 69,215 MWh fifteen hours earlier, then dropped as plants tripped offline and ERCOT ordered rolling outages.

Interactive chart available when JavaScript loads.

The worst hour missed by 28,885 MWh

At 06:00 UTC on February 16 the forecast said 73,149 MWh and the grid served 44,264, a miss of 28,885 MWh, two fifths of the forecast. For 71 of the week's 168 hours the grid ran more than 10,000 MWh below forecast. The mean absolute miss for the week was 17.52% of the forecast.

Interactive chart available when JavaScript loads.

By clock hour

Outside the storm, the clock barely matters

Each cell is a clock hour, averaged over the hours in its column. In the other weeks the signed miss stays within a few hundred megawatt-hours all day, slightly over forecast at night and slightly under in the afternoon. In the storm week every hour is thousands below, and the evening is worst.

Interactive chart available when JavaScript loads.

The storm's evenings missed most

Inside the storm week, the 19:00 UTC hour ran 14,006 MWh below forecast on average, the deepest of any clock hour. That is early afternoon in Texas, when the forecast expected heating demand to peak and the grid had the least generation to offer.

Interactive chart available when JavaScript loads.

Takeaway

A forecast can be excellent and useless in the same two months. Before Uri, ERCOT's day-ahead forecast missed by under 3%; during the storm the miss was not a forecasting error but a supply failure, with the grid serving tens of thousands of megawatt-hours less than Texans needed. Any summary of forecast accuracy for early 2021 is really a summary of one week.

Limits

Served electricity is not demand: during the outages it measures what the grid could deliver, not what was wanted, so the storm-week error mixes forecast error with load shedding. Hours are UTC; the snapshot starts and ends mid-day, and the first and last days are partial.