How we test — and the full results grid

This is the transparency page: the complete grid behind every guide on the site, plus exactly how each number is produced. Nothing is cherry-picked — the nulls and the near-misses are shown alongside the few robust results.

How each number is produced

  1. Event study, look-ahead protected. For each release we measure the market's change from the prior close to the close at the end of the holding window. Nothing uses information that was not available before the release.
  2. A baseline, always. The release-window move is compared against the unconditional distribution of same-length moves on all days — what a "normal" stretch looks like. Without a baseline, every release looks dramatic.
  3. Two separate questions. - Direction — a one-sample t-test of the signed move against zero. Can you predict which way the market goes? - Size — the average absolute release-window move divided by the baseline (a ratio), tested by bootstrap. Does the market move more than usual, regardless of direction?
  4. Multiple-testing correction. Run one grid of ~70 cells and a few will look "significant" by chance. We apply a Benjamini-Hochberg false-discovery-rate correction (q=0.05) across the grid. A result is only called robust if it survives that correction.

The full release-day grid

Each cell is the average absolute move on release day versus a normal day. Bold = survives the multiple-testing correction. Everything else — including plenty of numbers above 1.0 — does not, and we treat those as not robust. Yields are in basis points; the dollar and oil in percent returns; the ratio is unit-free.

Release N 3M 2Y 5Y 10Y 30Y 2s10s USD WTI Brent
CPI 30 ×0.49 ×1.77 ×1.93 ×1.75 ×1.41 ×1.17 ×1.41 ×1.05 ×0.91
PPI 36 ×0.52 ×1.48 ×1.47 ×1.33 ×1.07 ×1.23 ×1.00 ×0.78 ×0.86
NFP (jobs) 36 ×0.61 ×2.35 ×2.27 ×1.97 ×1.48 ×1.36 ×1.38 ×1.02 ×1.12
PCE 35 ×0.44 ×0.80 ×0.96 ×0.97 ×0.92 ×0.81 ×0.67 ×0.62 ×0.63
GDP (low N) 12 ×0.27 ×1.37 ×1.33 ×1.12 ×0.91 ×1.12 ×0.54 ×0.85 ×0.79
Retail sales 38 ×0.45 ×1.29 ×1.42 ×1.32 ×1.08 ×0.97 ×1.04 ×0.88 ×1.00
Jobless claims 150 ×0.44 ×1.06 ×1.17 ×1.15 ×1.00 ×1.12 ×1.02 ×0.77 ×0.85
FOMC 24 ×0.52 ×1.61 ×1.74 ×1.45 ×0.99 ×1.08 ×0.80 ×0.86 ×0.91

What survives, and what doesn't

Why most of the grid is "not robust"

Of the ~70 cells, after correction the breakdown is: a handful robust, a middle band that is nominally significant but fails multiple-testing (we flag these for review, not publication), and the rest genuine nulls. We deliberately do not spin each cell into its own page — that would be low-value duplicate content. The grid lives here, on one page, in full.

Caveats

Read the write-ups

Sources

All series are U.S. government public domain (17 U.S.C. §105), retrieved via FRED: