What is an event study? How we test whether news moves markets

Every result on this site comes from the same method: an event study. It is a standard tool in economics and finance for answering a simple question — when a specific event happens, does a market react? This page explains, in plain language, how we run one, and why a few unglamorous details (a baseline, a significance test, a correction for testing many things at once) are what separate a real finding from a story.

The question an event study answers

Suppose someone tells you "the 10-year Treasury yield jumped after CPI." Maybe it did. But to know whether CPI actually causes a reaction, you need to answer two harder questions:

  1. Did it move more than it would have on an ordinary day?
  2. Did it move in a predictable direction, or was it just as likely to go the other way?

An event study is the disciplined way to answer both. You gather every instance of the event, measure the market's move around each one, and compare that to what "normal" looks like.

Step 1: define the event and the window

We take an event — say, every CPI release — and pull its exact release dates from the source agency. For each release we measure the market's change over a fixed window: the "release day" is the move from the prior day's close to the release day's close. We also look at a 5-day window to see whether any reaction lasts.

Crucially, the window starts at the prior close, before the number is public. That keeps the test look-ahead protected — we never accidentally use information that wasn't available when the event happened. Look-ahead leakage is one of the most common ways backtests fool themselves, and guarding against it is non-negotiable.

Step 2: build a baseline

This is the step most casual analysis skips, and it is the most important. A move of "8 basis points" means nothing on its own — you have to know what a normal move looks like. So for each market we compute the baseline: the distribution of moves over all trading days, not just event days. If the 10-year yield moves about 4.3 basis points on a typical day, then an 8-basis-point move on CPI day is roughly twice normal. Without the baseline, every event looks dramatic; with it, you can see which ones actually stand out.

Step 3: measure two different things

We deliberately separate the two questions, because they usually have different answers:

Across our tests, the recurring pattern is: some events reliably increase the size of the move, but almost none give you a reliable direction. That distinction is the single most useful thing an honest event study reveals.

Step 4: a significance test on every claim

"It moved" is not enough — small samples throw up patterns by chance. So every result carries a p-value: roughly, the probability of seeing a result this strong if the event actually had no effect. A low p-value (we use 0.05 as the line) means the effect is unlikely to be a fluke. A result sitting right on the line is reported as not established, not rounded up to a win.

Step 5: correct for testing many things at once

Here is a subtle trap. If you test one event against one market, a p-value of 0.05 is meaningful. But if you test dozens of event-and-market combinations, some will clear 0.05 purely by chance — run twenty coin-flip experiments and one will look "significant." To guard against this, we apply a multiple-testing correction (the Benjamini-Hochberg false-discovery-rate method) across our whole grid of tests. A result is only called robust if it survives that correction. This is why some numbers that look elevated on an individual page are still labeled "not robust": they don't hold up once you account for how many tests were run. You can see the full corrected grid on our methodology and full-results page.

Why this matters

The point of all this machinery is to be honest about what the data does and does not show. Most market commentary asserts a reaction and a direction with total confidence. An event study, done properly, usually delivers a more modest and more trustworthy message: this event makes the market move more than usual, but you can't tell which way. That is not a limitation of the method — it is the method telling you the truth.

See it in action

Historical statistics for informational purposes only, not financial advice.