Case study · The Other Data

I tested 15 offbeat stock signals the hard way. One survived.

Every number on this page comes from theotherdata.com/track and the raw data files behind it.

1. The question

Can free public data predict stocks? The Other Data explains stocks with offbeat public data like paperboard output, airport lines, and FDA reports. I wanted to know if any of it actually lined up with what stocks did next, measured honestly. Its scoreboard grades 88 signals one by one, and I ran 15 separate, tougher tests on the most promising ideas.

2. What failed

To pass, a signal had to beat the better of "always guess up" and "always guess down" against the S&P 500, and the bottom of its 95% range had to clear that bar too. Back-to-back calls in the same direction count as one event.

Signal → stockEventsBeat the S&PBar to clearResult
Ski-country snowpack → Vail Resorts6347.6%52.4%Failed
Midwest/Northeast snowfall → Compass Minerals4652.2%52.2%Failed
US box office → Disney10946.8%52.3%Failed
Bird flu in egg flocks → Cal-Maine966.7% (range 35.4–87.9%)55.6%Failed
Cattle on Feed → Tyson4344.2%55.8%Failed
Major power outages → Generac3964.1% (range 48.4–77.3%)53.8%Failed
Suez Canal transits → ZIM862.5% (range 30.6–86.3%)50.0%Failed
Insider open-market buys, top 500 stocks (1 month)4,56149.5%50.6%Failed

Six SEC filing signals had their rule picked on 2012–2020, then were checked once on 2021–2026. None was confirmed:

8-K / filing signal (2021–2026)EventsCalled right vs S&PBar to clearStatus
8-K 4.02 non-reliance59563.5%64.9%Not confirmed
8-K 4.01 auditor change1,72666.7%63.0%Under review
8-K 3.01 delisting notice3,68736.3%61.7%Not confirmed
8-K 5.02 officer/director change27,65339.8%59.0%Not confirmed
8-K 5.02 CFO departure17,12638.6%58.9%Not confirmed
Schedule 13D3,47439.1%59.2%Not confirmed

For several signals, the direction chosen on 2012–2020 reversed in 2021–2026, which is why their hit rates fall far below the bar.

Full list of what was tried: the tougher tests on /track.

3. How I kept it honest

  • Size-matched comparison groups. Small companies often lag the market on their own, so each late filer was compared with stocks of similar size, not just the S&P 500.
  • Survivorship checks. Failed and delisted companies were added back, and notices from companies that couldn't be classified were also tested at a 0% return as a bound.
  • Rules chosen first, confirmed later. New signals had their rule picked on 2012–2020 and were checked once on 2021–2026.
  • Stress tests. Outliers capped, three benchmarks (S&P 500, small caps, micro caps), and a baseline of the same stocks in months with no filing.

4. Bugs I caught

  • Claims without proof. The AI agent I built with reported results for four signals before it had run them. When I asked for the tables, it admitted it hadn't tested them yet. Since then, every claim needs a results table behind it.
  • The shrinking Apple. An early insider-buying test showed insider buys lagging by about 1.6% a month. That came from a bug in the size ranking: it multiplied old share counts by split-adjusted prices, which made companies that later split look smaller (Apple by 28x) and let the wrong companies into the top 500. After the fix, Apple, Microsoft, JPMorgan, Exxon and Johnson & Johnson are in the top 500 every month from 2012 to 2026, and the insider-buying signal disappeared.

5. The result: late filers

When a company files a notice that its annual or quarterly report will be late (SEC Form 12b-25), its stock lagged similar-sized stocks by about 4% on average over the next 3 months, in both periods:

PeriodEventsAvg vs similar-sized stocks (3 months)95% range
2012–20202,872−3.90%−5.42% to −2.37%
2021–20263,881−4.16%−5.55% to −2.78%

At 1 month, it's not proven.

6. Limits

  • Historical pattern only.
  • Mostly small, hard-to-trade stocks. Real trades would be hard to fill at these prices, and trading costs and short-selling limits aren't included and could erase the gap.
  • This reproduces a known effect in academic research on late filings. It's not a new discovery.
  • Not a prediction for any single company.
  • Education only. Not financial advice.

7. See the data yourself

Education only. Past results, real or backtested, don't predict future ones.

← Back to my work