Conference League prediction accuracy
Every forecast is locked before kickoff (normally 24 hours before), hashed into our public ledger and graded on the 90-minute result. Misses stay on the record. Published forecasts and the backtest are reported separately and never mixed.
Model comparison
| Model | n | Correct | RPS | Brier | Log loss |
|---|---|---|---|---|---|
| Final (published)V1: equals the statistical model | 0 | – | – | – | – |
| Statistical modelElo + Dixon-Coles | 0 | – | – | – | – |
| ClaudeAI analyst · shadow | 0 | – | – | – | – |
| CodexAI analyst · shadow | 0 | – | – | – | – |
| Base rateBenchmark: league H/D/A frequency | 0 | – | – | – | – |
| Elo onlyBenchmark | 0 | – | – | – | – |
| Model | n | Correct | RPS | Brier | Log loss |
|---|---|---|---|---|---|
| Final (published)V1: equals the statistical model | 0 | – | – | – | – |
| Statistical modelElo + Dixon-Coles | 0 | – | – | – | – |
| ClaudeAI analyst · shadow | 0 | – | – | – | – |
| CodexAI analyst · shadow | 0 | – | – | – | – |
| Base rateBenchmark: league H/D/A frequency | 0 | – | – | – | – |
| Elo onlyBenchmark | 0 | – | – | – | – |
| Model | n | Correct | RPS | Brier | Log loss |
|---|---|---|---|---|---|
| Final (published)V1: equals the statistical model | 0 | – | – | – | – |
| Statistical modelElo + Dixon-Coles | 0 | – | – | – | – |
| ClaudeAI analyst · shadow | 0 | – | – | – | – |
| CodexAI analyst · shadow | 0 | – | – | – | – |
| Base rateBenchmark: league H/D/A frequency | 0 | – | – | – | – |
| Elo onlyBenchmark | 0 | – | – | – | – |
| Model | n | Correct | RPS | Brier | Log loss |
|---|---|---|---|---|---|
| Final (published)V1: equals the statistical model | 0 | – | – | – | – |
| Statistical modelElo + Dixon-Coles | 0 | – | – | – | – |
| ClaudeAI analyst · shadow | 0 | – | – | – | – |
| CodexAI analyst · shadow | 0 | – | – | – | – |
| Base rateBenchmark: league H/D/A frequency | 0 | – | – | – | – |
| Elo onlyBenchmark | 0 | – | – | – | – |
The n column shows how many matches each row covers, so only compare scores between rows with the same n. Lowest RPS among the rows with the most matches is in bold. Claude and Codex have only run on some matches so far and stay in shadow: they are graded but not used in the published probability (V1). The AI layer section compares them with the statistical model on the same matches.
Calibration
Graded published forecasts in five bins by the top probability, with 95% intervals.
Our picksPerfect calibration
| Top probability | n | Predicted | Observed | 95% CI |
|---|---|---|---|---|
| < 45% | 0 | – | – | – |
| 45–55% | 0 | – | – | – |
| 55–65% | 0 | – | – | – |
| 65–75% | 0 | – | – | – |
| ≥ 75% | 0 | – | – | – |
By confidence tier
| Tier | n | Correct | Backtest |
|---|---|---|---|
| High | 0 | – | 70–83% |
| Medium | 0 | – | about 61% |
| Low | 0 | – | 39–49% |
High: top probability 65% or more · Medium: 50–65% · Low: under 50%. Totals include Low picks.
By market
"Simple rule" is the benchmark in the note under each market.
| Market | Correct | Simple rule |
|---|
AI layer – shadow, not yet used in published probabilities
No graded match has the AI layer yet. Claude and Codex forecast each match in shadow from the day before kickoff; their record appears here once those matches are graded. The AI layer gets a weight only after at least 300 graded matches and the other conditions on the methodology page.
MethodologyBacktest, not live results. The model was run match by match on past seasons using only data available before each kickoff (open historical data (CC0) + live-season results, walk-forward, data cut at D−2). It shows how the method would have done; it is not our published record.
Benchmarks
| Model | Correct | RPS | Brier | Log loss |
|---|---|---|---|---|
| Base rate (league H/D/A frequency) | 44.0% | 0.2304 | 0.6485 | 1.0719 |
| Elo only | 52.0% | 0.2011 | 0.5879 | 0.9863 |
| Dixon-Coles | 52.3% | 0.2007 | 0.5871 | 0.9853 |
| Combined statistical model (published) | 52.1% | 0.2001 | 0.5857 | 0.9827 |
14,184 matches, 2022/23 – 2025/26 (Scotland, Saudi Pro League 2024/25 – 2025/26), 11 leagues, model v1.2-2026-11. Parameters were chosen on earlier seasons and never tuned on this test set.
Backtest calibration
Five bins by the top probability. These bins also drive the tier notes on prediction pages.
Our picksPerfect calibration
| Top probability | n | Predicted | Observed |
|---|---|---|---|
| < 45% | 5,065 | 40% | 39% |
| 45–55% | 4,142 | 50% | 49% |
| 55–65% | 2,554 | 60% | 61% |
| 65–75% | 1,527 | 70% | 70% |
| ≥ 75% | 896 | 80% | 83% |
Grading rules
Graded on the 90-minute score; extra time and penalties are ignored. Every forecast locked before kickoff counts. We lock 24 hours before kickoff, or straight away when a match enters our tracking later than that; each match page shows the actual lock time. Forecasts locked after kickoff are never graded. Corrections are logged, never silently replaced.
Grading methodologyExclusion log
No exclusions so far.
Forecast archive
Every graded forecast with its locked probabilities, result and hash. Download the full ledger as CSV or JSON.
Browse graded resultsOpen the ledgerOther leagues: Premier LeagueLa LigaSerie ABundesligaLigue 1Primeira LigaScottish PremiershipEredivisieSüper LigEFL ChampionshipSaudi Pro LeagueChampions LeagueEuropa League All leagues
For information and entertainment only. Not betting advice. 18+. Predictions are probabilities, not certainties. Responsible gambling