Eredivisie prediction accuracy
Every forecast is locked before kickoff (normally 24 hours before), hashed into our public ledger and graded on the 90-minute result. Misses stay on the record. Published forecasts and the backtest are reported separately and never mixed.
Calibration warning. Eredivisie fails our calibration check. In back-tests on the 2022–23 to 2025–26 seasons (1,223 matches), when the result we rated most likely had less than 45% (close matches), it came in 33% of the time, against 40% forecast. The model is too confident in close matches here, so its pick is probably less likely than shown. We publish it unchanged (model v1.2-2026-11) and are tracking live results before recalibrating.
Model comparison
| Model | n | Correct | RPS | Brier | Log loss |
|---|---|---|---|---|---|
| Final (published)V1: equals the statistical model | 3 | 33.3% | 0.2907 | 0.6485 | 1.0733 |
| Statistical modelElo + Dixon-Coles | 3 | 33.3% | 0.2907 | 0.6485 | 1.0733 |
| ClaudeAI analyst · shadow | 0 | – | – | – | – |
| CodexAI analyst · shadow | 0 | – | – | – | – |
| Base rateBenchmark: league H/D/A frequency | 3 | 33.3% | 0.2963 | 0.6550 | 1.0688 |
| Elo onlyBenchmark | 3 | 33.3% | 0.3038 | 0.6771 | 1.1283 |
| Model | n | Correct | RPS | Brier | Log loss |
|---|---|---|---|---|---|
| Final (published)V1: equals the statistical model | 3 | 33.3% | 0.2907 | 0.6485 | 1.0733 |
| Statistical modelElo + Dixon-Coles | 3 | 33.3% | 0.2907 | 0.6485 | 1.0733 |
| ClaudeAI analyst · shadow | 0 | – | – | – | – |
| CodexAI analyst · shadow | 0 | – | – | – | – |
| Base rateBenchmark: league H/D/A frequency | 3 | 33.3% | 0.2963 | 0.6550 | 1.0688 |
| Elo onlyBenchmark | 3 | 33.3% | 0.3038 | 0.6771 | 1.1283 |
| Model | n | Correct | RPS | Brier | Log loss |
|---|---|---|---|---|---|
| Final (published)V1: equals the statistical model | 3 | 33.3% | 0.2907 | 0.6485 | 1.0733 |
| Statistical modelElo + Dixon-Coles | 3 | 33.3% | 0.2907 | 0.6485 | 1.0733 |
| ClaudeAI analyst · shadow | 0 | – | – | – | – |
| CodexAI analyst · shadow | 0 | – | – | – | – |
| Base rateBenchmark: league H/D/A frequency | 3 | 33.3% | 0.2963 | 0.6550 | 1.0688 |
| Elo onlyBenchmark | 3 | 33.3% | 0.3038 | 0.6771 | 1.1283 |
| Model | n | Correct | RPS | Brier | Log loss |
|---|---|---|---|---|---|
| Final (published)V1: equals the statistical model | 3 | 33.3% | 0.2907 | 0.6485 | 1.0733 |
| Statistical modelElo + Dixon-Coles | 3 | 33.3% | 0.2907 | 0.6485 | 1.0733 |
| ClaudeAI analyst · shadow | 0 | – | – | – | – |
| CodexAI analyst · shadow | 0 | – | – | – | – |
| Base rateBenchmark: league H/D/A frequency | 3 | 33.3% | 0.2963 | 0.6550 | 1.0688 |
| Elo onlyBenchmark | 3 | 33.3% | 0.3038 | 0.6771 | 1.1283 |
The n column shows how many matches each row covers, so only compare scores between rows with the same n. Lowest RPS among the rows with the most matches is in bold. Claude and Codex have only run on some matches so far and stay in shadow: they are graded but not used in the published probability (V1). The AI layer section compares them with the statistical model on the same matches.
Calibration
Graded published forecasts in five bins by the top probability, with 95% intervals.
Our picksPerfect calibration
| Top probability | n | Predicted | Observed | 95% CI |
|---|---|---|---|---|
| < 45% | 0 | – | – | – |
| 45–55% | 2 | 47% | 0% | 0–66% |
| 55–65% | 1 | 56% | 100% | 21–100% |
| 65–75% | 0 | – | – | – |
| ≥ 75% | 0 | – | – | – |
By confidence tier
| Tier | n | Correct | Backtest |
|---|---|---|---|
| High | 0 | – | 70–83% |
| Medium | 1 | 100.0% | about 61% |
| Low | 2 | 0.0% | 39–49% |
High: top probability 65% or more · Medium: 50–65% · Low: under 50%. Totals include Low picks.
By market
"Simple rule" is the benchmark in the note under each market.
| Market | Correct | Simple rule |
|---|---|---|
| Result (1X2)Always pick the home team | 33.3% | 33.3% |
| Correct score: most likely overallExact scores land about one time in eight | 0.0% | – |
| Correct score: most likely in the pick | 0.0% | – |
| Over/Under 2.5 goalsAlways pick the more common side | 100.0% | 100.0% |
| Both teams to scoreClose to the base rate: little skill shown so far | 66.7% | 66.7% |
AI layer – shadow, not yet used in published probabilities
No graded match has the AI layer yet. Claude and Codex forecast each match in shadow from the day before kickoff; their record appears here once those matches are graded. The AI layer gets a weight only after at least 300 graded matches and the other conditions on the methodology page.
MethodologyBacktest, not live results. The model was run match by match on past seasons using only data available before each kickoff (open historical data (CC0) + live-season results, walk-forward, data cut at D−2). It shows how the method would have done; it is not our published record.
Benchmarks
| Model | Correct | RPS | Brier | Log loss |
|---|---|---|---|---|
| Base rate (league H/D/A frequency) | 44.0% | 0.2304 | 0.6485 | 1.0719 |
| Elo only | 52.0% | 0.2011 | 0.5879 | 0.9863 |
| Dixon-Coles | 52.3% | 0.2007 | 0.5871 | 0.9853 |
| Combined statistical model (published) | 52.1% | 0.2001 | 0.5857 | 0.9827 |
14,184 matches, 2022/23 – 2025/26 (Scotland, Saudi Pro League 2024/25 – 2025/26), 11 leagues, model v1.2-2026-11. Parameters were chosen on earlier seasons and never tuned on this test set.
Backtest calibration
Five bins by the top probability. These bins also drive the tier notes on prediction pages.
Our picksPerfect calibration
| Top probability | n | Predicted | Observed |
|---|---|---|---|
| < 45% | 5,065 | 40% | 39% |
| 45–55% | 4,142 | 50% | 49% |
| 55–65% | 2,554 | 60% | 61% |
| 65–75% | 1,527 | 70% | 70% |
| ≥ 75% | 896 | 80% | 83% |
Grading rules
Graded on the 90-minute score; extra time and penalties are ignored. Every forecast locked before kickoff counts. We lock 24 hours before kickoff, or straight away when a match enters our tracking later than that; each match page shows the actual lock time. Forecasts locked after kickoff are never graded. Corrections are logged, never silently replaced.
Grading methodologyExclusion log
No exclusions so far.
Forecast archive
Every graded forecast with its locked probabilities, result and hash. Download the full ledger as CSV or JSON.
Browse graded resultsOpen the ledgerOther leagues: Premier LeagueLa LigaSerie ABundesligaLigue 1Primeira LigaScottish PremiershipSüper LigEFL ChampionshipSaudi Pro LeagueChampions LeagueEuropa LeagueConference League All leagues
For information and entertainment only. Not betting advice. 18+. Predictions are probabilities, not certainties. Responsible gambling