Loading race intelligence…
Loading race intelligence…
What goes into each forecast, how it is evaluated, and where the uncertainty remains.
Separate FP1, FP2 and FP3 models use only the completed session and earlier inputs. Clean-lap gaps, sample sizes, tyres and compound-matched long-run proxies retain missingness.
Qualifying gaps compare the same phase. Teammate comparisons use the highest common phase. Grid conversion and circuit history use earlier races with smoothed priors.
Earlier driver/team finishes and nonfinish history inform the forecast. The validated FP3 candidate also uses archived JMA race-hour weather and weather/form interactions.
Practice long-run proxies are matched by compound and tyre-age bounds; they are not fuel-adjusted. Missing or small samples are labelled. Confirmed event entries take priority over a provisional roster, and guest practice drivers do not expand the race field.
The weather model uses a consistent 72-hour lead: temperature, precipitation amount, humidity and wind. Historical release availability is conservatively estimated; new live retrievals are timestamped. The separate latest-weather card is context. Only FP3 passed the matched no-weather validation gate; other stages retain their existing models. Weather validation →
Grid/form baselines, logistic regression and CatBoost are compared on chronological race groups. Preprocessing fits training rows only; winner temperature normalization and model selection use validation. The 2025 benchmark was inspected during development and is not an untouched final test. Recorded future races provide the prospective evaluation.
Winner probabilities sum to one. Podium and top-10 marginals nest above them and sum to three and ten across the full field. These are individual finish probabilities, not a joint finishing-order simulation or a guarantee of calibration.
2018–2023 (111 races)
2024–2024 (18 races)
2025–2025 (17 races)
catboost · qual-v2-1cf9fc78-20261024T150228
| Candidate | Winner race log loss ↓ | Summed Brier ↓ | Top pick | Races |
|---|---|---|---|---|
| grid_baseline | 0.894 | 0.463 | 70.6% | 17 |
| logistic | 1.217 | 0.621 | 52.9% | 17 |
| catboost | 0.874 | 0.463 | 58.8% | 17 |
The Performance page uses race-balanced per-driver binary log loss/Brier, reliability bins and race-cluster intervals. Winner race log loss and summed Brier above have a different scale. Newly recorded forecasts also save simple form/qualifying baselines so later comparisons use identical prospective race cohorts. Older snapshots are preserved.
Inspect measured performance →Every prediction is immutable and saved before race start. FP2 cannot use FP3 or qualifying; post-qualifying models cannot use target-race outcomes. Current-race results enter later scoring, while historical outcomes are joined only as labels or shifted earlier-race features. Later observed race weather cannot substitute for an earlier weather forecast.
Qualifying position can differ from the eventual starting grid after penalties. Race-result fallbacks preserve unknown grid values instead of replacing them with finish order. Driver evidence is frozen with the prediction. SHAP values and linear terms describe the fitted raw score before calibration and field constraints; they are associations, not causal effects or probability-point changes.
Weather, crashes, strategy, reliability, changing regulations and traffic can overwhelm pace signals. Standard weekends have trained stage models; sprint formats keep an explicitly experimental fallback and unsupported outcome columns remain unavailable. Short practice samples, provisional entries and the OpenF1 timing source shift remain visible limitations.
A model that wins one metric can lose another. Judge calibration using the prospective sample counts and reliability bins on Performance, including future seasons and changing regulations. The eight-session timing source pilot does not certify the newer FP3 weather model. More recorded weekends and a larger paired source audit are needed.
Practice uses FastF1 with OpenF1 fallback. Qualifying retries Jolpica, OpenF1 and FastF1. Final race classifications retry Jolpica, complete OpenF1 results and published FastF1 results. FastF1 results may share the Jolpica backend. OpenF1 calls wait at least 30 minutes after the session end. Empty and incomplete responses retry automatically; provider failures retain the last verified data, and later official corrections can update the report card.
Sources are checked about every five minutes and visible pages refresh every minute. The worker restarts after an unexpected exit, readiness checks expose delays, and daily backups are verified. The local computer must stay awake and online; continuous hosted operation requires an available production host. These free post-session sources are subject to publication delays.
Separate logistic regression models learn top-3 and top-10 classified finishes. Winner estimates come from the existing winner models. Probabilities are then constrained so winner ≤ podium ≤ top 10 for each driver, with column totals of 1, 3 and 10 expected finishing places. These are marginal estimates, not a simulated finishing order.
Train: 2018–2023. Selection: 2024 validation races. The 2025 development benchmark has already been inspected, so it is not a fresh confirmation of accuracy. The baseline distributes the remaining places uniformly after respecting the preceding outcome’s probability. Sprint weekends are outside training coverage.
| Stage | Target | Selected model | Log loss ↓ | Baseline ↓ | Brier ↓ | Races |
|---|---|---|---|---|---|---|
| FP1 | Podium | logistic | 0.324 | 0.375 | 0.105 | 14 |
| FP1 | Top 10 | logistic | 0.609 | 0.621 | 0.203 | 14 |
| FP2 | Podium | logistic | 0.288 | 0.351 | 0.092 | 17 |
| FP2 | Top 10 | logistic | 0.581 | 0.617 | 0.192 | 17 |
| FP3 | Podium | logistic | 0.290 | 0.346 | 0.093 | 17 |
| FP3 | Top 10 | logistic | 0.580 | 0.615 | 0.191 | 17 |
| Q | Podium | logistic | 0.213 | 0.309 | 0.063 | 17 |
| Q | Top 10 | logistic | 0.535 | 0.588 | 0.174 | 17 |
These are binary outcome metrics averaged per driver and race. Their scale differs from the winner-only race log loss and summed Brier score below.
FP1 uses FP1 only. FP2 can use FP1 and FP2. FP3 can use all three practice sessions. No practice model receives current-race qualifying, grid position or race outcomes. Selection and probability temperature use validation races; test results do not select the model.
2018–2023 (96 races) training · 2024–2024 (16 races) validation · 2025–2025 (14 races) development test
Experimental practice-stage backtest. Historical publication cutoffs estimated; retrospective confirmed rosters. 2025 is a development benchmark previously inspected for qualifying. Long-run proxy is not fuel-adjusted.
| Candidate | Log loss ↓ | Brier ↓ | Top pick | Races |
|---|---|---|---|---|
| uniform_baseline | 2.996 | 0.950 | 5.0% | 14 |
| practice_pace_baseline | 2.327 | 0.930 | 14.3% | 14 |
| history_logistic | 2.378 | 0.886 | 28.6% | 14 |
| logistic · selected | 2.473 | 0.917 | 21.4% | 14 |
| catboost | 2.212 | 0.880 | 21.4% | 14 |
practice-fp1-v1-0fa3e3e8-20261019T130104
2018–2023 (100 races) training · 2024–2024 (16 races) validation · 2025–2025 (17 races) development test
Experimental practice-stage backtest. Historical publication cutoffs estimated; retrospective confirmed rosters. 2025 is a development benchmark previously inspected for qualifying. Long-run proxy is not fuel-adjusted.
| Candidate | Log loss ↓ | Brier ↓ | Top pick | Races |
|---|---|---|---|---|
| uniform_baseline | 2.996 | 0.950 | 5.0% | 17 |
| practice_pace_baseline | 2.644 | 0.869 | 17.6% | 17 |
| history_logistic | 2.339 | 0.862 | 35.3% | 17 |
| logistic | 2.880 | 0.853 | 23.5% | 17 |
| catboost · selected | 1.994 | 0.850 | 23.5% | 17 |
practice-fp2-v1-dd05a7e5-20261019T130112
2018–2023 (98 races) training · 2024–2024 (16 races) validation · 2025–2025 (17 races) development test
Experimental practice-stage backtest. Historical publication cutoffs estimated; retrospective confirmed rosters. 2025 is a development benchmark previously inspected for qualifying. Long-run proxy is not fuel-adjusted.
| Candidate | Log loss ↓ | Brier ↓ | Top pick | Races |
|---|---|---|---|---|
| uniform_baseline | 2.996 | 0.950 | 5.0% | 17 |
| practice_pace_baseline | 2.584 | 0.848 | 17.6% | 17 |
| history_logistic | 2.338 | 0.874 | 29.4% | 17 |
| logistic | 2.979 | 0.876 | 17.6% | 17 |
| catboost · selected | 1.950 | 0.862 | 11.8% | 17 |
practice-fp3-v1-8721abbc-20261019T130122
Top-pick ties receive fractional credit. Different stages can have different eligible races, so their headline scores are not a direct measure of improvement through the weekend. Historical publication times are estimated and the backtest roster is retrospectively confirmed. Live fields remain provisional. Sprint weekends use the labeled experimental fallback until separately evaluated.