olivlawolivlaw

Strategic concept

Confidence calibration

"70% probability" should actually happen in 70% of cases.

Body

A calibrated analyst is one whose stated probabilities match real event frequency. If you say "80% likely" but you're right only 50% of the time, you are overconfident. Techniques: Brier score, log loss, Platt scaling, isotonic regression, reliability diagrams. olivLaw I&W v2 uses Platt scaling for calibration, plus ICD 203 language; validation of the models on a held-out future period is in progress.

Related