Strategic concept

Confidence calibration

"70% probability" should actually happen in 70% of cases.

Body

A calibrated analyst is one whose stated probabilities match real event frequency. If you say "80% likely" but you're right only 50% of the time, you are overconfident. Techniques: Brier score, log loss, Platt scaling, isotonic regression, reliability diagrams. olivLaw I&W v2 uses Platt scaling with AUC 0.64-0.88, plus ICD 203 language.

Related