Patterns · Vol. 08

Pattern

Confidence calibration

Verify that a model's stated confidence matches how often it is actually right — and set routing thresholds from the measured relationship — so that a "0.9" means roughly ninety-percent accuracy rather than an arbitrary number the model emitted.

Classification — Checking that a model's confidence matches its empirical accuracy, and tuning thresholds to it.

Full entry

The complete treatment — problem, how it works, when to use it, sources, and examples — lives in the volume below.

Browse the full pattern index or the catalog.