This table presents calibration statistics across probability bins, showing the relationship between predicted probabilities and observed frequencies.
Bin # |
Bin Range |
# Samples |
Avg. Pred. Probability |
Observed Frequency |
Calibration Error |
ECE Contribution |
Loading calibration data...
|
Calibration Metrics
Expected Calibration Error (ECE):
-
Maximum Calibration Error (MCE):
-
Reliability Diagram Deviation:
-
⚖️
Calibration Error measures the difference between predicted probabilities and observed frequencies within each bin.
A well-calibrated model should have small errors across all bins.
📈
ECE Contribution is each bin's weighted contribution to the overall Expected Calibration Error.
Bins with more samples and larger errors contribute more significantly to the total calibration error.