Accuracy Correlation Analysis on ACE Forecaster-level Season 4 1.0
0.4Human Rating Correlation CoefficientEQM composite score
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| EQM composite scoren=141, Metric (Ground Truth)=ABSnorm, Training Set=Seasons 1-3, Minimum Rationale Threshold=at least 10 rationales with at least three human ratings2026.06 | 0.4 | 0.5 | 0.001 | 0.001 | 0.4 | 0.001 | 0.097 | |
| Human Ratingn=141, Metric (Ground Truth)=ABSnorm, Minimum Rationale Threshold=at least 10 rationales with at least three human ratings2026.06 | 0.4 | — | — | 0.001 | — | — | — | |
| EQM composite scoren=242, Metric (Ground Truth)=ABSnorm, Minimum Rationale Threshold=at least 5 rationales2026.06 | 0.36 | 0.48 | — | — | — | — | 0.028 | |
| EQM composite scoren=409, Metric (Ground Truth)=ABSnorm, Minimum Rationale Threshold=at least 1 rationale2026.06 | 0.26 | 0.42 | — | — | — | — | 0.001 |