LLM evaluation correctness on PPE Correctness track
0.26MSE / PPILinearCal
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| LinearCaln=400, Estimator=LinearCal2026.04 | 0.26 | 10.5 | 98.9 | |
| Plattn=400, Estimator=Platt2026.04 | 0.26 | 10.5 | 98.9 | |
| AIPW-EMn=400, Estimator=AIPW-EM2026.04 | 0.262 | 10.3 | 98.9 | |
| AutoCaln=400, Estimator=AutoCal2026.04 | 0.263 | 10.2 | 98.8 | |
| MonoSplinen=400, Estimator=MonoSpline2026.04 | 0.263 | 9.4 | 98.9 | |
| IsoCaln=400, Estimator=IsoCal2026.04 | 0.265 | 8.9 | 98.9 | |
| PPI++n=400, Estimator=PPI++2026.04 | 0.276 | 8.3 | 98.9 | |
| Labeled-onlyn=400, Estimator=Labeled-only2026.04 | 0.299 | 0 | 98.8 | |
| Plattn=100, Estimator=Platt2026.04 | 0.304 | 10.2 | 93 | |
| LinearCaln=100, Estimator=LinearCal2026.04 | 0.305 | 10.1 | 93.1 | |
| AIPW-EMn=100, Estimator=AIPW-EM2026.04 | 0.309 | 9.5 | 93 | |
| MonoSplinen=100, Estimator=MonoSpline2026.04 | 0.309 | 9.2 | 92.6 | |
| IsoCaln=100, Estimator=IsoCal2026.04 | 0.309 | 8.9 | 92.5 | |
| AutoCaln=100, Estimator=AutoCal2026.04 | 0.31 | 9.4 | 92.9 | |
| PPI++n=100, Estimator=PPI++2026.04 | 0.33 | 7 | 92.9 | |
| Labeled-onlyn=100, Estimator=Labeled-only2026.04 | 0.346 | 0 | 92.7 | |
| AIPWn=400, Estimator=AIPW2026.04 | 0.405 | 0.9 | 94.1 | |
| AIPWn=100, Estimator=AIPW2026.04 | 0.774 | 0.9 | 90.6 | |
| PPIn=100, Estimator=PPI2026.04 | 1 | 1 | 90.4 | |
| PPIn=400, Estimator=PPI2026.04 | 1 | 2 | 92.4 |