Calibration on NTCIR
1.294CB-ECEPR
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| PRCalibration type=Platt Ranking2024.02 | 1.294 | 1.194 | 2.773 | |
| NLE (conditional)Explanation Type=conditional, LLM=LLaMA2-13B-Chat2024.02 | 1.405 | 0.257 | 1.29 | |
| NLE (literal)Explanation Type=literal, LLM=LLaMA2-13B-Chat2024.02 | 1.534 | 0.355 | 1.33 | |
| PCCalibration type=Post-hoc Calibration2024.02 | 1.624 | 0.457 | 1.462 | |
| PLCalibration type=Platt Linear2024.02 | 1.677 | 0.472 | 1.54 | |
| FC (BERT)Calibration type=Full Calibration, Backbone=BERT2024.02 | 1.756 | 0.546 | 1.416 | |
| NCCalibration type=No Calibration2024.02 | 1.757 | 0.799 | 1.824 | |
| FC (monoBERT)Calibration type=Full Calibration, Backbone=monoBERT2024.02 | 1.843 | 0.709 | 1.874 |