Expected Calibration Error on PopQA
19.85ECECDKC
Evaluation results
| Method | Links | |
|---|---|---|
| CDKCBackbone=Qwen2.5-7B-Instruct, Optimization Rounds=22026.02 | 19.85 | |
| CDKCBackbone=Qwen2.5-7B-Instruct2026.02 | 27.91 | |
| GRPOBackbone=Qwen2.5-7B-Instruct2026.02 | 30.03 | |
| BARRELBackbone=Qwen2.5-7B-Instruct2026.02 | 56.52 | |
| Know WhatBackbone=Qwen2.5-7B-Instruct2026.02 | 61.78 | |
| Vanilla SFTBackbone=Qwen2.5-7B-Instruct2026.02 | 67.07 | |
| CGKEBackbone=Qwen2.5-7B-Instruct2026.02 | 67.23 | |
| LLKD-SFTBackbone=Qwen2.5-7B-Instruct2026.02 | 67.56 | |
| Vanilla LLMBackbone=Qwen2.5-7B-Instruct2026.02 | 67.63 | |
| CRew-DPOBackbone=Qwen2.5-7B-Instruct2026.02 | 71.22 |