Confidence Estimation on VECBench OOD VER
0.1217ECEEmoCaliber
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| EmoCaliberConfidence Elicitation Strategy=Verb2025.12 | 0.1217 | 0.2241 | 72.17 | |
| GPT5Confidence Elicitation Strategy=Verb2025.12 | 0.1935 | 0.2582 | 70.92 | |
| Qwen3-VLConfidence Elicitation Strategy=Ans2025.12 | 0.2195 | 0.3238 | 42.35 | |
| EmoVITConfidence Elicitation Strategy=Ans2025.12 | 0.227 | 0.2991 | 57.43 | |
| InternVL3.5Confidence Elicitation Strategy=Avg2025.12 | 0.2333 | 0.2953 | 57.81 | |
| EmoVITConfidence Elicitation Strategy=Avg2025.12 | 0.2447 | 0.2945 | 67.29 | |
| Qwen2.5-VLConfidence Elicitation Strategy=Avg2025.12 | 0.2559 | 0.299 | 67.57 | |
| Qwen3-VLConfidence Elicitation Strategy=Verb2025.12 | 0.3005 | 0.3068 | 69.47 | |
| Qwen3-VLConfidence Elicitation Strategy=Avg2025.12 | 0.3066 | 0.3273 | 69.99 | |
| Qwen2.5-VLConfidence Elicitation Strategy=Verb2025.12 | 0.3415 | 0.3493 | 60.93 | |
| Qwen2.5-VLConfidence Elicitation Strategy=Ans2025.12 | 0.3523 | 0.3858 | 60.55 | |
| InternVL3.5Confidence Elicitation Strategy=Ans2025.12 | 0.3669 | 0.3993 | 47.5 | |
| Emotion-LLaMAConfidence Elicitation Strategy=Avg2025.12 | 0.4983 | 0.459 | 50 |