Language Understanding on MMLU (Acc, AUROC, ECE)
71.4AccuracyC3RL
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| C3RLBackbone Model=Qwen2.5VL-7B-Instruct2026.07 | 71.4 | 65.3 | 9.2 | |
| C3RL w/o RefBackbone Model=Qwen2.5VL-7B-Instruct2026.07 | 71.2 | 64.8 | 11.1 | |
| RLVRBackbone Model=Qwen2.5VL-7B-Instruct2026.07 | 71.1 | 60.2 | 23.9 | |
| RLCRBackbone Model=Qwen2.5VL-7B-Instruct2026.07 | 70.7 | 60.7 | 17.5 | |
| SCBackbone Model=Qwen2.5VL-7B-Instruct2026.07 | 69.9 | 75.9 | 14.1 | |
| BaseBackbone Model=Qwen2.5VL-7B-Instruct2026.07 | 68.3 | 58.7 | 18.8 | |
| SaySelfBackbone Model=Qwen2.5VL-7B-Instruct2026.07 | 64 | 73.1 | 12.9 | |
| C3RLBackbone Model=Llama-3.2-3B-Instruct2026.07 | 64 | 68 | 8.9 | |
| C3RL w/o RefBackbone Model=Llama-3.2-3B-Instruct2026.07 | 63.5 | 68.8 | 8.7 | |
| RLVRBackbone Model=Llama-3.2-3B-Instruct2026.07 | 63.4 | 53.7 | 20.8 | |
| RLCRBackbone Model=Llama-3.2-3B-Instruct2026.07 | 62.3 | 67 | 15.3 | |
| SFT+RefBackbone Model=Qwen2.5VL-7B-Instruct2026.07 | 62.1 | 70.6 | 9.8 | |
| SCBackbone Model=Llama-3.2-3B-Instruct2026.07 | 59.9 | 73.3 | 15.8 | |
| BaseBackbone Model=Llama-3.2-3B-Instruct2026.07 | 59.6 | 58.6 | 27.1 | |
| SFT+RefBackbone Model=Llama-3.2-3B-Instruct2026.07 | 52.8 | 62.8 | 16.2 | |
| SaySelfBackbone Model=Llama-3.2-3B-Instruct2026.07 | 37.4 | 71.5 | 11 |