Mathematical Reasoning on OlympiadBench (Acc, AUROC, ECE)
37.6AccuracyRLVR
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| RLVRModel family=Qwen2.5VL-7B-Instruct, Decoding temperature=0.7, top_k=-1, top_p=1, Seed=0, 42, 20252026.07 | 37.6 | 51.4 | 61.6 | |
| C3RL (Ours)Model family=Qwen2.5VL-7B-Instruct, Decoding temperature=0.7, top_k=-1, top_p=1, Seed=0, 42, 20252026.07 | 37.5 | 78.3 | 19.1 | |
| C3RL w/o RefModel family=Qwen2.5VL-7B-Instruct, Decoding temperature=0.7, top_k=-1, top_p=1, Seed=0, 42, 20252026.07 | 35.9 | 74.5 | 26.3 | |
| RLCRModel family=Qwen2.5VL-7B-Instruct, Decoding temperature=0.7, top_k=-1, top_p=1, Seed=0, 42, 20252026.07 | 35.4 | 80.5 | 14.7 | |
| SaySelfModel family=Qwen2.5VL-7B-Instruct, Decoding temperature=0.7, top_k=-1, top_p=1, Seed=0, 42, 20252026.07 | 28.3 | 79.9 | 7.1 | |
| SCModel family=Qwen2.5VL-7B-Instruct, Decoding temperature=0.7, top_k=-1, top_p=12026.07 | 26.6 | 78.3 | 9 | |
| BaseModel family=Qwen2.5VL-7B-Instruct, Decoding temperature=0.7, top_k=-1, top_p=1, Seed=0, 42, 20252026.07 | 20.3 | 59.4 | 70.9 | |
| RLVRModel family=Llama-3.2-3B-Instruct, Decoding temperature=0.7, top_k=-1, top_p=1, Seed=0, 42, 20252026.07 | 17 | 59.3 | 75.4 | |
| C3RL w/o RefModel family=Llama-3.2-3B-Instruct, Decoding temperature=0.7, top_k=-1, top_p=1, Seed=0, 42, 20252026.07 | 16.2 | 65.6 | 27.8 | |
| C3RL (Ours)Model family=Llama-3.2-3B-Instruct, Decoding temperature=0.7, top_k=-1, top_p=1, Seed=0, 42, 20252026.07 | 15.8 | 64.1 | 28.9 | |
| RLCRModel family=Llama-3.2-3B-Instruct, Decoding temperature=0.7, top_k=-1, top_p=1, Seed=0, 42, 20252026.07 | 12.8 | 65.7 | 7.7 | |
| SFT+RefModel family=Qwen2.5VL-7B-Instruct, Decoding temperature=0.7, top_k=-1, top_p=1, Seed=0, 42, 20252026.07 | 10.3 | 73.2 | 14.1 | |
| SCModel family=Llama-3.2-3B-Instruct, Decoding temperature=0.7, top_k=-1, top_p=12026.07 | 8.6 | 63.1 | 12 | |
| BaseModel family=Llama-3.2-3B-Instruct, Decoding temperature=0.7, top_k=-1, top_p=1, Seed=0, 42, 20252026.07 | 8.3 | 55.9 | 37.9 | |
| SFT+RefModel family=Llama-3.2-3B-Instruct, Decoding temperature=0.7, top_k=-1, top_p=1, Seed=0, 42, 20252026.07 | 5.2 | 58.3 | 17 | |
| SaySelfModel family=Llama-3.2-3B-Instruct, Decoding temperature=0.7, top_k=-1, top_p=1, Seed=0, 42, 20252026.07 | 3.3 | 65.4 | 8.3 |