Factual Question Answering on Factual Category Average (test)
31.38AccuracyRLVR+QuestionProb
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| RLVR+QuestionProbModel Size=7B, Backbone=Qwen2.5-Instruct2026.03 | 31.38 | 55 | 30 | 31 | |
| RLVR+Assessor ModelModel Size=7B, Backbone=Qwen2.5-Instruct2026.03 | 31.38 | 61 | 26 | 26 | |
| RLVR+ProbeModel Size=7B, Backbone=Qwen2.5-Instruct2026.03 | 31.38 | 64 | 21 | 21 | |
| RLVRModel Size=7B, Backbone=Qwen2.5-Instruct2026.03 | 30.74 | 60 | 58 | 53 | |
| Instruct ModelModel Size=7B, Backbone=Qwen2.5-Instruct2026.03 | 30.13 | 63 | 58 | 52 | |
| CoCAModel Size=7B, Backbone=Qwen2.5-Instruct2026.03 | 28.85 | 69 | 26 | 24 | |
| RLVR+QuestionProbModel Size=3B, Backbone=Qwen2.5-Instruct2026.03 | 26.01 | 50 | 26 | 26 | |
| RLVR+Assessor ModelModel Size=3B, Backbone=Qwen2.5-Instruct2026.03 | 26.01 | 61 | 27 | 25 | |
| RLVR+ProbeModel Size=3B, Backbone=Qwen2.5-Instruct2026.03 | 26.01 | 64 | 29 | 24 | |
| CoCAModel Size=3B, Backbone=Qwen2.5-Instruct2026.03 | 24.74 | 73 | 14 | 14 | |
| RLVRModel Size=3B, Backbone=Qwen2.5-Instruct2026.03 | 23.92 | 54 | 62 | 56 | |
| Instruct ModelModel Size=3B, Backbone=Qwen2.5-Instruct2026.03 | 22.71 | 57 | 66 | 60 | |
| RLVR+QuestionProbModel Size=1.5B, Backbone=Qwen2.5-Instruct2026.03 | 19.79 | 51 | 19 | 20 | |
| RLVR+Assessor ModelModel Size=1.5B, Backbone=Qwen2.5-Instruct2026.03 | 19.79 | 63 | 16 | 17 | |
| RLVR+ProbeModel Size=1.5B, Backbone=Qwen2.5-Instruct2026.03 | 19.79 | 57 | 46 | 42 | |
| CoCAModel Size=1.5B, Backbone=Qwen2.5-Instruct2026.03 | 18.89 | 71 | 9 | 12 | |
| RLVRModel Size=1.5B, Backbone=Qwen2.5-Instruct2026.03 | 16.77 | 54 | 76 | 71 | |
| Instruct ModelModel Size=1.5B, Backbone=Qwen2.5-Instruct2026.03 | 14.81 | 53 | 72 | 66 |