Question Answering on MSMARCO Out-of-distribution (test)
46.2AccuracyRLCR
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| RLCRBackbone=Qwen2.5-7B-Instruct2026.05 | 46.2 | 8.54 | 66.77 | |
| RLVRBackbone=Mistral-7B-Instruct2026.05 | 43.14 | 5.68 | 68.36 | |
| BaseBackbone=Mistral-7B-Instruct2026.05 | 42.58 | 5.73 | 68.52 | |
| CSRBackbone=Mistral-7B-Instruct2026.05 | 42.54 | 4.83 | 71.72 | |
| RLCRBackbone=Mistral-7B-Instruct2026.05 | 42 | 15.99 | 61.47 | |
| BaseBackbone=Llama-3.1-8B-Instruct2026.05 | 41.53 | 8.78 | 71.17 | |
| RLVRBackbone=Llama-3.1-8B-Instruct2026.05 | 41.14 | 5.26 | 71.38 | |
| RDBackbone=Llama-3.1-8B-Instruct2026.05 | 40.9 | 16.56 | 67.82 | |
| RLCRBackbone=Llama-3.1-8B-Instruct2026.05 | 40.9 | 13.47 | 63.13 | |
| CSRBackbone=Llama-3.1-8B-Instruct2026.05 | 39.08 | 5.55 | 71.72 | |
| BaseBackbone=Qwen2.5-7B-Instruct2026.05 | 38.41 | 8.22 | 68.04 | |
| RLVRBackbone=Qwen2.5-7B-Instruct2026.05 | 38.39 | 8.39 | 68.58 | |
| CSRBackbone=Qwen2.5-7B-Instruct2026.05 | 36.74 | 5.5 | 71.34 | |
| RDBackbone=Qwen2.5-7B-Instruct2026.05 | 36.7 | 15.34 | 59.27 | |
| RDBackbone=Mistral-7B-Instruct2026.05 | 34.1 | 24.36 | 67.79 |