Question Answering on NQ-Open Out-of-distribution (test)
49.93AccuracyBase
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| BaseBackbone=Llama-3.1-8B-Instruct2026.05 | 49.93 | 10.02 | 70.81 | |
| RLVRBackbone=Llama-3.1-8B-Instruct2026.05 | 49.58 | 8.03 | 69.14 | |
| CSRBackbone=Llama-3.1-8B-Instruct2026.05 | 46.05 | 6.92 | 76.67 | |
| RLVRBackbone=Mistral-7B-Instruct2026.05 | 44.87 | 4.01 | 72.28 | |
| BaseBackbone=Mistral-7B-Instruct2026.05 | 44.56 | 6.38 | 73.1 | |
| RLCRBackbone=Mistral-7B-Instruct2026.05 | 44 | 14.43 | 64.42 | |
| RLCRBackbone=Llama-3.1-8B-Instruct2026.05 | 43.7 | 16.55 | 61.27 | |
| CSRBackbone=Mistral-7B-Instruct2026.05 | 43.35 | 3.54 | 79.11 | |
| RDBackbone=Llama-3.1-8B-Instruct2026.05 | 42.4 | 12.18 | 73.65 | |
| RLCRBackbone=Qwen2.5-7B-Instruct2026.05 | 37.5 | 21.71 | 59.02 | |
| RLVRBackbone=Qwen2.5-7B-Instruct2026.05 | 31.18 | 9.72 | 77.91 | |
| BaseBackbone=Qwen2.5-7B-Instruct2026.05 | 31.05 | 9.76 | 78.49 | |
| CSRBackbone=Qwen2.5-7B-Instruct2026.05 | 29.98 | 5.7 | 84.73 | |
| RDBackbone=Mistral-7B-Instruct2026.05 | 29.7 | 23.23 | 72.92 | |
| RDBackbone=Qwen2.5-7B-Instruct2026.05 | 27.4 | 9.07 | 66.94 |