Long-context reasoning (Pairs) on OOL-Pairs
64.3Accuracyλ-RLM
Evaluation Results
| Method | Links | |
|---|---|---|
| λ-RLMParadigm=P3, Model Family=Llama, Model Scale=405B2026.03 | 64.3 | |
| λ-RLMParadigm=P3, Model Family=Qwen3, Model Scale=235B2026.03 | 61.5 | |
| λ-RLMParadigm=P3, Model Family=Llama, Model Scale=70B2026.03 | 50.7 | |
| λ-RLMParadigm=P3, Model Family=Qwen3, Model Scale=32B2026.03 | 48.2 | |
| λ-RLMParadigm=P3, Model Family=Mistral, Model Scale=Cdsrl2026.03 | 47.6 | |
| λ-RLMParadigm=P3, Model Family=Mistral, Model Scale=8x22B2026.03 | 44.1 | |
| RLMParadigm=P2, Model Family=Llama, Model Scale=405B2026.03 | 42.7 | |
| RLMParadigm=P2, Model Family=Qwen3, Model Scale=235B2026.03 | 38.4 | |
| λ-RLMParadigm=P3, Model Family=Qwen3, Model Scale=8B2026.03 | 34.8 | |
| λ-RLMParadigm=P3, Model Family=Llama, Model Scale=8B2026.03 | 31.6 | |
| λ-RLMParadigm=P3, Model Family=Mistral, Model Scale=7B2026.03 | 28.4 | |
| RLMParadigm=P2, Model Family=Mistral, Model Scale=Cdsrl2026.03 | 22.8 | |
| RLMParadigm=P2, Model Family=Llama, Model Scale=70B2026.03 | 21.3 | |
| RLMParadigm=P2, Model Family=Qwen3, Model Scale=32B2026.03 | 18.6 | |
| RLMParadigm=P2, Model Family=Mistral, Model Scale=8x22B2026.03 | 14.5 | |
| RLMParadigm=P2, Model Family=Qwen3, Model Scale=8B2026.03 | 4.2 | |
| RLMParadigm=P2, Model Family=Llama, Model Scale=8B2026.03 | 3.8 | |
| RLMParadigm=P2, Model Family=Mistral, Model Scale=7B2026.03 | 2.1 | |
| DirectParadigm=P1, Model Family=Llama, Model Scale=70B2026.03 | 0.4 | |
| DirectParadigm=P1, Model Family=Qwen3, Model Scale=32B2026.03 | 0.3 | |
| DirectParadigm=P1, Model Family=Llama, Model Scale=405B2026.03 | 0.2 | |
| DirectParadigm=P1, Model Family=Mistral, Model Scale=8x22B2026.03 | 0.2 | |
| DirectParadigm=P1, Model Family=Qwen3, Model Scale=8B2026.03 | 0.1 | |
| DirectParadigm=P1, Model Family=Qwen3, Model Scale=235B2026.03 | 0.1 | |
| DirectParadigm=P1, Model Family=Llama, Model Scale=8B2026.03 | 0.1 | |
| DirectParadigm=P1, Model Family=Mistral, Model Scale=Cdsrl2026.03 | 0.1 | |
| DirectParadigm=P1, Model Family=Mistral, Model Scale=7B2026.03 | 0 |