Long Context on MRCR
89.7ScoreGemini-3.0 Pro
Evaluation results
| Method | Links | |
|---|---|---|
| Gemini-3.0 ProVariant=Pro2026.01 | 89.7 | |
| DeepSeek-V3.2 ThinkingThinking Mode=true2026.01 | 55.5 | |
| Claude Sonnet 4.5Variant=Sonnet 4.52026.01 | 55.4 | |
| LONGTRACERLBackbone=Qwen3-30B-A3B-Thinking-25072026.05 | 46.5 | |
| LONGTRACERLBackbone=Qwen3-4B-Thinking-25072026.05 | 45.8 | |
| MiMo-V2-FlashVariant=Flash2026.01 | 45.7 | |
| DocQABackbone=Qwen3-30B-A3B-Thinking-25072026.05 | 44.8 | |
| LONGTRACERL-GRPOBackbone=Qwen3-30B-A3B-Thinking-25072026.05 | 44.7 | |
| Kimi-K2 ThinkingThinking Mode=true2026.01 | 44.2 | |
| LoongRLBackbone=Qwen3-30B-A3B-Thinking-25072026.05 | 43.8 | |
| LongRLVRBackbone=Qwen3-30B-A3B-Thinking-25072026.05 | 43.3 | |
| DocQABackbone=Qwen3-4B-Thinking-25072026.05 | 41.9 | |
| LongRLVRBackbone=Qwen3-4B-Thinking-25072026.05 | 41.8 | |
| BaseBackbone=Qwen3-30B-A3B-Thinking-25072026.05 | 40.8 | |
| LONGTRACERL-GRPOBackbone=Qwen3-4B-Thinking-25072026.05 | 38.9 | |
| LoongRLBackbone=Qwen3-4B-Thinking-25072026.05 | 38.2 | |
| BaseBackbone=Qwen3-4B-Thinking-25072026.05 | 36.2 | |
| BaseBackbone=DeepSeek-R1-0528-Qwen3-8B2026.05 | 27 | |
| LONGTRACERLBackbone=DeepSeek-R1-0528-Qwen3-8B2026.05 | 27 | |
| LONGTRACERL-GRPOBackbone=DeepSeek-R1-0528-Qwen3-8B2026.05 | 25.2 | |
| LongRLVRBackbone=DeepSeek-R1-0528-Qwen3-8B2026.05 | 21.9 | |
| JT-Safe-V2-35BParameters=35B2026.05 | 21.6 | |
| DocQABackbone=DeepSeek-R1-0528-Qwen3-8B2026.05 | 20.2 | |
| LoongRLBackbone=DeepSeek-R1-0528-Qwen3-8B2026.05 | 19 | |
| SOTA with Equivalent ParametersModel comparison=Equivalent Parameters2026.05 | 15.6 |