Latency Measurement for Long-context reasoning on OOLONG
7.1Latency (s)Direct
Evaluation Results
| Method | Links | |
|---|---|---|
| DirectParadigm=P1: Direct, Backbone=Mistral, Model Size=7B2026.03 | 7.1 | |
| DirectParadigm=P1: Direct, Backbone=Llama, Model Size=8B2026.03 | 7.9 | |
| DirectParadigm=P1: Direct, Backbone=Qwen3, Model Size=8B2026.03 | 8.4 | |
| DirectParadigm=P1: Direct, Backbone=Mistral, Model Size=Cdsrl2026.03 | 12.6 | |
| DirectParadigm=P1: Direct, Backbone=Qwen3, Model Size=32B2026.03 | 14.2 | |
| DirectParadigm=P1: Direct, Backbone=Mistral, Model Size=8x22B2026.03 | 15.4 | |
| DirectParadigm=P1: Direct, Backbone=Llama, Model Size=70B2026.03 | 16.1 | |
| DirectParadigm=P1: Direct, Backbone=Qwen3, Model Size=235B2026.03 | 35.8 | |
| λ-RLMParadigm=P3: λ-RLM, Backbone=Llama, Model Size=405B2026.03 | 38.5 | |
| DirectParadigm=P1: Direct, Backbone=Llama, Model Size=405B2026.03 | 40.3 | |
| λ-RLMParadigm=P3: λ-RLM, Backbone=Qwen3, Model Size=235B2026.03 | 42.3 | |
| λ-RLMParadigm=P3: λ-RLM, Backbone=Mistral, Model Size=Cdsrl2026.03 | 48.1 | |
| λ-RLMParadigm=P3: λ-RLM, Backbone=Llama, Model Size=70B2026.03 | 48.2 | |
| λ-RLMParadigm=P3: λ-RLM, Backbone=Qwen3, Model Size=32B2026.03 | 51.7 | |
| λ-RLMParadigm=P3: λ-RLM, Backbone=Mistral, Model Size=8x22B2026.03 | 56.4 | |
| λ-RLMParadigm=P3: λ-RLM, Backbone=Qwen3, Model Size=8B2026.03 | 62.4 | |
| λ-RLMParadigm=P3: λ-RLM, Backbone=Llama, Model Size=8B2026.03 | 66.8 | |
| λ-RLMParadigm=P3: λ-RLM, Backbone=Mistral, Model Size=7B2026.03 | 71.5 | |
| RLMParadigm=P2: RLM, Backbone=Llama, Model Size=405B2026.03 | 108.2 | |
| RLMParadigm=P2: RLM, Backbone=Qwen3, Model Size=235B2026.03 | 125.7 | |
| RLMParadigm=P2: RLM, Backbone=Mistral, Model Size=Cdsrl2026.03 | 168.7 | |
| RLMParadigm=P2: RLM, Backbone=Llama, Model Size=70B2026.03 | 182.5 | |
| RLMParadigm=P2: RLM, Backbone=Qwen3, Model Size=32B2026.03 | 198.3 | |
| RLMParadigm=P2: RLM, Backbone=Mistral, Model Size=8x22B2026.03 | 215.3 | |
| RLMParadigm=P2: RLM, Backbone=Qwen3, Model Size=8B2026.03 | 241.6 | |
| RLMParadigm=P2: RLM, Backbone=Llama, Model Size=8B2026.03 | 258.4 | |
| RLMParadigm=P2: RLM, Backbone=Mistral, Model Size=7B2026.03 | 284.1 |