Latency Measurement on OOL-Pairs for Long-context reasoning
5.1Latency (s)Direct
Evaluation Results
| Method | Links | |
|---|---|---|
| DirectParadigm=P1: Direct, Backbone=Mistral, Model Size=7B2026.03 | 5.1 | |
| DirectParadigm=P1: Direct, Backbone=Llama, Model Size=8B2026.03 | 5.8 | |
| DirectParadigm=P1: Direct, Backbone=Qwen3, Model Size=8B2026.03 | 6.2 | |
| DirectParadigm=P1: Direct, Backbone=Mistral, Model Size=Cdsrl2026.03 | 9.4 | |
| DirectParadigm=P1: Direct, Backbone=Qwen3, Model Size=32B2026.03 | 10.8 | |
| DirectParadigm=P1: Direct, Backbone=Mistral, Model Size=8x22B2026.03 | 11.7 | |
| DirectParadigm=P1: Direct, Backbone=Llama, Model Size=70B2026.03 | 12.3 | |
| DirectParadigm=P1: Direct, Backbone=Qwen3, Model Size=235B2026.03 | 28.4 | |
| λ-RLMParadigm=P3: λ-RLM, Backbone=Llama, Model Size=30.82026.03 | 30.8 | |
| DirectParadigm=P1: Direct, Backbone=Llama, Model Size=405B2026.03 | 32.1 | |
| λ-RLMParadigm=P3: λ-RLM, Backbone=Qwen3, Model Size=235B2026.03 | 34.7 | |
| λ-RLMParadigm=P3: λ-RLM, Backbone=Mistral, Model Size=Cdsrl2026.03 | 38.2 | |
| λ-RLMParadigm=P3: λ-RLM, Backbone=Llama, Model Size=70B2026.03 | 38.4 | |
| λ-RLMParadigm=P3: λ-RLM, Backbone=Qwen3, Model Size=32B2026.03 | 41.2 | |
| λ-RLMParadigm=P3: λ-RLM, Backbone=Mistral, Model Size=8x22B2026.03 | 44.6 | |
| λ-RLMParadigm=P3: λ-RLM, Backbone=Qwen3, Model Size=8B2026.03 | 48.6 | |
| λ-RLMParadigm=P3: λ-RLM, Backbone=Llama, Model Size=8B2026.03 | 52.1 | |
| λ-RLMParadigm=P3: λ-RLM, Backbone=Mistral, Model Size=7B2026.03 | 55.8 | |
| RLMParadigm=P2: RLM, Backbone=Llama, Model Size=405B2026.03 | 156.4 | |
| RLMParadigm=P2: RLM, Backbone=Qwen3, Model Size=235B2026.03 | 178.3 | |
| RLMParadigm=P2: RLM, Backbone=Mistral, Model Size=Cdsrl2026.03 | 224.5 | |
| RLMParadigm=P2: RLM, Backbone=Llama, Model Size=70B2026.03 | 241.8 | |
| RLMParadigm=P2: RLM, Backbone=Qwen3, Model Size=32B2026.03 | 264.7 | |
| RLMParadigm=P2: RLM, Backbone=Mistral, Model Size=8x22B2026.03 | 288.6 | |
| RLMParadigm=P2: RLM, Backbone=Qwen3, Model Size=8B2026.03 | 312.5 | |
| RLMParadigm=P2: RLM, Backbone=Llama, Model Size=8B2026.03 | 338.1 | |
| RLMParadigm=P2: RLM, Backbone=Mistral, Model Size=7B2026.03 | 365.2 |