Code Question Answering on CodeQA (Latency)
13.2Latency (s)Direct
Evaluation Results
| Method | Links | |
|---|---|---|
| DirectParadigm=P1: Direct, Backbone=Mistral, Model Size=7B2026.03 | 13.2 | |
| DirectParadigm=P1: Direct, Backbone=Llama, Model Size=8B2026.03 | 14.8 | |
| DirectParadigm=P1: Direct, Backbone=Qwen3, Model Size=8B2026.03 | 15.6 | |
| DirectParadigm=P1: Direct, Backbone=Mistral, Model Size=Cdsrl2026.03 | 20.1 | |
| DirectParadigm=P1: Direct, Backbone=Qwen3, Model Size=32B2026.03 | 24.3 | |
| DirectParadigm=P1: Direct, Backbone=Mistral, Model Size=8x22B2026.03 | 25.8 | |
| DirectParadigm=P1: Direct, Backbone=Llama, Model Size=70B2026.03 | 27.6 | |
| λ-RLMParadigm=P3: λ-RLM, Backbone=Llama, Model Size=405B2026.03 | 42.1 | |
| λ-RLMParadigm=P3: λ-RLM, Backbone=Qwen3, Model Size=235B2026.03 | 46.8 | |
| DirectParadigm=P1: Direct, Backbone=Qwen3, Model Size=235B2026.03 | 52.7 | |
| λ-RLMParadigm=P3: λ-RLM, Backbone=Llama, Model Size=70B2026.03 | 54.2 | |
| λ-RLMParadigm=P3: λ-RLM, Backbone=Mistral, Model Size=Cdsrl2026.03 | 54.3 | |
| DirectParadigm=P1: Direct, Backbone=Llama, Model Size=405B2026.03 | 58.4 | |
| λ-RLMParadigm=P3: λ-RLM, Backbone=Qwen3, Model Size=32B2026.03 | 58.6 | |
| λ-RLMParadigm=P3: λ-RLM, Backbone=Mistral, Model Size=8x22B2026.03 | 63.7 | |
| λ-RLMParadigm=P3: λ-RLM, Backbone=Qwen3, Model Size=8B2026.03 | 72.3 | |
| λ-RLMParadigm=P3: λ-RLM, Backbone=Llama, Model Size=8B2026.03 | 76.4 | |
| λ-RLMParadigm=P3: λ-RLM, Backbone=Mistral, Model Size=7B2026.03 | 81.5 | |
| RLMParadigm=P2: RLM, Backbone=Llama, Model Size=98.72026.03 | 98.7 | |
| RLMParadigm=P2: RLM, Backbone=Qwen3, Model Size=235B2026.03 | 112.5 | |
| RLMParadigm=P2: RLM, Backbone=Mistral, Model Size=Cdsrl2026.03 | 145.6 | |
| RLMParadigm=P2: RLM, Backbone=Llama, Model Size=70B2026.03 | 154.3 | |
| RLMParadigm=P2: RLM, Backbone=Qwen3, Model Size=32B2026.03 | 168.2 | |
| RLMParadigm=P2: RLM, Backbone=Mistral, Model Size=8x22B2026.03 | 182.4 | |
| RLMParadigm=P2: RLM, Backbone=Qwen3, Model Size=8B2026.03 | 198.4 | |
| RLMParadigm=P2: RLM, Backbone=Llama, Model Size=8B2026.03 | 215.6 | |
| RLMParadigm=P2: RLM, Backbone=Mistral, Model Size=7B2026.03 | 232.8 |