List your company
ResearchFormerly WizWand

Code Question Answering on CodeQA (Latency)

13.2Latency (s)Direct
4.41663.708123182.292Mar 20, 2026
Updated 7mo ago

Evaluation results

MethodLinks
DirectParadigm=P1: Direct, Backbone=Mistral, Model Size=7B2026.0313.2
DirectParadigm=P1: Direct, Backbone=Llama, Model Size=8B2026.0314.8
DirectParadigm=P1: Direct, Backbone=Qwen3, Model Size=8B2026.0315.6
DirectParadigm=P1: Direct, Backbone=Mistral, Model Size=Cdsrl2026.0320.1
DirectParadigm=P1: Direct, Backbone=Qwen3, Model Size=32B2026.0324.3
DirectParadigm=P1: Direct, Backbone=Mistral, Model Size=8x22B2026.0325.8
DirectParadigm=P1: Direct, Backbone=Llama, Model Size=70B2026.0327.6
λ-RLMParadigm=P3: λ-RLM, Backbone=Llama, Model Size=405B2026.0342.1
λ-RLMParadigm=P3: λ-RLM, Backbone=Qwen3, Model Size=235B2026.0346.8
DirectParadigm=P1: Direct, Backbone=Qwen3, Model Size=235B2026.0352.7
λ-RLMParadigm=P3: λ-RLM, Backbone=Llama, Model Size=70B2026.0354.2
λ-RLMParadigm=P3: λ-RLM, Backbone=Mistral, Model Size=Cdsrl2026.0354.3
DirectParadigm=P1: Direct, Backbone=Llama, Model Size=405B2026.0358.4
λ-RLMParadigm=P3: λ-RLM, Backbone=Qwen3, Model Size=32B2026.0358.6
λ-RLMParadigm=P3: λ-RLM, Backbone=Mistral, Model Size=8x22B2026.0363.7
λ-RLMParadigm=P3: λ-RLM, Backbone=Qwen3, Model Size=8B2026.0372.3
λ-RLMParadigm=P3: λ-RLM, Backbone=Llama, Model Size=8B2026.0376.4
λ-RLMParadigm=P3: λ-RLM, Backbone=Mistral, Model Size=7B2026.0381.5
RLMParadigm=P2: RLM, Backbone=Llama, Model Size=98.72026.0398.7
RLMParadigm=P2: RLM, Backbone=Qwen3, Model Size=235B2026.03112.5
RLMParadigm=P2: RLM, Backbone=Mistral, Model Size=Cdsrl2026.03145.6
RLMParadigm=P2: RLM, Backbone=Llama, Model Size=70B2026.03154.3
RLMParadigm=P2: RLM, Backbone=Qwen3, Model Size=32B2026.03168.2
RLMParadigm=P2: RLM, Backbone=Mistral, Model Size=8x22B2026.03182.4
RLMParadigm=P2: RLM, Backbone=Qwen3, Model Size=8B2026.03198.4
RLMParadigm=P2: RLM, Backbone=Llama, Model Size=8B2026.03215.6
RLMParadigm=P2: RLM, Backbone=Mistral, Model Size=7B2026.03232.8