List your company
ResearchFormerly WizWand

LoRA Routing on PaperQA PMD-BENCH

92.3AccuracyPMDRouter
-1.92422.5384771.462Jul 5, 2026
Updated 3mo ago

Evaluation results

MethodLinks
PMDRouterBackbone=Qwen3-8B, Zero-shot=true2026.0792.3
PMDRouterBackbone=Qwen3-4B-Instruct, Zero-shot=true2026.0789.7
embeddingBackbone=Llama-3.1-8B2026.0788.4
embeddingBackbone=Qwen3-4B-Instruct2026.0788.4
embeddingBackbone=Qwen3-8B2026.0788.4
bm25Backbone=Llama-3.1-8B2026.0782
bm25Backbone=Qwen3-4B-Instruct2026.0782
bm25Backbone=Qwen3-8B2026.0782
embeddingBackbone=Llama-3.1-8B2026.0776.2
embeddingBackbone=Qwen3-4B-Instruct2026.0776.2
embeddingBackbone=Qwen3-8B2026.0776.2
bm25Backbone=Llama-3.1-8B2026.0773.5
bm25Backbone=Qwen3-4B-Instruct2026.0773.5
bm25Backbone=Qwen3-8B2026.0773.5
PMDRouterBackbone=Llama-3.1-8B, Zero-shot=true2026.0766.3
PMDRouterBackbone=Qwen3-8B, Zero-shot=true2026.0765.8
LAGBackbone=Qwen3-8B, Zero-shot=true2026.0763.6
PMDRouterBackbone=Qwen3-4B-Instruct, Zero-shot=true2026.0761.3
PMDRouterBackbone=Llama-3.1-8B, Zero-shot=true2026.0760
LAGBackbone=Qwen3-4B-Instruct, Zero-shot=true2026.0759.8
LAGBackbone=Llama-3.1-8B, Zero-shot=true2026.0744
L-AlphaZBackbone=Qwen3-4B-Instruct, Zero-shot=true2026.0740.6
L-HidL2-LastMedBackbone=Qwen3-4B-Instruct, Zero-shot=true2026.0737.8
L-HidL2-L4ZBackbone=Qwen3-4B-Instruct, Zero-shot=true2026.0737.7
B-CtrL2Backbone=Qwen3-4B-Instruct, Zero-shot=true2026.0736.5
ArrowBackbone=Llama-3.1-8B, Zero-shot=true2026.0736.4
SPECTRBackbone=Llama-3.1-8B, Zero-shot=true2026.0735.8
J-GlobalBackbone=Llama-3.1-8B, Zero-shot=true2026.0735.7
ArrowBackbone=Qwen3-4B-Instruct, Zero-shot=true2026.0734.2
LAGBackbone=Qwen3-4B-Instruct, Zero-shot=true2026.0732.6
LAGBackbone=Llama-3.1-8B, Zero-shot=true2026.0731.5
ArrowBackbone=Qwen3-8B, Zero-shot=true2026.0731.1
L-AlphaZBackbone=Llama-3.1-8B, Zero-shot=true2026.0730.9
SPECTRBackbone=Qwen3-4B-Instruct, Zero-shot=true2026.0730.2
J-GlobalBackbone=Qwen3-4B-Instruct, Zero-shot=true2026.0730.1
J-MLPGlobalBackbone=Qwen3-4B-Instruct, Zero-shot=true2026.0730
B-LogitVarBackbone=Qwen3-4B-Instruct, Zero-shot=true2026.0728.8
B-CtrL2Backbone=Llama-3.1-8B, Zero-shot=true2026.0728.7
L-AlphaZBackbone=Qwen3-8B, Zero-shot=true2026.0728.5
L-HidL2-LastMedBackbone=Llama-3.1-8B, Zero-shot=true2026.0728.2
L-HidL2-L4ZBackbone=Llama-3.1-8B, Zero-shot=true2026.0726.9
B-LogitVarBackbone=Llama-3.1-8B, Zero-shot=true2026.0726.3
J-WAllZBackbone=Llama-3.1-8B, Zero-shot=true2026.0725.6
B-S4aBackbone=Qwen3-4B-Instruct, Zero-shot=true2026.0725.6
L-AlphaZBackbone=Qwen3-4B-Instruct, Zero-shot=true2026.0722.2
J-WAllZBackbone=Qwen3-4B-Instruct, Zero-shot=true2026.0721.9
LAGBackbone=Qwen3-8B, Zero-shot=true2026.0721.7
SPECTRBackbone=Llama-3.1-8B, Zero-shot=true2026.0718.7
B-CtrL2Backbone=Qwen3-8B, Zero-shot=true2026.0718.2
L-HidL2-L4ZBackbone=Qwen3-8B, Zero-shot=true2026.0718
L-HidL2-L4ZBackbone=Llama-3.1-8B, Zero-shot=true2026.0717.9
B-S4aBackbone=Qwen3-8B, Zero-shot=true2026.0717.8
L-HidL2-LastMedBackbone=Qwen3-8B, Zero-shot=true2026.0717.8
L-HidL2-L4ZBackbone=Qwen3-4B-Instruct, Zero-shot=true2026.0717.1
B-LogitVarBackbone=Qwen3-8B, Zero-shot=true2026.0717
L-AlphaZBackbone=Llama-3.1-8B, Zero-shot=true2026.0716.2
ArrowBackbone=Llama-3.1-8B, Zero-shot=true2026.0715.8
B-CtrL2Backbone=Qwen3-4B-Instruct, Zero-shot=true2026.0714.2
ArrowBackbone=Qwen3-4B-Instruct, Zero-shot=true2026.0713.9
J-GlobalBackbone=Qwen3-8B, Zero-shot=true2026.0713.8
B-S4aBackbone=Qwen3-4B-Instruct, Zero-shot=true2026.0713.6
SPECTRBackbone=Qwen3-8B, Zero-shot=true2026.0712.7
B-S4aBackbone=Llama-3.1-8B, Zero-shot=true2026.0712.6
J-MLPGlobalBackbone=Llama-3.1-8B, Zero-shot=true2026.0712.5
L-HidL2-LastMedBackbone=Llama-3.1-8B, Zero-shot=true2026.0712.2
B-LogitVarBackbone=Llama-3.1-8B, Zero-shot=true2026.0712
J-MLPGlobalBackbone=Qwen3-4B-Instruct, Zero-shot=true2026.0712
ArrowBackbone=Qwen3-8B, Zero-shot=true2026.0710.8
J-MLPGlobalBackbone=Qwen3-8B, Zero-shot=true2026.0710.2
SPECTRBackbone=Qwen3-4B-Instruct, Zero-shot=true2026.0710
J-GlobalBackbone=Qwen3-4B-Instruct, Zero-shot=true2026.079.6
J-GlobalBackbone=Qwen3-8B, Zero-shot=true2026.079.1
L-AlphaZBackbone=Qwen3-8B, Zero-shot=true2026.078.9
B-LogitVarBackbone=Qwen3-4B-Instruct, Zero-shot=true2026.078.2
J-WAllZBackbone=Llama-3.1-8B, Zero-shot=true2026.078
J-WAllZBackbone=Qwen3-4B-Instruct, Zero-shot=true2026.078
L-HidL2-L4ZBackbone=Qwen3-8B, Zero-shot=true2026.078
B-CtrL2Backbone=Llama-3.1-8B, Zero-shot=true2026.077.8
B-LogitVarBackbone=Qwen3-8B, Zero-shot=true2026.077.8
J-MLPGlobalBackbone=Llama-3.1-8B, Zero-shot=true2026.077.3
L-HidL2-LastMedBackbone=Qwen3-4B-Instruct, Zero-shot=true2026.077.3
J-MLPGlobalBackbone=Qwen3-8B, Zero-shot=true2026.077.1
L-HidL2-LastMedBackbone=Qwen3-8B, Zero-shot=true2026.076.9
B-S4aBackbone=Llama-3.1-8B, Zero-shot=true2026.076.7
B-CtrL2Backbone=Qwen3-8B, Zero-shot=true2026.076.7
B-S4aBackbone=Qwen3-8B, Zero-shot=true2026.076.7
J-WAllZBackbone=Qwen3-8B, Zero-shot=true2026.076.6
J-WAllZBackbone=Qwen3-8B, Zero-shot=true2026.076.4
J-GlobalBackbone=Llama-3.1-8B, Zero-shot=true2026.076.2
SPECTRBackbone=Qwen3-8B, Zero-shot=true2026.071.7