LoRA Routing on NQ-DomainLoRA PMD-BENCH
89.7Accuracybm25
Evaluation Results
| Method | Links | |
|---|---|---|
| bm25Backbone=Llama-3.1-8B2026.07 | 89.7 | |
| bm25Backbone=Qwen3-4B-Instruct2026.07 | 89.7 | |
| bm25Backbone=Qwen3-8B2026.07 | 89.7 | |
| LAGBackbone=Qwen3-4B-Instruct, Zero-shot=true2026.07 | 79.3 | |
| PMDRouterBackbone=Qwen3-8B, Zero-shot=true2026.07 | 79 | |
| PMDRouterBackbone=Qwen3-4B-Instruct, Zero-shot=true2026.07 | 78.1 | |
| PMDRouterBackbone=Llama-3.1-8B, Zero-shot=true2026.07 | 76.9 | |
| LAGBackbone=Qwen3-8B, Zero-shot=true2026.07 | 75.4 | |
| LAGBackbone=Llama-3.1-8B, Zero-shot=true2026.07 | 73.3 | |
| SPECTRBackbone=Llama-3.1-8B, Zero-shot=true2026.07 | 60.1 | |
| SPECTRBackbone=Qwen3-4B-Instruct, Zero-shot=true2026.07 | 57 | |
| SPECTRBackbone=Qwen3-8B, Zero-shot=true2026.07 | 47.4 | |
| embeddingBackbone=Llama-3.1-8B2026.07 | 39.7 | |
| embeddingBackbone=Qwen3-4B-Instruct2026.07 | 39.7 | |
| embeddingBackbone=Qwen3-8B2026.07 | 39.7 | |
| L-HidL2-LastMedBackbone=Qwen3-4B-Instruct, Zero-shot=true2026.07 | 21.2 | |
| L-AlphaZBackbone=Qwen3-4B-Instruct, Zero-shot=true2026.07 | 21.1 | |
| L-AlphaZBackbone=Llama-3.1-8B, Zero-shot=true2026.07 | 18.6 | |
| ArrowBackbone=Qwen3-8B, Zero-shot=true2026.07 | 16.2 | |
| L-HidL2-L4ZBackbone=Llama-3.1-8B, Zero-shot=true2026.07 | 15.9 | |
| J-WAllZBackbone=Qwen3-4B-Instruct, Zero-shot=true2026.07 | 15.1 | |
| L-HidL2-LastMedBackbone=Llama-3.1-8B, Zero-shot=true2026.07 | 14.7 | |
| B-CtrL2Backbone=Qwen3-4B-Instruct, Zero-shot=true2026.07 | 14.4 | |
| ArrowBackbone=Qwen3-4B-Instruct, Zero-shot=true2026.07 | 13 | |
| B-LogitVarBackbone=Qwen3-4B-Instruct, Zero-shot=true2026.07 | 12.5 | |
| B-S4aBackbone=Qwen3-4B-Instruct, Zero-shot=true2026.07 | 12.4 | |
| L-HidL2-L4ZBackbone=Qwen3-4B-Instruct, Zero-shot=true2026.07 | 12.2 | |
| L-AlphaZBackbone=Qwen3-8B, Zero-shot=true2026.07 | 12 | |
| B-LogitVarBackbone=Llama-3.1-8B, Zero-shot=true2026.07 | 11.9 | |
| J-WAllZBackbone=Qwen3-8B, Zero-shot=true2026.07 | 11.8 | |
| J-GlobalBackbone=Llama-3.1-8B, Zero-shot=true2026.07 | 11.6 | |
| B-CtrL2Backbone=Qwen3-8B, Zero-shot=true2026.07 | 10.3 | |
| B-CtrL2Backbone=Llama-3.1-8B, Zero-shot=true2026.07 | 9.9 | |
| L-HidL2-L4ZBackbone=Qwen3-8B, Zero-shot=true2026.07 | 9.7 | |
| B-S4aBackbone=Llama-3.1-8B, Zero-shot=true2026.07 | 9.1 | |
| B-LogitVarBackbone=Qwen3-8B, Zero-shot=true2026.07 | 9.1 | |
| B-S4aBackbone=Qwen3-8B, Zero-shot=true2026.07 | 9.1 | |
| J-WAllZBackbone=Llama-3.1-8B, Zero-shot=true2026.07 | 9 | |
| ArrowBackbone=Llama-3.1-8B, Zero-shot=true2026.07 | 8.7 | |
| L-HidL2-LastMedBackbone=Qwen3-8B, Zero-shot=true2026.07 | 8.4 | |
| J-MLPGlobalBackbone=Llama-3.1-8B, Zero-shot=true2026.07 | 8.3 | |
| J-MLPGlobalBackbone=Qwen3-4B-Instruct, Zero-shot=true2026.07 | 8.3 | |
| J-MLPGlobalBackbone=Qwen3-8B, Zero-shot=true2026.07 | 8.3 | |
| J-GlobalBackbone=Qwen3-8B, Zero-shot=true2026.07 | 4.9 | |
| J-GlobalBackbone=Qwen3-4B-Instruct, Zero-shot=true2026.07 | 3.5 |