List your company
ResearchFormerly WizWand

Question Answering on PaperQA

6Judge Scorebm25
2.979843.763924.5485.33208Jul 5, 2026
Updated 3mo ago

Evaluation results

MethodLinks
bm25Backbone=Qwen3 4B, Category=Text retrieval2026.076
bm25Backbone=Qwen3 8B, Category=Text retrieval2026.075.964
embeddingBackbone=Qwen3 8B, Category=Text retrieval2026.075.842
embeddingBackbone=Qwen3 4B, Category=Text retrieval2026.075.833
bm25Backbone=Llama 3.1-8B, Category=Text retrieval2026.075.753
embeddingBackbone=Llama 3.1-8B, Category=Text retrieval2026.075.516
PMDRouterBackbone=Qwen3 8B, Category=Joint Backbone-LoRA2026.075.309
PMDRouterBackbone=Llama 3.1-8B, Category=Joint Backbone-LoRA2026.075.271
LAGBackbone=Qwen3 8B, Category=Joint Backbone-LoRA2026.075.176
PMDRouterBackbone=Qwen3 4B, Category=Joint Backbone-LoRA2026.075.093
LAGBackbone=Qwen3 4B, Category=Joint Backbone-LoRA2026.074.993
LAGBackbone=Llama 3.1-8B, Category=Joint Backbone-LoRA2026.074.522
ArrowBackbone=Llama 3.1-8B, Category=Joint Backbone-LoRA2026.074.453
L-HidL2-L4ZBackbone=Llama 3.1-8B, Category=LoRA-only2026.074.24
ArrowBackbone=Qwen3 8B, Category=Joint Backbone-LoRA2026.074.184
L-AlphaZBackbone=Llama 3.1-8B, Category=LoRA-only2026.074.164
ArrowBackbone=Qwen3 4B, Category=Joint Backbone-LoRA2026.074.08
J-WAllZBackbone=Llama 3.1-8B, Category=Joint Backbone-LoRA2026.073.944
SPECTRBackbone=Llama 3.1-8B, Category=Joint Backbone-LoRA2026.073.862
L-HidL2-LastMedBackbone=Llama 3.1-8B, Category=LoRA-only2026.073.836
B-CtrL2Backbone=Llama 3.1-8B, Category=Backbone-only2026.073.727
J-GlobalBackbone=Llama 3.1-8B, Category=Joint Backbone-LoRA2026.073.7
B-LogitVarBackbone=Llama 3.1-8B, Category=Backbone-only2026.073.696
B-S4aBackbone=Llama 3.1-8B, Category=Backbone-only2026.073.691
B-CtrL2Backbone=Qwen3 4B, Category=Backbone-only2026.073.604
J-MLPGlobalBackbone=Llama 3.1-8B, Category=Joint Backbone-LoRA2026.073.602
J-GlobalBackbone=Qwen3 8B, Category=Joint Backbone-LoRA2026.073.596
L-AlphaZBackbone=Qwen3 4B, Category=LoRA-only2026.073.564
L-AlphaZBackbone=Qwen3 8B, Category=LoRA-only2026.073.507
L-HidL2-L4ZBackbone=Qwen3 4B, Category=LoRA-only2026.073.496
B-S4aBackbone=Qwen3 4B, Category=Backbone-only2026.073.469
J-WAllZBackbone=Qwen3 8B, Category=Joint Backbone-LoRA2026.073.464
B-S4aBackbone=Qwen3 8B, Category=Backbone-only2026.073.436
L-HidL2-L4ZBackbone=Qwen3 8B, Category=LoRA-only2026.073.413
L-HidL2-LastMedBackbone=Qwen3 8B, Category=LoRA-only2026.073.411
SPECTRBackbone=Qwen3 8B, Category=Joint Backbone-LoRA2026.073.362
B-LogitVarBackbone=Qwen3 8B, Category=Backbone-only2026.073.331
B-CtrL2Backbone=Qwen3 8B, Category=Backbone-only2026.073.304
SPECTRBackbone=Qwen3 4B, Category=Joint Backbone-LoRA2026.073.3
B-LogitVarBackbone=Qwen3 4B, Category=Backbone-only2026.073.26
J-MLPGlobalBackbone=Qwen3 8B, Category=Joint Backbone-LoRA2026.073.244
L-HidL2-LastMedBackbone=Qwen3 4B, Category=LoRA-only2026.073.231
J-GlobalBackbone=Qwen3 4B, Category=Joint Backbone-LoRA2026.073.231
J-MLPGlobalBackbone=Qwen3 4B, Category=Joint Backbone-LoRA2026.073.189
J-WAllZBackbone=Qwen3 4B, Category=Joint Backbone-LoRA2026.073.096