List your company
ResearchFormerly WizWand

Question Answering on TriviaQA (1,000-example evaluation slice)

25.6Alias-Substring AccuracyBase Qwen
15.92818.43920.9523.461May 4, 2026
Updated 6mo ago

Evaluation results

MethodLinks
Base QwenBackbone=Qwen-2.5-0.5B-Instruct2026.0525.6
Additive sparseBackbone=Qwen-2.5-0.5B-Instruct, Selection rule=TF-IDF2026.0525.5
Additive sparseBackbone=Qwen-2.5-0.5B-Instruct, Selection rule=KL2026.0525.2
Additive sparse +SBackbone=Qwen-2.5-0.5B-Instruct, Selection rule=TF-IDF2026.0524.5
Additive sparse +SBackbone=Qwen-2.5-0.5B-Instruct, Selection rule=KL2026.0522.3
Replacement sparseBackbone=Qwen-2.5-0.5B-Instruct, Selection rule=TF-IDF2026.0520.7
LoRABackbone=Qwen-2.5-0.5B-Instruct2026.0519.3
Replacement sparseBackbone=Qwen-2.5-0.5B-Instruct, Selection rule=KL2026.0517.9
Full finetuneBackbone=Qwen-2.5-0.5B-Instruct2026.0516.3