List your company
ResearchFormerly WizWand

Reading Comprehension Accuracy on RACE (test)

59.9AccuracyInstruction-Queryable LoRA
25.569634.482343.39552.3077May 24, 2025Jul 21, 2025Sep 17, 2025Nov 14, 2025Jan 11, 2026Mar 10, 2026May 8, 2026
Updated 5mo ago

Evaluation results

MethodLinks
Instruction-Queryable LoRABackbone=Qwen0.5B, Type=Test Accuracy2026.0559.9
LoRABackbone=Qwen0.5B, Type=Test Accuracy2026.0559.5
RepLoRABackbone=Qwen0.5B, Type=Test Accuracy2026.0558.5
Queryable LoRABackbone=Qwen0.5B, Type=Test Accuracy2026.0558.5
DoRABackbone=Qwen0.5B, Type=Test Accuracy2026.0550.2
PGM 8 / 8distillation=After Distillation (SDTT)2025.0530.62
MDLMdistillation=Before2025.0528.04
MDLMdistillation=After Distillation (SDTT)2025.0527.94
PGM 6 / 6 (1024)distillation=Before2025.0527.37
PGM 6 / 6 (1024)distillation=After Distillation (SDTT)2025.0527.37
PGM 8 / 8distillation=Before2025.0526.89