Reading Comprehension Accuracy on RACE (test)
59.9AccuracyInstruction-Queryable LoRA
Evaluation Results
| Method | Links | |
|---|---|---|
| Instruction-Queryable LoRABackbone=Qwen0.5B, Type=Test Accuracy2026.05 | 59.9 | |
| LoRABackbone=Qwen0.5B, Type=Test Accuracy2026.05 | 59.5 | |
| RepLoRABackbone=Qwen0.5B, Type=Test Accuracy2026.05 | 58.5 | |
| Queryable LoRABackbone=Qwen0.5B, Type=Test Accuracy2026.05 | 58.5 | |
| DoRABackbone=Qwen0.5B, Type=Test Accuracy2026.05 | 50.2 | |
| PGM 8 / 8distillation=After Distillation (SDTT)2025.05 | 30.62 | |
| MDLMdistillation=Before2025.05 | 28.04 | |
| MDLMdistillation=After Distillation (SDTT)2025.05 | 27.94 | |
| PGM 6 / 6 (1024)distillation=Before2025.05 | 27.37 | |
| PGM 6 / 6 (1024)distillation=After Distillation (SDTT)2025.05 | 27.37 | |
| PGM 8 / 8distillation=Before2025.05 | 26.89 |