Reading Comprehension on SQuAD v2 (Accuracy)
32.6AccuracyLLaMA3B
Evaluation Results
| Method | Links | |
|---|---|---|
| LLaMA3BModel=LLaMA-3.2, Router=None2025.10 | 32.6 | |
| Dr.LLMModel=LLaMA-3.2, Router=Enabled2025.10 | 30.6 | |
| LLaMA8BModel=LLaMA-3.1, Router=None2025.10 | 29.1 | |
| Dr.LLMModel=LLaMA-3.1, Router=Enabled2025.10 | 28.6 | |
| FoLoRAFine-tuning dataset=MetaMathQA, Calibration data=NQ Open, Calibration model size=1.7B2026.05 | 27.98 | |
| FoLoRAFine-tuning dataset=MetaMathQA, Calibration data=NQ Open2026.05 | 27.56 | |
| Qwen3-1.7BType=Base Model2026.05 | 27.19 | |
| FoLoRAFine-tuning dataset=MetaMathQA, Calibration data=NQ Open, Calibration model size=4B2026.05 | 27.07 | |
| LoRA-NullFine-tuning dataset=MetaMathQA, Calibration data=model-generated pretraining-proxy, Calibration model size=4B2026.05 | 25.84 | |
| LoRAFine-tuning dataset=MetaMathQA2026.05 | 25.79 | |
| FoLoRAFine-tuning dataset=MetaMathQA, Calibration data=NQ Open, Calibration model size=0.6B2026.05 | 25.53 | |
| OPLoRAFine-tuning dataset=MetaMathQA2026.05 | 25.52 | |
| CorDAFine-tuning dataset=MetaMathQA, Calibration data=model-generated pretraining-proxy2026.05 | 23.93 | |
| CorDAFine-tuning dataset=MetaMathQA, Calibration data=model-generated pretraining-proxy, Calibration model size=4B2026.05 | 23.76 | |
| LoRA-NullFine-tuning dataset=MetaMathQA, Calibration data=model-generated pretraining-proxy2026.05 | 23.53 | |
| MiLoRAFine-tuning dataset=MetaMathQA2026.05 | 23.07 | |
| Qwen3BModel=Qwen2.5, Router=None2025.10 | 21.5 | |
| Qwen7BModel=Qwen2.5, Router=None2025.10 | 20.8 | |
| Dr.LLMModel=Qwen2.5, Router=Enabled2025.10 | 20.2 | |
| Dr.LLMModel=Qwen2.5, Router=Enabled2025.10 | 20.1 |