Science Question Answering on ScienceQA text-only
96.2AccuracyFull FT
Evaluation results
| Method | Links | |
|---|---|---|
| Full FTParams (%)=100, Base Model=Llama-3-8B2026.03 | 96.2 | |
| NeuroLoRAParams (%)=0.14, Base Model=Llama-3-8B2026.03 | 95.5 | |
| DoRAParams (%)=0.84, Base Model=Llama-3-8B2026.03 | 94.3 | |
| FlyLoRAParams (%)=0.13, Base Model=Llama-3-8B2026.03 | 94.1 | |
| LoRAParams (%)=0.83, Base Model=Llama-3-8B2026.03 | 94 | |
| AdaLoRAParams (%)=0.81, Base Model=Llama-3-8B2026.03 | 93.6 | |
| MoLEParams (%)=0.35, Base Model=Llama-3-8B2026.03 | 93.1 |