Knowledge recall on ARC-c (test)
83.73Accuracy (ARC-c test)ReMix
Evaluation results
| Method | Links | |
|---|---|---|
| ReMixType=Mixture, Params=0.016B2026.03 | 83.73 | |
| DoRAType=Weight Modulation, Params=0.169B2026.03 | 83.39 | |
| LoRAType=Weight Modulation, Params=0.084B2026.03 | 83.05 | |
| rsLoRAType=Weight Modulation, Params=0.021B2026.03 | 82.71 | |
| HydraLoRAType=Mixture, Params=0.082B2026.03 | 82.71 | |
| MixLoRAType=Mixture, Params=0.119B2026.03 | 82.37 | |
| Few-ShotType=No Tuning, Params=N/A2026.03 | 81.36 | |
| P-TuningType=Prefix Injection, Params=0.001B2026.03 | 43.05 | |
| Prefix TuningType=Prefix Injection, Params=0.004B2026.03 | 28.47 | |
| Prompt TuningType=Prefix Injection, Params=0.000B2026.03 | 23.73 | |
| VB-LoRAType=Mixture, Params=0.674B2026.03 | 23.73 | |
| (IA)3Type=Weight Modulation, Params=0.001B2026.03 | 23.39 | |
| Zero-ShotType=No Tuning, Params=N/A2026.03 | 22.03 |