General Intelligence Evaluation (3-shot) on AGIEval (test)
27AGIEval (3-shot)Full FT
Evaluation results
| Method | Links | |
|---|---|---|
| Full FTBit=16.00, #Trained=100%2025.03 | 27 | |
| ClusCompBit=4.15, #Trained=0.9%2025.03 | 26.5 | |
| LISABit=16.00, #Trained=100.0%2025.03 | 26.1 | |
| Llama-2-7BBit=16.002025.03 | 25.7 | |
| ClusCompBit=2.88, #Trained=1.4%2025.03 | 25.6 | |
| LoRA (r=128)Bit=16.00, #Trained=4.9%2025.03 | 24.7 | |
| GaLoreBit=16.00, #Trained=100.0%2025.03 | 24.4 | |
| ClusCompBit=2.00, #Trained=1.8%2025.03 | 21.8 |