Downstream Task on ARC Challenge
35.67AccuracyTinyLlama-1.1B
Evaluation results
| Method | Links | |
|---|---|---|
| TinyLlama-1.1BFFN Size=100%, Shots=252025.06 | 35.67 | |
| DIVE 1/8FFN Size=50% × 1, Shots=252025.06 | 24.91 | |
| FLAPFFN Size=50%, Shots=252025.06 | 24.49 | |
| LLM-PrunerFFN Size=50%, Shots=252025.06 | 22.87 | |
| LLaMA-MoE 1/8FFN Size=50% × 1, Shots=252025.06 | 22.7 | |
| DIVE 2/8FFN Size=25% × 2, Shots=252025.06 | 22.7 | |
| LLaMA-MoE 2/8FFN Size=25% × 2, Shots=252025.06 | 21.84 |