Question Answering on ARC Challenge (Accuracy and Average Accuracy)
27.22AccuracyFLAP
Evaluation results
| Method | Links | ||
|---|---|---|---|
| FLAPModel=LLaMA-2-13B, Parameter Retention=40%2026.04 | 27.22 | 43.44 | |
| FLAPModel=LLaMA-7B, Parameter Retention=40%2026.04 | 26.88 | 38.25 | |
| GRASPruneModel=LLaMA-2-13B, Parameter Retention=40%2026.04 | 26.79 | 44.12 | |
| LLM-PrunerModel=LLaMA-7B, Parameter Retention=40%2026.04 | 26.45 | 37.58 | |
| GRASPruneModel=Vicuna-7B, Parameter Retention=40%2026.04 | 26.28 | 41.61 | |
| LLM-PrunerModel=Vicuna-7B, Parameter Retention=40%2026.04 | 26.19 | 38.29 | |
| FLAPModel=Vicuna-7B, Parameter Retention=40%2026.04 | 25.51 | 38.99 | |
| LLM-PrunerModel=LLaMA-2-7B, Parameter Retention=40%2026.04 | 25.43 | 36.54 | |
| FLAPModel=LLaMA-2-7B, Parameter Retention=40%2026.04 | 25 | 39.64 | |
| LLM-PrunerModel=LLaMA-2-13B, Parameter Retention=40%2026.04 | 24.66 | 38.81 | |
| GRASPruneModel=LLaMA-7B, Parameter Retention=40%2026.04 | 24.57 | 40.74 | |
| SliceGPTModel=LLaMA-7B, Parameter Retention=40%2026.04 | 24.23 | 35.28 | |
| SliceGPTModel=LLaMA-2-7B, Parameter Retention=40%2026.04 | 24.15 | 36.52 | |
| GRASPruneModel=LLaMA-2-7B, Parameter Retention=40%2026.04 | 23.89 | 40.6 | |
| SliceGPTModel=Vicuna-7B, Parameter Retention=40%2026.04 | 23.29 | 36.88 | |
| SliceGPTModel=LLaMA-2-13B, Parameter Retention=40%2026.04 | 23.04 | 37.25 |