Downstream Task Performance on Multilingual Downstream Tasks (test)
62.16ENReSheared
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| ReShearedBase Model=Qwen2-1.5B, Prune=false, PT=true2024.11 | 62.16 | 58.95 | 54.93 | 55.6 | 43.91 | 37.27 | 54.05 | 39.96 | 50.85 | |
| DRPruningBase Model=Qwen2-1.5B, Prune=true, PT=true2024.11 | 61.67 | 59.09 | 54.01 | 54.95 | 45.14 | 46.91 | 52.65 | 44.42 | 52.35 | |
| Qwen2-1.5BBase Model=Qwen2-1.5B, Prune=false, PT=false2024.11 | 61.58 | 57.83 | 55.72 | 55.3 | 43.31 | 35.98 | 49.25 | 36.02 | 49.37 | |
| Qwen1.5-1.8BBase Model=Qwen1.5-1.8B, Prune=false, PT=false2024.11 | 60.89 | 52.3 | 56.13 | 53.3 | 42.17 | 34.98 | 48.25 | 36.75 | 48.1 | |
| DRPruningBase Model=Qwen2-7B, Prune=true, PT=true2024.11 | 60.43 | 56.8 | 55.72 | 55.05 | 45.69 | 43.82 | 53.95 | 43.53 | 51.87 | |
| XGLM-1.7BBase Model=XGLM-1.7B, Prune=false, PT=false2024.11 | 55.06 | 52.97 | 51.02 | 51 | 42.89 | 37.99 | 49 | 38.63 | 47.32 |