Downstream Task Evaluation on 15 Downstream Tasks Summary
2Median EGMPP-B
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| MPP-B2024.05 | 2 | 1.82 | 3 | 6 | — | |
| CNO2024.05 | 4.6 | 2.61 | 5 | 6 | — | |
| scOT2024.05 | 5.4 | 2.57 | 4 | 8 | — | |
| CNO-FM2024.05 | 10.6 | 2.91 | 8 | 10 | — | |
| POSEIDON-TModel Scale=Tiny2024.05 | 19.5 | 6.49 | 10 | 12 | — | |
| POSEIDON-BModel Scale=Base2024.05 | 24.4 | 6.71 | 11 | 12 | — | |
| POSEIDON-LModel Scale=Large2024.05 | 49.8 | 9.58 | 12 | 13 | — | |
| DRPruningFrom=7B, To=1.3B2024.11 | — | — | — | — | 35.6 | |
| DRPruningFrom=7B, To=2.7B2024.11 | — | — | — | — | 40.18 | |
| ReShearedFrom=7B, To=1.3B2024.11 | — | — | — | — | 34.85 | |
| ReShearedFrom=7B, To=2.7B2024.11 | — | — | — | — | 39.98 | |
| Sheared LlamaFrom=7B, To=1.3B2024.11 | — | — | — | — | 34.89 | |
| Sheared LlamaFrom=7B, To=2.7B2024.11 | — | — | — | — | 39.75 |