Model Merging on LLM Evaluation Suite
0.401Normalized ScoreKARCHER
Evaluation Results
| Method | Links | |
|---|---|---|
| KARCHERModel Scale=1.7B, Number of merged models (m)=22026.03 | 0.401 | |
| LerpModel Scale=1.7B, Number of merged models (m)=22026.03 | 0.398 | |
| SlerpModel Scale=1.7B, Number of merged models (m)=22026.03 | 0.395 | |
| TiesModel Scale=1.7B, Number of merged models (m)=22026.03 | 0.391 | |
| KARCHERModel Scale=360M, Number of merged models (m)=22026.03 | 0.282 | |
| SlerpModel Scale=360M, Number of merged models (m)=22026.03 | 0.274 | |
| TiesModel Scale=360M, Number of merged models (m)=22026.03 | 0.271 | |
| LerpModel Scale=360M, Number of merged models (m)=22026.03 | 0.269 | |
| KARCHERModel Scale=135M, Number of merged models (m)=22026.03 | 0.246 | |
| LerpModel Scale=135M, Number of merged models (m)=22026.03 | 0.245 | |
| TiesModel Scale=135M, Number of merged models (m)=22026.03 | 0.24 | |
| SlerpModel Scale=135M, Number of merged models (m)=22026.03 | 0.23 |