Language Model Evaluation on 1.3B LLM Leaderboard
36.4ARCQA+C4-85B
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| QA+C4-85BTraining Steps=300K, Seed=12342024.01 | 36.4 | 60.9 | 25.5 | 40.6 | 59.4 | 40 | 37.2 | |
| QA+C4-100BTraining Steps=350K, Seed=12342024.01 | 35.5 | 60.5 | 26.8 | 40.6 | 61.3 | 30 | 37.5 | |
| Falcon-RWSeed=12342024.01 | 35.1 | 63.6 | 25.3 | 36 | 62 | 50 | 37.1 | |
| Pythia-1.4b-PileSeed=12342024.01 | 32.7 | 55 | 25.6 | 38.7 | 57.3 | 80 | 35 | |
| C4Seed=12342024.01 | 31.7 | 62.1 | 26.7 | 33.4 | 57.9 | 90 | 35.5 |