General Language Understanding and Reasoning on Academic Benchmarks (test)
59.9Average ScoreCamelidae-8x34B-pro
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Camelidae-8x34B-pro#Params=38B2024.01 | 59.9 | 46 | 51.7 | 79.2 | 46.9 | 75.7 | |
| Camelidae-8x34B#Params=38B2024.01 | 59.3 | 42.7 | 50.5 | 79.7 | 47.8 | 75.6 | |
| SUSChat-34B#Params=34B2024.01 | 53.3 | 25.9 | 47.2 | 78.8 | 38.3 | 76.4 | |
| Yi-34B-Chat#Params=34B2024.01 | 51.8 | 30.4 | 42.5 | 73.3 | 38 | 74.8 | |
| Camelidae-8x13B#Params=15B2024.01 | 46.5 | 30.5 | 30.7 | 73.8 | 43.1 | 54.4 | |
| Llama2-13B-Chat#Params=13B2024.01 | 41.8 | 23.1 | 21.2 | 70.9 | 40 | 53.8 | |
| Camelidae-8x7B#Params=8B2024.01 | 39.9 | 20.9 | 24.9 | 70.7 | 34.4 | 48.3 | |
| Vicuna-13B#Params=13B2024.01 | 39.9 | 10.7 | 21 | 70.8 | 41.1 | 55.8 | |
| Llama2-7B-Chat#Params=7B2024.01 | 35.4 | 14.9 | 15.1 | 66.7 | 33 | 47.3 | |
| Vicuna-7B#Params=7B2024.01 | 34 | 9.6 | 13.5 | 67.6 | 29.2 | 50.1 |