Multilingual ARC Challenge Accuracy on test set
58.2ARC Accuracy (French)Mixtral 8x7B
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Mixtral 8x7BActive Params=13B2024.01 | 58.2 | 54.3 | 55.4 | 52.8 | |
| LLAMA 2 70BActive Params=70B2024.01 | 49.9 | 47.3 | 50.5 | 49.4 | |
| LLAMA 1 33BActive Params=33B2024.01 | 39.3 | 41.1 | 45.7 | 42.9 |