Comprehensive Examination on GAOKAO (test)
76.3AccuracyQwen-14B-Chat
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen-14B-ChatParameter size group=13~20B Models, Evaluation protocol=0-shot2024.03 | 76.3 | |
| Qwen-14BShots=0-shot, Model Size Group=13 ~ 20B Models2024.03 | 62.5 | |
| Qwen-7B-ChatParameter size group=< 7B Models, Evaluation protocol=0-shot2024.03 | 62.1 | |
| ChatGLM3-6B-BaseShots=0-shot, Model Size Group=<= 7B Models2024.03 | 59.4 | |
| InternLM2-Chat-20B-SFTParameter size group=13~20B Models, Evaluation protocol=0-shot, Alignment=SFT2024.03 | 58.6 | |
| InternLM2-7BShots=0-shot, Model Size Group=<= 7B Models2024.03 | 58.6 | |
| InternLM2-Chat-20BParameter size group=13~20B Models, Evaluation protocol=0-shot2024.03 | 58.3 | |
| InternLM2-Chat-7BParameter size group=< 7B Models, Evaluation protocol=0-shot2024.03 | 58 | |
| InternLM2-Chat-7B-SFTParameter size group=< 7B Models, Evaluation protocol=0-shot, Alignment=SFT2024.03 | 57.3 | |
| InternLM2-20BShots=0-shot, Model Size Group=13 ~ 20B Models2024.03 | 57.1 | |
| ChatGLM3-6BParameter size group=< 7B Models, Evaluation protocol=0-shot2024.03 | 56.3 | |
| Qwen-7BShots=0-shot, Model Size Group=<= 7B Models2024.03 | 52.8 | |
| GPT-3.5Model type=API Models, Evaluation protocol=0-shot2024.03 | 51.1 | |
| Baichuan2-13B-ChatParameter size group=13~20B Models, Evaluation protocol=0-shot2024.03 | 45.8 | |
| Baichuan2-13B-BaseShots=0-shot, Model Size Group=13 ~ 20B Models2024.03 | 45.6 | |
| Mixtral-8x7B-Instruct-v0.1Parameter size group=13~20B Models, Evaluation protocol=0-shot, Alignment=Instruct2024.03 | 42.6 | |
| InternLM2-7B-BaseShots=0-shot, Model Size Group=<= 7B Models2024.03 | 40.7 | |
| InternLM2-20B-BaseShots=0-shot, Model Size Group=13 ~ 20B Models2024.03 | 40.7 | |
| Baichuan2-7B-ChatParameter size group=< 7B Models, Evaluation protocol=0-shot2024.03 | 37.5 | |
| Baichuan2-7B-BaseShots=0-shot, Model Size Group=<= 7B Models2024.03 | 34.7 | |
| Mixtral-8x7B-v0.1Shots=0-shot, Model Size Group=13 ~ 20B Models2024.03 | 32.3 | |
| Mistral-7B-v0.1Shots=0-shot, Model Size Group=<= 7B Models2024.03 | 28.7 | |
| Mistral-7B-Instruct-v0.2Parameter size group=< 7B Models, Evaluation protocol=0-shot, Alignment=Instruct2024.03 | 28.6 | |
| Llama2-13B-ChatParameter size group=13~20B Models, Evaluation protocol=0-shot2024.03 | 23.2 | |
| Llama2-7B-ChatParameter size group=< 7B Models, Evaluation protocol=0-shot2024.03 | 19.8 | |
| Llama2-7BShots=0-shot, Model Size Group=<= 7B Models2024.03 | 19 | |
| Llama2-13BShots=0-shot, Model Size Group=13 ~ 20B Models2024.03 | 18.4 |