Question Answering on TheoremQA
15AccuracyQwen2-1.5B
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen2-1.5B# Non-Emb Params=1.2B2024.07 | 15 | |
| InternLM2-Chat-20BModel Category=~20B Models, Shot Count=0-shot2024.03 | 14.1 | |
| InternLM2-Chat-20B-SFTModel Category=~20B Models, Shot Count=0-shot2024.03 | 13.6 | |
| InternLM2-Chat-7B-SFTModel Category=~7BModels, Shot Count=0-shot2024.03 | 11.3 | |
| Mixtral-8x7B-Instruct-v0.1Model Category=~20B Models, Shot Count=0-shot2024.03 | 9.6 | |
| InternLM2-Chat-7BModel Category=~7BModels, Shot Count=0-shot2024.03 | 9.5 | |
| ChatGLM3-6BModel Category=~7BModels, Shot Count=0-shot2024.03 | 9.3 | |
| GPT-3.5Model Category=API Models, Shot Count=0-shot2024.03 | 9.1 | |
| Qwen2-0.5B# Non-Emb Params=0.3B2024.07 | 8.9 | |
| Qwen-14B-ChatModel Category=~20B Models, Shot Count=0-shot2024.03 | 8.1 | |
| Qwen-7B-ChatModel Category=~7BModels, Shot Count=0-shot2024.03 | 5.8 | |
| Baichuan2-13B-ChatModel Category=~20B Models, Shot Count=0-shot2024.03 | 3.4 | |
| Baichuan2-7B-ChatModel Category=~7BModels, Shot Count=0-shot2024.03 | 2.4 | |
| Mistral-7B-Instruct-v0.2Model Category=~7BModels, Shot Count=0-shot2024.03 | 2.3 | |
| Llama2-13B-ChatModel Category=~20B Models, Shot Count=0-shot2024.03 | 1.1 | |
| Llama2-7B-ChatModel Category=~7BModels, Shot Count=0-shot2024.03 | 0.3 |