Open-ended Generation on AlpacaEval
93.5Win Rate vs Davinci-003GPT-4
Evaluation Results
| Method | Links | |
|---|---|---|
| GPT-42023.06 | 93.5 | |
| ChatGPT2023.06 | 83.6 | |
| RED# Param=0.26M2024.02 | 81.69 | |
| LoRA# Param=8.39M2024.02 | 81.48 | |
| FT# Param=6739M2024.02 | 80.93 | |
| ShareGPT 65B2023.06 | 73.6 | |
| TÜLU-1.1 13B2023.06 | 64 | |
| TÜLU 30B2023.06 | 62.3 | |
| TÜLU 65B2023.06 | 61.8 | |
| TÜLU-1.1 7B2023.06 | 57.3 | |
| TÜLU 13B2023.06 | 56.5 | |
| TÜLU 7B2023.06 | 48.6 | |
| Human mix. 65B2023.06 | 43.4 | |
| DPOBackbone=Qwen3-8B2026.03 | 24.6 | |
| Prompt EngBackbone=Gemma-2-9B2026.03 | 22.51 | |
| InternLM2-Chat-20BCategory=~20B Models, Parameter Size=20B, Strategy=RLHF2024.03 | 21.8 | |
| Base ModelBackbone=Gemma-2-9B2026.03 | 21.12 | |
| DSPABackbone=Gemma-2-9B2026.03 | 20 | |
| DSPABackbone=Gemma-2-2B2026.03 | 19.3 | |
| RepEBackbone=Gemma-2-9B2026.03 | 18.88 | |
| DSPABackbone=Qwen3-8B2026.03 | 17.83 | |
| Base ModelBackbone=Gemma-2-2B2026.03 | 17.54 | |
| DPOBackbone=Gemma-2-9B2026.03 | 17.39 | |
| RepEBackbone=Gemma-2-2B2026.03 | 16.94 | |
| DPOBackbone=Gemma-2-2B2026.03 | 15.82 | |
| Prompt EngBackbone=Gemma-2-2B2026.03 | 15.28 | |
| Mistral-7B-Instruct-v0.2Category=~7B Models, Parameter Size=7B2024.03 | 14.7 | |
| Static-SAEBackbone=Gemma-2-9B2026.03 | 13.56 | |
| Base ModelBackbone=Qwen3-8B2026.03 | 13.47 | |
| RepEBackbone=Qwen3-8B2026.03 | 12.95 | |
| Prompt EngBackbone=Qwen3-8B2026.03 | 11.74 | |
| InternLM2-Chat-7BCategory=~7B Models, Parameter Size=7B, Strategy=RLHF2024.03 | 11.3 | |
| GPT-3.5Category=API Models2024.03 | 9.6 | |
| Static-SAEBackbone=Gemma-2-2B2026.03 | 9.33 | |
| Static-SAEBackbone=Qwen3-8B2026.03 | 8.58 | |
| InternLM2-Chat-20B-SFTCategory=~20B Models, Parameter Size=20B, Strategy=SFT2024.03 | 8 | |
| Llama2-13B-ChatCategory=~20B Models, Parameter Size=13B2024.03 | 7.7 | |
| Qwen-14B-ChatCategory=~20B Models, Parameter Size=14B2024.03 | 7.5 | |
| InternLM2-Chat-7B-SFTCategory=~7B Models, Parameter Size=7B, Strategy=SFT2024.03 | 6.9 | |
| Llama2-7B-ChatCategory=~7B Models, Parameter Size=7B2024.03 | 5 |