Instruction Following on AgentIF (Out-of-Domain)
66.9CSRQwen2.5-32B-Instruct-IF
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen2.5-32B-Instruct-IFBase Model=Qwen-32B2025.10 | 66.9 | |
| Qwen2.5-32B-InstructBase Model=Qwen-32B2025.10 | 64.9 | |
| R1-0528-Qwen3-8BBase Model=Qwen-8B2025.10 | 63.5 | |
| GPT-4oBase Model=GPT2025.10 | 58.5 | |
| QwQ-32BBase Model=Qwen-32B2025.10 | 58.1 | |
| R1-0528-Qwen3-8BBase Model=Qwen-8B2025.10 | 57.4 | |
| Distill-Qwen-14B-IFBase Model=Qwen-14B2025.10 | 57 | |
| Qwen2.5-7B-Instruct-IFBase Model=Qwen-7B2025.10 | 56.7 | |
| VERIF-8BBase Model=LLaMA-8B2025.10 | 56.6 | |
| Llama-3.1-8B-Instruct-IFBase Model=LLaMA-8B2025.10 | 55.1 | |
| Distill-Qwen-14BBase Model=Qwen-14B2025.10 | 54.5 | |
| Qwen2.5-7B-InstructBase Model=Qwen-7B2025.10 | 54.2 | |
| SPAR-8B-DPOBase Model=LLaMA-8B2025.10 | 53.6 | |
| Llama-3.1-8B-InstructBase Model=LLaMA-8B2025.10 | 53.4 | |
| Qwen2.5-1.5B-Instruct-IFBase Model=Qwen-1.5B2025.10 | 48.2 | |
| Crab-7B-DPOBase Model=Mistral-7B2025.10 | 47.2 | |
| Distill-Qwen-7BBase Model=Qwen-7B2025.10 | 47.2 | |
| Distill-Qwen-7B-IFBase Model=Qwen-7B2025.10 | 46.9 | |
| Conifer-7B-DPOBase Model=Mistral-7B2025.10 | 44.3 | |
| Qwen2.5-1.5B-InstructBase Model=Qwen-1.5B2025.10 | 42.8 | |
| Distill-Qwen-1.5B-IFBase Model=Qwen-1.5B2025.10 | 39.7 | |
| IR-1.5BBase Model=Qwen-1.5B2025.10 | 38.7 | |
| Distill-Qwen-1.5BBase Model=Qwen-1.5B2025.10 | 37.5 |