Instruction Hierarchy Adherence on IHEval Conflict Multi-turn
51.74AccuracyVerIH
Evaluation results
| Method | Links | |
|---|---|---|
| VerIHModel=Qwen3-8B-Instruct2026.06 | 51.74 | |
| IHDec + VerIHModel=Qwen3-8B-Instruct2026.06 | 51.5 | |
| IHDecModel=Llama-3.1-8B-Instruct2026.06 | 50.68 | |
| IHDecModel=Qwen3-8B-Instruct2026.06 | 41.85 | |
| IHDec + ISEModel=Llama-3.1-8B-Instruct2026.06 | 41.15 | |
| IHDec + PromptingModel=Llama-3.1-8B-Instruct2026.06 | 39.85 | |
| IHDec + PromptingModel=Qwen3-4B-Instruct2026.06 | 39.1 | |
| IHDec + PromptingModel=Qwen3-8B-Instruct2026.06 | 38.85 | |
| IHDecModel=Qwen3-4B-Instruct2026.06 | 37.2 | |
| VanillaModel=Llama-3.1-8B-Instruct2026.06 | 31.2 | |
| PromptingModel=Qwen3-4B-Instruct2026.06 | 30.3 | |
| PromptingModel=Qwen3-8B-Instruct2026.06 | 27.5 | |
| VanillaModel=Qwen3-8B-Instruct2026.06 | 25.8 | |
| VanillaModel=Qwen3-4B-Instruct2026.06 | 23.05 | |
| PromptingModel=Llama-3.1-8B-Instruct2026.06 | 13.25 | |
| ISEModel=Llama-3.1-8B-Instruct2026.06 | 12.6 |