Instruction Hierarchy Reasoning on MANYIH-BENCH coding
60.9AccuracyGPT 5.4
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GPT 5.4Privilege Prompt Interface=ordinal2026.04 | 60.9 | 89.7 | 67.9 | |
| Gemini 3.1 ProPrivilege Prompt Interface=ordinal2026.04 | 59 | 91.3 | 65.1 | |
| Grok 4.20Privilege Prompt Interface=ordinal2026.04 | 54.1 | 86.2 | 63 | |
| Opus 4.6Privilege Prompt Interface=ordinal2026.04 | 51.3 | 92.5 | 56.7 | |
| Kimi K2.5Privilege Prompt Interface=ordinal2026.04 | 42.4 | 87.4 | 49.4 | |
| Qwen3.5-397BPrivilege Prompt Interface=ordinal2026.04 | 41 | 87.4 | 48.2 | |
| Sonnet 4.6Privilege Prompt Interface=ordinal2026.04 | 39.1 | 91.6 | 42.4 | |
| Qwen3.5-122BPrivilege Prompt Interface=ordinal2026.04 | 19.7 | 65.3 | 31.6 | |
| Qwen3.5-9BPrivilege Prompt Interface=ordinal2026.04 | 8.4 | 71.7 | 13.3 | |
| Qwen3.5-4BPrivilege Prompt Interface=ordinal2026.04 | 3.5 | 61.8 | 7.7 |