IFEval
Benchmarks
TaskDatasetSOTA resultTrendResults
IFEval
35.12Strict Accuracy
5
IFEval strict-prompt
83.73Score
5
IFEval (test)
56.19Pass@4
4
IFEval Hard
2.2Length Ratio
4
IFEval Hard
84.5Worst@20 Score
4
IFEval strict instance
74.12Accuracy
4
IFEVAL
0.29Drift (pp)
3
IFEval
28.1Strict Score
3
IFEval
56.93Strict Accuracy (Prompt-level)
3
IFEval
88.7CSR (Correctness Score Rate)
3
IFEval (random subset of 50 prompts)
85.9Task Fidelity
3
IFEval (dev)
92Accuracy
3
IFEval
17.93Instruction Following (Loose)
2
IFEval PLS
84.7Score
2
IFEval Hard 10-sample subset
1.43Readability (Human)
2
System IFEval
96IFEval Score
2
IFEval (541)
85.9Accuracy
2
IFEval 1.0 (full)
446Pass@1
2
IFEval TH
80.47Overall Score
2