Instruction Following on Math-IF
61.97IF-RT ScoreStaged Decoding
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Staged DecodingFamily=Qwen 3, Size (B)=82026.02 | 61.97 | 76.41 | 69.19 | |
| IF-RT chkpt.Family=Qwen 3, Size (B)=82026.02 | 61.82 | 37 | 49.41 | |
| IF-RT chkpt.Family=Qwen 3, Size (B)=142026.02 | 53.11 | 25.85 | 39.48 | |
| Staged DecodingFamily=Qwen 3, Size (B)=142026.02 | 53.11 | 82.61 | 67.86 | |
| IF-RT chkpt.Family=Qwen 3, Size (B)=42026.02 | 51.61 | 26.1 | 38.86 | |
| Staged DecodingFamily=Qwen 3, Size (B)=42026.02 | 51.61 | 72.46 | 62.04 | |
| Staged DecodingFamily=Phi 4, Size (B)=142026.02 | 45.86 | 66.21 | 56.04 | |
| IF-RT chkpt.Family=Phi 4, Size (B)=142026.02 | 45.71 | 32.73 | 39.22 | |
| IF-RT chkpt.Family=Phi 4, Size (B)=3.82026.02 | 45.38 | 27.38 | 36.38 | |
| Staged DecodingFamily=Phi 4, Size (B)=3.82026.02 | 45.38 | 45.73 | 45.56 | |
| IF-RT chkpt.Family=Qwen 3, Size (B)=1.72026.02 | 41.44 | 21.69 | 31.56 | |
| Staged DecodingFamily=Qwen 3, Size (B)=1.72026.02 | 41.37 | 51.26 | 46.31 | |
| BaselineFamily=Qwen 3, Size (B)=82026.02 | 36.7 | 59.89 | 48.29 | |
| Avg. IF chkpt.Family=Qwen 3, Size (B)=142026.02 | 36.4 | 71.71 | 54.05 | |
| BaselineFamily=Qwen 3, Size (B)=142026.02 | 36.17 | 73.04 | 54.61 | |
| Avg. IF chkpt.Family=Phi 4, Size (B)=142026.02 | 35.12 | 79.77 | 57.44 | |
| IF-FA chkpt.Family=Phi 4, Size (B)=142026.02 | 34.86 | 77.48 | 56.17 | |
| IF-FA chkpt.Family=Qwen 3, Size (B)=82026.02 | 34.74 | 61.22 | 47.98 | |
| Avg. IF chkpt.*Family=Qwen 3, Size (B)=82026.02 | 34.74 | 61.22 | 47.98 | |
| BaselineFamily=Phi 4, Size (B)=142026.02 | 34.54 | 79.14 | 56.84 | |
| IF-FA chkpt.Family=Qwen 3, Size (B)=142026.02 | 34.46 | 72.82 | 53.64 | |
| BaselineFamily=Qwen 3, Size (B)=1.72026.02 | 34.21 | 45.28 | 39.75 | |
| IF-FA chkpt.Family=Qwen 3, Size (B)=1.72026.02 | 33.73 | 39.73 | 36.73 | |
| Avg. IF chkpt.*Family=Qwen 3, Size (B)=1.72026.02 | 33.73 | 39.73 | 36.73 | |
| BaselineFamily=Qwen 3, Size (B)=42026.02 | 33.41 | 63.63 | 48.52 | |
| BaselineFamily=Phi 4, Size (B)=3.82026.02 | 30.25 | 38.81 | 34.53 | |
| IF-FA chkpt.Family=Qwen 3, Size (B)=42026.02 | 28.87 | 62.98 | 45.92 | |
| Avg. IF chkpt.*Family=Qwen 3, Size (B)=42026.02 | 28.87 | 62.98 | 45.92 | |
| IF-FA chkpt.Family=Phi 4, Size (B)=3.82026.02 | 28.11 | 36.65 | 32.38 | |
| Avg. IF chkpt.*Family=Phi 4, Size (B)=3.82026.02 | 28.11 | 36.65 | 32.38 |