Compositional Reasoning on D4 V2 (test)
89.9Stability (%)Qwen2.5-7B-Inst
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Qwen2.5-7B-InstPost-training recipe=RLHF, Inference temperature=greedy (T=0), Response structure=XML-structured, Consistency matcher=Press et al.2026.05 | 89.9 | 12 | 69.8 | 78.9 | 81.1 | |
| DeepHermes-3Post-training recipe=SFT distill, Inference temperature=greedy (T=0), Response structure=XML-structured, Consistency matcher=Press et al.2026.05 | 88 | 47.4 | 61.9 | 73.1 | 100 | |
| Qwen3-8BPost-training recipe=RLVR, Inference temperature=greedy (T=0), Response structure=XML-structured, Consistency matcher=Press et al.2026.05 | 87.7 | 0 | 55.3 | 78.9 | 100 | |
| Mistral-7B-InstPost-training recipe=RLHF, Inference temperature=greedy (T=0), Response structure=XML-structured, Consistency matcher=Press et al.2026.05 | 78.8 | 25 | 55.6 | 66.7 | — |