Multimodal Reasoning on MMBench (Accuracy, Acceptance Rate, and Speedup)
92.65Accuracy (%)DREAM-R
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DREAM-RTarget=Q32B, Draft=Q2B2026.05 | 92.65 | 63.52 | 1.86 | |
| DREAM-RTarget=Q32B, Draft=M7B-RL2026.05 | 90.4 | 63.8 | 1.62 | |
| DREAM-RTarget=Q32B, Draft=Q4B2026.05 | 89.44 | 53.28 | 2.48 | |
| DREAM-RTarget=Q235B, Draft=Q2B2026.05 | 88.45 | 71.45 | 2.31 | |
| DREAM-R-NSTarget=Q32B, Draft=M7B-RL2026.05 | 88.1 | 60.2 | 1.48 | |
| Standard SDTarget=Q32B, Draft=M7B-RL2026.05 | 86.9 | — | 1.05 | |
| LRTarget=Q32B, Draft=M7B-RL2026.05 | 84.3 | 35.6 | 1.32 | |
| Standard SDTarget=Q32B, Draft=Q4B2026.05 | 83.9 | — | 1.11 | |
| DREAM-RTarget=Q32B, Draft=R4B2026.05 | 83.6 | 57.1 | 2.31 | |
| Standard SDTarget=Q235B, Draft=Q2B2026.05 | 83.2 | — | 1.06 | |
| Standard SDTarget=Q235B, Draft=M7B-RL2026.05 | 82.7 | — | 1.04 | |
| DREAM-RTarget=Q235B, Draft=M7B-RL2026.05 | 82.3 | 47 | 1.78 | |
| DREAM-RTarget=Q235B, Draft=Q4B2026.05 | 82.2 | 37.96 | 1.73 | |
| Standard SDTarget=Q32B, Draft=R4B2026.05 | 82.1 | — | 1.09 | |
| DREAM-RTarget=Q235B, Draft=R4B2026.05 | 81.95 | 36.9 | 1.71 | |
| DREAM-R-NSTarget=Q235B, Draft=Q2B2026.05 | 81.73 | 66.8 | 2.28 | |
| DREAM-R-NSTarget=Q235B, Draft=Q4B2026.05 | 81.32 | 39.01 | 1.65 | |
| Standard SDTarget=Q235B, Draft=Q4B2026.05 | 81.31 | — | 1.09 | |
| Standard SDTarget=Q235B, Draft=R4B2026.05 | 80.95 | — | 1.08 | |
| LRTarget=Q235B, Draft=Q2B2026.05 | 80.5 | 66.42 | 1.93 | |
| DREAM-R-NSTarget=Q32B, Draft=Q2B2026.05 | 80.32 | 69.99 | 1.77 | |
| DREAM-R-NSTarget=Q32B, Draft=R4B2026.05 | 80.15 | 52.6 | 2.18 | |
| DREAM-R-NSTarget=Q235B, Draft=R4B2026.05 | 79.85 | 37.9 | 1.62 | |
| DREAM-R-NSTarget=Q235B, Draft=M7B-RL2026.05 | 79.6 | 35.45 | 1.62 | |
| DREAM-R-NSTarget=Q32B, Draft=Q4B2026.05 | 79.42 | 49.15 | 2.37 | |
| Standard SDTarget=Q32B, Draft=Q2B2026.05 | 79.11 | — | 1.15 | |
| LRTarget=Q235B, Draft=Q4B2026.05 | 79.1 | 37.34 | 1.45 | |
| LRTarget=Q235B, Draft=R4B2026.05 | 78.25 | 35.8 | 1.43 | |
| LRTarget=Q32B, Draft=R4B2026.05 | 77.35 | 47.8 | 1.78 | |
| LRTarget=Q32B, Draft=Q4B2026.05 | 76.41 | 48.92 | 1.58 | |
| LRTarget=Q235B, Draft=M7B-RL2026.05 | 74.7 | 35.46 | 1.46 | |
| LRTarget=Q32B, Draft=Q2B2026.05 | 74.52 | 71.75 | 1.73 | |
| SpecReasonTarget=Q32B, Draft=Q4B2026.05 | 73.58 | 32.13 | 1.28 | |
| SpecReasonTarget=Q235B, Draft=Q2B2026.05 | 73.29 | 68.47 | 1.13 | |
| SpecReasonTarget=Q32B, Draft=R4B2026.05 | 71.2 | 29.3 | 1.24 | |
| SpecReasonTarget=Q235B, Draft=Q4B2026.05 | 69.74 | 39.18 | 1.22 | |
| SpecReasonTarget=Q235B, Draft=R4B2026.05 | 67.1 | 37.5 | 1.2 | |
| SpecReasonTarget=Q32B, Draft=Q2B2026.05 | 62.49 | 24.26 | 1.43 | |
| SpecReasonTarget=Q32B, Draft=M7B-RL2026.05 | 45.2 | 15.1 | 0.8 | |
| SpecReasonTarget=Q235B, Draft=M7B-RL2026.05 | 17.1 | 14.82 | 0.71 |