Mathematical Reasoning on Average GSM8k-Aug, GSM-Hard, SVAMP, MultiArith
79.3AccuracySFT-CoT
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| SFT-CoTModel=Qwen3-VL-4B-Instruct2026.01 | 79.3 | 108.4 | 0.73 | — | — | |
| CoT-SFTBackbone=Qwen3-VL-4B-Instruct2026.06 | 79.3 | — | — | — | 108.4 | |
| CoT-SFTBackbone=Qwen3-4B2026.06 | 79.2 | — | — | — | 105.1 | |
| SFT-CoTModel=Qwen3-VL-2B-Instruct2026.01 | 63.8 | 117.5 | 0.54 | — | — | |
| DLR (Full)Backbone=Qwen3-VL-4B-Instruct2026.06 | 63.2 | — | — | — | 5.4 | |
| DLR (Full)Backbone=Qwen3-4B2026.06 | 62.9 | — | — | — | 5.4 | |
| DLR (SFT)Backbone=Qwen3-VL-4B-Instruct2026.06 | 57.3 | — | — | — | 5.2 | |
| DLR (SFT)Backbone=Qwen3-4B2026.06 | 56.9 | — | — | — | 5.3 | |
| RoT (Ours)Model=Qwen3-VL-4B-Instruct2026.01 | 55.4 | 32 | 1.73 | — | — | |
| RoTBackbone=Qwen3-VL-4B-Instruct2026.06 | 55.4 | — | — | — | 32 | |
| CoT2026.02 | 53.6 | 21.4 | — | — | — | |
| CoLaRCompression ratio=22026.02 | 48.8 | 10 | — | — | — | |
| LSTRCompression ratio=22026.02 | 48.4 | 11.4 | — | — | — | |
| SFT-CoTModel=LLaVa-V1.6-Mistral-7B2026.01 | 48.3 | 130.8 | 0.37 | — | — | |
| Direct-SFTBackbone=Qwen3-4B2026.06 | 48.1 | — | — | — | 0 | |
| SFT-w/o CoTModel=Qwen3-VL-4B-Instruct2026.01 | 47.8 | 0 | — | — | — | |
| Direct-SFTBackbone=Qwen3-VL-4B-Instruct2026.06 | 47.8 | — | — | — | 0 | |
| LSTRCompression ratio=2, Ablation=w/o Skip2026.02 | 47.3 | 12.9 | — | — | — | |
| CoLaRBackbone=Qwen3-4B2026.06 | 47.3 | — | — | — | 31.8 | |
| ReGuLaRBackbone=LLaMA-3.2-1B-Instruct2026.01 | 45.6 | 3.03 | — | — | — | |
| CoLaRBackbone=Qwen3-VL-4B-Instruct2026.06 | 45.1 | — | — | — | 31.8 | |
| LSTRCompression ratio=2, Ablation=w/o Sparse2026.02 | 43.9 | 12.7 | — | — | — | |
| LSTRCompression ratio=52026.02 | 43.3 | 4.66 | — | — | — | |
| LSTRCompression ratio=5, Ablation=w/o Skip2026.02 | 41.9 | 5 | — | — | — | |
| CoLaRCompression ratio=52026.02 | 41.7 | 4.57 | — | — | — | |
| CoLaRBackbone=LLaMA-3.2-1B-Instruct, Compression Rate=52026.01 | 41.7 | 4.7 | — | — | — | |
| RoT (Ours)Model=Qwen3-VL-2B-Instruct2026.01 | 37 | 32 | 1.16 | — | — | |
| LSTRCompression ratio=5, Ablation=w/o Sparse2026.02 | 35.6 | 4.7 | — | — | — | |
| RoT (Ours)Model=LLaVa-V1.6-Mistral-7B2026.01 | 34.3 | 32 | 1.07 | — | — | |
| CoconutBackbone=Qwen3-4B2026.06 | 31.6 | — | — | — | 6 | |
| CoconutBackbone=Qwen3-VL-4B-Instruct2026.06 | 30.5 | — | — | — | 6 | |
| SFT-w/o CoTModel=Qwen3-VL-2B-Instruct2026.01 | 28.6 | 0 | — | — | — | |
| Coconut2026.02 | 27.6 | 6 | — | — | — | |
| CoconutBackbone=LLaMA-3.2-1B-Instruct2026.01 | 26.6 | 6 | — | — | — | |
| SFT-w/o CoTModel=LLaVa-V1.6-Mistral-7B2026.01 | 26.6 | 0 | — | — | — | |
| iCoTBackbone=Qwen3-4B2026.06 | 25.9 | — | — | — | 0 | |
| iCoT2026.02 | 24.6 | 0 | — | — | — | |
| iCoTBackbone=LLaMA-3.2-1B-Instruct2026.01 | 24.6 | 0 | — | — | — | |
| Distill2026.02 | 14.3 | 6 | — | — | — | |
| CODIBackbone=LLaMA-3.2-1B-Instruct2026.01 | 14.3 | 6 | — | — | — | |
| CODIBackbone=Qwen3-4B2026.06 | 9.7 | — | — | — | 6 | |
| CODIBackbone=Qwen3-VL-4B-Instruct2026.06 | 9.4 | — | — | — | 6 | |
| CoconutRationale Format=GSM8k-Aug2026.05 | — | 6 | — | 27.59 | — | |
| CoLaR-2Rationale Format=GSM8k-Aug2026.05 | — | 10.04 | — | 48.84 | — | |
| Ours-RLRationale Format=GSM8k-Aug2026.05 | — | 11.45 | — | 54.42 | — | |
| Ours-SFTRationale Format=GSM8k-Aug2026.05 | — | 11.98 | — | 51.27 | — | |
| SFT-CoTRationale Format=GSM8k-Aug2026.05 | — | 21.35 | — | 56.98 | — |