Mathematical Reasoning on GSM8K (test) (Accuracy, Average, Improvement (%))
0.8385AccuracyT3D
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| T3DTokPS=2, SD=true, Block Size=4, Backbone=SDAR-4B-Chat2026.02 | 0.8385 | 0.5889 | 12.43 | |
| T3DTokPS=2, SD=true, Block Size=8, Backbone=SDAR-4B-Chat2026.02 | 0.8196 | 0.5889 | 12.43 | |
| Original ModelTokPS=2, Block Size=4, Backbone=SDAR-4B-Chat2026.02 | 0.7877 | 0.5238 | — | |
| SFTTokPS=2, SD=false, Block Size=8, Backbone=SDAR-4B-Chat2026.02 | 0.7741 | 0.4676 | -10.73 | |
| dParallelTokPS=2, SD=true, Block Size=4, Backbone=SDAR-4B-Chat2026.02 | 0.7657 | 0.4583 | -12.51 | |
| dParallelTokPS=2, SD=true, Block Size=8, Backbone=SDAR-4B-Chat2026.02 | 0.7597 | 0.4583 | -12.51 | |
| ReDiTokPS=2, SD=true, Block Size=4, Backbone=SDAR-4B-Chat2026.02 | 0.7362 | 0.368 | -29.74 | |
| Naive TDTokPS=2, SD=true, Block Size=4, Backbone=SDAR-4B-Chat2026.02 | 0.7278 | 0.4082 | -22.07 | |
| Original ModelTokPS=2, Block Size=8, Backbone=SDAR-4B-Chat2026.02 | 0.7233 | 0.5238 | — | |
| ReDiTokPS=2, SD=true, Block Size=8, Backbone=SDAR-4B-Chat2026.02 | 0.7187 | 0.368 | -29.74 | |
| T3DTokPS=2, SD=true, Block Size=4, Backbone=SDAR-1.7B-Chat2026.02 | 0.7096 | 0.4306 | 7.59 | |
| T3DTokPS=4, SD=true, Block Size=4, Backbone=SDAR-4B-Chat2026.02 | 0.699 | 0.3966 | 85.02 | |
| T3DTokPS=2, SD=true, Block Size=8, Backbone=SDAR-1.7B-Chat2026.02 | 0.6884 | 0.4306 | 7.59 | |
| dParallelTokPS=2, SD=true, Block Size=4, Backbone=SDAR-1.7B-Chat2026.02 | 0.6823 | 0.4014 | 0.29 | |
| Naive TDTokPS=2, SD=true, Block Size=8, Backbone=SDAR-4B-Chat2026.02 | 0.6801 | 0.4082 | -22.07 | |
| dParallelTokPS=2, SD=true, Block Size=8, Backbone=SDAR-1.7B-Chat2026.02 | 0.677 | 0.4014 | 0.29 | |
| Naive TDTokPS=2, SD=true, Block Size=4, Backbone=SDAR-1.7B-Chat2026.02 | 0.6619 | 0.3605 | -9.94 | |
| ReDiTokPS=2, SD=true, Block Size=4, Backbone=SDAR-1.7B-Chat2026.02 | 0.6399 | 0.3238 | -19.11 | |
| Naive TDTokPS=2, SD=true, Block Size=8, Backbone=SDAR-1.7B-Chat2026.02 | 0.6399 | 0.3605 | -9.94 | |
| T3DTokPS=4, SD=true, Block Size=8, Backbone=SDAR-4B-Chat2026.02 | 0.6399 | 0.3966 | 85.02 | |
| Original ModelTokPS=2, Block Size=4, Backbone=SDAR-1.7B-Chat2026.02 | 0.63 | 0.4003 | — | |
| SFTTokPS=2, SD=false, Block Size=8, Backbone=SDAR-1.7B-Chat2026.02 | 0.6255 | 0.4174 | 4.28 | |
| ReDiTokPS=2, SD=true, Block Size=8, Backbone=SDAR-1.7B-Chat2026.02 | 0.6217 | 0.3238 | -19.11 | |
| SFTTokPS=2, SD=false, Block Size=4, Backbone=SDAR-1.7B-Chat2026.02 | 0.6179 | 0.4174 | 4.28 | |
| Naive TDTokPS=4, SD=true, Block Size=4, Backbone=SDAR-4B-Chat2026.02 | 0.5792 | 0.2892 | 34.95 | |
| Original ModelTokPS=2, Block Size=8, Backbone=SDAR-1.7B-Chat2026.02 | 0.5588 | 0.4003 | — | |
| SFTTokPS=4, SD=false, Block Size=8, Backbone=SDAR-4B-Chat2026.02 | 0.5542 | 0.285 | 32.98 | |
| SFTTokPS=2, SD=false, Block Size=4, Backbone=SDAR-4B-Chat2026.02 | 0.546 | 0.4676 | -10.73 | |
| dParallelTokPS=4, SD=true, Block Size=8, Backbone=SDAR-4B-Chat2026.02 | 0.5383 | 0.298 | 39.05 | |
| ReDiTokPS=4, SD=true, Block Size=4, Backbone=SDAR-4B-Chat2026.02 | 0.533 | 0.2157 | 0.65 | |
| Naive TDTokPS=4, SD=true, Block Size=8, Backbone=SDAR-4B-Chat2026.02 | 0.508 | 0.2892 | 34.95 | |
| SFTTokPS=4, SD=false, Block Size=4, Backbone=SDAR-4B-Chat2026.02 | 0.4814 | 0.285 | 32.98 | |
| ReDiTokPS=4, SD=true, Block Size=8, Backbone=SDAR-4B-Chat2026.02 | 0.4784 | 0.2157 | 0.65 | |
| Naive TDTokPS=4, SD=true, Block Size=4, Backbone=SDAR-1.7B-Chat2026.02 | 0.4602 | 0.2207 | 122.78 | |
| dParallelTokPS=4, SD=true, Block Size=4, Backbone=SDAR-4B-Chat2026.02 | 0.4594 | 0.298 | 39.05 | |
| dParallelTokPS=4, SD=true, Block Size=4, Backbone=SDAR-1.7B-Chat2026.02 | 0.4526 | 0.226 | 128.09 | |
| dParallelTokPS=4, SD=true, Block Size=8, Backbone=SDAR-1.7B-Chat2026.02 | 0.4291 | 0.226 | 128.09 | |
| T3DTokPS=4, SD=true, Block Size=4, Backbone=SDAR-1.7B-Chat2026.02 | 0.4291 | 0.2227 | 124.79 | |
| Original ModelTokPS=4, Block Size=4, Backbone=SDAR-4B-Chat2026.02 | 0.4109 | 0.2143 | — | |
| Original ModelTokPS=4, Block Size=8, Backbone=SDAR-4B-Chat2026.02 | 0.4102 | 0.2143 | — | |
| Naive TDTokPS=4, SD=true, Block Size=8, Backbone=SDAR-1.7B-Chat2026.02 | 0.3973 | 0.2207 | 122.78 | |
| SFTTokPS=4, SD=false, Block Size=8, Backbone=SDAR-1.7B-Chat2026.02 | 0.3965 | 0.1784 | 80.05 | |
| T3DTokPS=4, SD=true, Block Size=8, Backbone=SDAR-1.7B-Chat2026.02 | 0.3738 | 0.2227 | 124.79 | |
| SFTTokPS=4, SD=false, Block Size=4, Backbone=SDAR-1.7B-Chat2026.02 | 0.3662 | 0.1784 | 80.05 | |
| ReDiTokPS=4, SD=true, Block Size=4, Backbone=SDAR-1.7B-Chat2026.02 | 0.3245 | 0.1347 | 35.95 | |
| ReDiTokPS=4, SD=true, Block Size=8, Backbone=SDAR-1.7B-Chat2026.02 | 0.2972 | 0.1347 | 35.95 | |
| Original ModelTokPS=4, Block Size=4, Backbone=SDAR-1.7B-Chat2026.02 | 0.1334 | 0.0991 | — | |
| Original ModelTokPS=4, Block Size=8, Backbone=SDAR-1.7B-Chat2026.02 | 0.1274 | 0.0991 | — |