Code Generation on MBPP (Acc, Steps, Speed)
57.2AccuracyASRD
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ASRDModel=Dream-Base-7B, Sequence Length=2562026.06 | 57.2 | 73.8 | 3.1 | |
| ASRDModel=Dream-Base-7B, Sequence Length=5122026.06 | 56.8 | 113.6 | 3.9 | |
| BaselineModel=Dream-Base-7B, Sequence Length=5122026.06 | 55.8 | 495.7 | 1 | |
| BaselineModel=Dream-Base-7B, Sequence Length=2562026.06 | 54.6 | 239.1 | 1 | |
| ASRDModel=LLaDA-Base-8B, Sequence Length=5122026.06 | 42 | 180.4 | 2.6 | |
| ASRDModel=LLaDA-Base-8B, Sequence Length=2562026.06 | 41.4 | 115.8 | 1.9 | |
| BaselineModel=LLaDA-Base-8B, Sequence Length=5122026.06 | 39.8 | 493.7 | 1 | |
| ASRDModel=LLaDA-1.5-8B, Sequence Length=2562026.06 | 39.8 | 63.5 | 3.6 | |
| BaselineModel=LLaDA-Base-8B, Sequence Length=2562026.06 | 39.6 | 238.8 | 1 | |
| BaselineModel=LLaDA-1.5-8B, Sequence Length=2562026.06 | 38.6 | 237.9 | 1 | |
| ASRDModel=LLaDA-1.5-8B, Sequence Length=5122026.06 | 38.4 | 106.8 | 4.1 | |
| BaselineModel=LLaDA-1.5-8B, Sequence Length=5122026.06 | 37.6 | 496.8 | 1 |