Grammar-Constrained Decoding on C++
64.07Relative Inference TimeEPIC
Evaluation Results
| Method | Links | |
|---|---|---|
| EPICModel=LLaDA (8B), Steps=322026.05 | 64.07 | |
| EPICModel=LLaDA (8B), Steps=162026.05 | 74.84 | |
| EPICModel=LLaDA (8B), Steps=642026.05 | 76.78 | |
| CFG-constrained decoderModel=LLaDA (8B), Steps=642026.05 | 93.26 | |
| EPICModel=LLaDA (8B), Steps=1282026.05 | 93.27 | |
| CFG-constrained decoderModel=LLaDA (8B), Steps=322026.05 | 95.49 | |
| EPICModel=Dream (7B), Steps=162026.05 | 98.44 | |
| CFG-constrained decoderModel=LLaDA (8B), Steps=1282026.05 | 100.52 | |
| EPICModel=LLaDA (8B), Steps=2562026.05 | 100.71 | |
| CFG-constrained decoderModel=Dream (7B), Steps=2562026.05 | 102.12 | |
| CFG-constrained decoderModel=LLaDA (8B), Steps=2562026.05 | 102.3 | |
| EPICModel=DiffuCoder (7B), Steps=642026.05 | 102.33 | |
| EPICModel=Dream (7B), Steps=1282026.05 | 102.65 | |
| EPICModel=Dream (7B), Steps=2562026.05 | 102.92 | |
| EPICModel=DiffuCoder (7B), Steps=1282026.05 | 103.98 | |
| CFG-constrained decoderModel=Dream (7B), Steps=1282026.05 | 106.03 | |
| EPICModel=DreamCoder (7B), Steps=2562026.05 | 106.5 | |
| EPICModel=DiffuCoder (7B), Steps=2562026.05 | 107.8 | |
| EPICModel=DiffuCoder (7B), Steps=162026.05 | 108.07 | |
| EPICModel=Dream (7B), Steps=642026.05 | 108.12 | |
| EPICModel=DreamCoder (7B), Steps=1282026.05 | 110.46 | |
| CFG-constrained decoderModel=LLaDA (8B), Steps=162026.05 | 112.19 | |
| CFG-constrained decoderModel=Dream (7B), Steps=642026.05 | 114.41 | |
| EPICModel=Dream (7B), Steps=322026.05 | 114.85 | |
| CFG-constrained decoderModel=DreamCoder (7B), Steps=2562026.05 | 117.23 | |
| CFG-constrained decoderModel=DiffuCoder (7B), Steps=2562026.05 | 118.54 | |
| CFG-constrained decoderModel=DiffuCoder (7B), Steps=1282026.05 | 121.15 | |
| EPICModel=DiffuCoder (7B), Steps=322026.05 | 123.18 | |
| EPICModel=DreamCoder (7B), Steps=162026.05 | 127.34 | |
| EPICModel=DreamCoder (7B), Steps=642026.05 | 128.04 | |
| CFG-constrained decoderModel=DreamCoder (7B), Steps=1282026.05 | 133.57 | |
| CFG-constrained decoderModel=DiffuCoder (7B), Steps=642026.05 | 138.87 | |
| EPICModel=DreamCoder (7B), Steps=322026.05 | 140.51 | |
| CFG-constrained decoderModel=Dream (7B), Steps=162026.05 | 143.86 | |
| CFG-constrained decoderModel=Dream (7B), Steps=322026.05 | 147.89 | |
| CFG-constrained decoderModel=DiffuCoder (7B), Steps=322026.05 | 182.2 | |
| CFG-constrained decoderModel=DreamCoder (7B), Steps=642026.05 | 182.52 | |
| CFG-constrained decoderModel=DiffuCoder (7B), Steps=162026.05 | 187.5 | |
| CFG-constrained decoderModel=DreamCoder (7B), Steps=322026.05 | 269.76 | |
| CFG-constrained decoderModel=DreamCoder (7B), Steps=162026.05 | 388.6 |