Grammar-Constrained Decoding on JSON
74.9Relative Inference TimeEPIC
Evaluation Results
| Method | Links | |
|---|---|---|
| EPICModel=LLaDA (8B), Steps=162026.05 | 74.9 | |
| EPICModel=LLaDA (8B), Steps=322026.05 | 77.51 | |
| EPICModel=LLaDA (8B), Steps=642026.05 | 87.55 | |
| EPICModel=DreamCoder (7B), Steps=162026.05 | 89.19 | |
| EPICModel=DreamCoder (7B), Steps=322026.05 | 89.52 | |
| EPICModel=DiffuCoder (7B), Steps=2562026.05 | 92.97 | |
| CFG-constrained decoderModel=DiffuCoder (7B), Steps=2562026.05 | 95.17 | |
| EPICModel=LLaDA (8B), Steps=1282026.05 | 95.21 | |
| EPICModel=DiffuCoder (7B), Steps=322026.05 | 96.37 | |
| EPICModel=DiffuCoder (7B), Steps=1282026.05 | 96.46 | |
| EPICModel=DreamCoder (7B), Steps=642026.05 | 96.74 | |
| EPICModel=DiffuCoder (7B), Steps=642026.05 | 97.45 | |
| EPICModel=DreamCoder (7B), Steps=1282026.05 | 98.21 | |
| EPICModel=LLaDA (8B), Steps=2562026.05 | 98.25 | |
| EPICModel=DreamCoder (7B), Steps=2562026.05 | 98.84 | |
| CFG-constrained decoderModel=LLaDA (8B), Steps=2562026.05 | 100.09 | |
| EPICModel=Dream (7B), Steps=2562026.05 | 100.82 | |
| EPICModel=Dream (7B), Steps=1282026.05 | 100.92 | |
| EPICModel=Dream (7B), Steps=322026.05 | 101.22 | |
| CFG-constrained decoderModel=DreamCoder (7B), Steps=2562026.05 | 101.26 | |
| EPICModel=Dream (7B), Steps=642026.05 | 101.36 | |
| CFG-constrained decoderModel=DiffuCoder (7B), Steps=1282026.05 | 102.38 | |
| CFG-constrained decoderModel=Dream (7B), Steps=2562026.05 | 102.39 | |
| CFG-constrained decoderModel=LLaDA (8B), Steps=1282026.05 | 102.42 | |
| CFG-constrained decoderModel=Dream (7B), Steps=1282026.05 | 104.42 | |
| CFG-constrained decoderModel=LLaDA (8B), Steps=642026.05 | 104.67 | |
| CFG-constrained decoderModel=DreamCoder (7B), Steps=1282026.05 | 106.71 | |
| CFG-constrained decoderModel=Dream (7B), Steps=642026.05 | 108.19 | |
| EPICModel=DiffuCoder (7B), Steps=162026.05 | 108.72 | |
| EPICModel=Dream (7B), Steps=162026.05 | 109.36 | |
| CFG-constrained decoderModel=DiffuCoder (7B), Steps=642026.05 | 111.23 | |
| CFG-constrained decoderModel=LLaDA (8B), Steps=322026.05 | 111.99 | |
| CFG-constrained decoderModel=DreamCoder (7B), Steps=642026.05 | 118.02 | |
| CFG-constrained decoderModel=LLaDA (8B), Steps=162026.05 | 123.15 | |
| CFG-constrained decoderModel=Dream (7B), Steps=322026.05 | 123.79 | |
| CFG-constrained decoderModel=DiffuCoder (7B), Steps=322026.05 | 125.93 | |
| CFG-constrained decoderModel=DreamCoder (7B), Steps=322026.05 | 132.63 | |
| CFG-constrained decoderModel=DiffuCoder (7B), Steps=162026.05 | 165.58 | |
| CFG-constrained decoderModel=Dream (7B), Steps=162026.05 | 176.32 | |
| CFG-constrained decoderModel=DreamCoder (7B), Steps=162026.05 | 178.21 |