Structured Generation on Bython
1.39Mean Generation Time (s)Llama-3B
Evaluation results
| Method | Links | |
|---|---|---|
| Llama-3BConstraint=Unconstrained2026.05 | 1.39 | |
| Llama-3BConstraint=+CFGZIP2026.05 | 1.76 | |
| Qwen-4BConstraint=Unconstrained2026.05 | 2.34 | |
| GPT-20BConstraint=Unconstrained2026.05 | 2.67 | |
| Qwen-4BConstraint=+CFGZIP2026.05 | 2.72 | |
| GPT-20BConstraint=+CFGZIP2026.05 | 3.52 | |
| Llama-3BConstraint=XGrammar22026.05 | 12.55 | |
| Qwen-4BConstraint=XGrammar22026.05 | 19.5 | |
| GPT-20BConstraint=XGrammar22026.05 | 19.52 |