Long-Context Generation on PG-19 8K context length
553.79ThroughputDustin
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DustinModel=Qwen2.5-7B-Instruct, Batch Size=162026.06 | 553.79 | 2.3 | 1.37 | |
| DustinBatch Size=16, Backbone=Llama-3.1-8B-Instruct2026.06 | 510.88 | 2.7 | 2.37 | |
| DustinModel=Qwen2.5-14B-Instruct, Batch Size=162026.06 | 443.91 | 2.1 | 3.11 | |
| DustinModel=Qwen2.5-32B-Instruct, Batch Size=162026.06 | 426.06 | 2.3 | 4.17 | |
| VanillaModel=Qwen2.5-7B-Instruct, Batch Size=162026.06 | 402.94 | — | 1 | |
| MagicDecModel=Qwen2.5-7B-Instruct, Batch Size=162026.06 | 402.3 | 2.2 | 1 | |
| ClassicSDModel=Qwen2.5-7B-Instruct, Batch Size=162026.06 | 385.72 | 2.4 | 0.96 | |
| MagicDecBatch Size=16, Backbone=Llama-3.1-8B-Instruct2026.06 | 337.75 | 2.5 | 1.57 | |
| DustinBatch Size=8, Backbone=Llama-3.1-8B-Instruct2026.06 | 313.3 | 2.7 | 1.85 | |
| DustinModel=Qwen2.5-7B-Instruct, Batch Size=82026.06 | 300.73 | 2.3 | 1.18 | |
| ClassicSDBatch Size=16, Backbone=Llama-3.1-8B-Instruct2026.06 | 289.06 | 2.6 | 1.34 | |
| VanillaModel=Qwen2.5-7B-Instruct, Batch Size=82026.06 | 255.05 | — | 1 | |
| MagicDecModel=Qwen2.5-7B-Instruct, Batch Size=82026.06 | 247.25 | 2.1 | 0.97 | |
| ClassicSDModel=Qwen2.5-7B-Instruct, Batch Size=82026.06 | 244.14 | 2.3 | 0.96 | |
| MagicDecBatch Size=8, Backbone=Llama-3.1-8B-Instruct2026.06 | 236.27 | 2.5 | 1.39 | |
| DustinModel=Qwen2.5-14B-Instruct, Batch Size=82026.06 | 233.19 | 2.2 | 2.05 | |
| MagicDecModel=Qwen2.5-14B-Instruct, Batch Size=162026.06 | 218.78 | 2.1 | 1.53 | |
| VanillaBatch Size=16, Backbone=Llama-3.1-8B-Instruct2026.06 | 215.3 | — | 1 | |
| ClassicSDBatch Size=8, Backbone=Llama-3.1-8B-Instruct2026.06 | 215.11 | 2.6 | 1.27 | |
| ClassicSDModel=Qwen2.5-14B-Instruct, Batch Size=162026.06 | 212.73 | 2.2 | 1.49 | |
| DustinModel=Qwen2.5-32B-Instruct, Batch Size=82026.06 | 205 | 2.3 | 2.54 | |
| MagicDecModel=Qwen2.5-32B-Instruct, Batch Size=162026.06 | 193.29 | 2.1 | 1.89 | |
| ClassicSDModel=Qwen2.5-32B-Instruct, Batch Size=162026.06 | 192.57 | 2.2 | 1.88 | |
| VanillaBatch Size=8, Backbone=Llama-3.1-8B-Instruct2026.06 | 169.7 | — | 1 | |
| MagicDecModel=Qwen2.5-14B-Instruct, Batch Size=82026.06 | 147.94 | 2.1 | 1.3 | |
| ClassicSDModel=Qwen2.5-14B-Instruct, Batch Size=82026.06 | 146.87 | 2.1 | 1.29 | |
| VanillaModel=Qwen2.5-14B-Instruct, Batch Size=162026.06 | 142.8 | — | 1 | |
| MagicDecModel=Qwen2.5-32B-Instruct, Batch Size=82026.06 | 128.09 | 2.2 | 1.59 | |
| ClassicSDModel=Qwen2.5-32B-Instruct, Batch Size=82026.06 | 125.09 | 2.3 | 1.55 | |
| VanillaModel=Qwen2.5-14B-Instruct, Batch Size=82026.06 | 113.99 | — | 1 | |
| VanillaModel=Qwen2.5-32B-Instruct, Batch Size=162026.06 | 102.24 | — | 1 | |
| VanillaModel=Qwen2.5-32B-Instruct, Batch Size=82026.06 | 80.62 | — | 1 |