Long-Context Generation on PG-19 32K context length
329.61ThroughputDustin
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DustinModel=Qwen2.5-7B-Instruct, Batch Size=162026.06 | 329.61 | 2.2 | 2.33 | |
| DustinModel=Qwen2.5-14B-Instruct, Batch Size=162026.06 | 278.11 | 2.1 | 6.2 | |
| DustinModel=Qwen2.5-32B-Instruct, Batch Size=162026.06 | 258.69 | 2.2 | 7.81 | |
| DustinModel=Qwen2.5-7B-Instruct, Batch Size=82026.06 | 239.76 | 2.3 | 1.9 | |
| DustinBatch Size=16, Backbone=Llama-3.1-8B-Instruct2026.06 | 213.64 | 2.8 | 3.17 | |
| MagicDecModel=Qwen2.5-7B-Instruct, Batch Size=162026.06 | 194.38 | 2.1 | 1.37 | |
| DustinModel=Qwen2.5-14B-Instruct, Batch Size=82026.06 | 194.36 | 2.1 | 4.63 | |
| DustinBatch Size=8, Backbone=Llama-3.1-8B-Instruct2026.06 | 180.14 | 2.7 | 2.85 | |
| DustinModel=Qwen2.5-32B-Instruct, Batch Size=82026.06 | 178.35 | 2.2 | 5.85 | |
| ClassicSDModel=Qwen2.5-7B-Instruct, Batch Size=162026.06 | 155.42 | 2.3 | 1.1 | |
| MagicDecModel=Qwen2.5-7B-Instruct, Batch Size=82026.06 | 145.94 | 2.1 | 1.16 | |
| VanillaModel=Qwen2.5-7B-Instruct, Batch Size=162026.06 | 141.47 | — | 1 | |
| ClassicSDModel=Qwen2.5-7B-Instruct, Batch Size=82026.06 | 132.62 | 2.3 | 1.05 | |
| MagicDecBatch Size=16, Backbone=Llama-3.1-8B-Instruct2026.06 | 127.11 | 2.6 | 1.89 | |
| VanillaModel=Qwen2.5-7B-Instruct, Batch Size=82026.06 | 126.35 | — | 1 | |
| MagicDecBatch Size=8, Backbone=Llama-3.1-8B-Instruct2026.06 | 110.05 | 2.5 | 1.74 | |
| ClassicSDBatch Size=16, Backbone=Llama-3.1-8B-Instruct2026.06 | 91.36 | 2.7 | 1.36 | |
| ClassicSDBatch Size=8, Backbone=Llama-3.1-8B-Instruct2026.06 | 84.8 | 2.6 | 1.34 | |
| MagicDecModel=Qwen2.5-14B-Instruct, Batch Size=162026.06 | 80.34 | 2.1 | 1.79 | |
| MagicDecModel=Qwen2.5-32B-Instruct, Batch Size=162026.06 | 74.7 | 2.3 | 2.25 | |
| ClassicSDModel=Qwen2.5-14B-Instruct, Batch Size=162026.06 | 72.65 | 2.1 | 1.62 | |
| ClassicSDModel=Qwen2.5-32B-Instruct, Batch Size=162026.06 | 68.16 | 2.4 | 2.06 | |
| VanillaBatch Size=16, Backbone=Llama-3.1-8B-Instruct2026.06 | 67.42 | — | 1 | |
| MagicDecModel=Qwen2.5-14B-Instruct, Batch Size=82026.06 | 63.52 | 2 | 1.51 | |
| VanillaBatch Size=8, Backbone=Llama-3.1-8B-Instruct2026.06 | 63.13 | — | 1 | |
| ClassicSDModel=Qwen2.5-14B-Instruct, Batch Size=82026.06 | 61.23 | 2.1 | 1.46 | |
| MagicDecModel=Qwen2.5-32B-Instruct, Batch Size=82026.06 | 57.61 | 2.2 | 1.89 | |
| ClassicSDModel=Qwen2.5-32B-Instruct, Batch Size=82026.06 | 56.04 | 2.3 | 1.84 | |
| VanillaModel=Qwen2.5-14B-Instruct, Batch Size=162026.06 | 44.87 | — | 1 | |
| VanillaModel=Qwen2.5-14B-Instruct, Batch Size=82026.06 | 41.96 | — | 1 | |
| VanillaModel=Qwen2.5-32B-Instruct, Batch Size=162026.06 | 33.14 | — | 1 | |
| VanillaModel=Qwen2.5-32B-Instruct, Batch Size=82026.06 | 30.49 | — | 1 |