Long-Context Generation on PG-19 24K context length
393.9ThroughputDustin
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DustinModel=Qwen2.5-7B-Instruct, Batch Size=162026.06 | 393.9 | 2.3 | 2.18 | |
| DustinModel=Qwen2.5-14B-Instruct, Batch Size=162026.06 | 330.63 | 2.2 | 5.69 | |
| DustinModel=Qwen2.5-32B-Instruct, Batch Size=162026.06 | 309.21 | 2.2 | 7.24 | |
| DustinBatch Size=16, Backbone=Llama-3.1-8B-Instruct2026.06 | 266.08 | 2.8 | 3.05 | |
| DustinModel=Qwen2.5-7B-Instruct, Batch Size=82026.06 | 257.39 | 2.3 | 1.64 | |
| MagicDecModel=Qwen2.5-7B-Instruct, Batch Size=162026.06 | 235.08 | 2.3 | 1.3 | |
| DustinBatch Size=8, Backbone=Llama-3.1-8B-Instruct2026.06 | 214.07 | 2.8 | 2.67 | |
| DustinModel=Qwen2.5-14B-Instruct, Batch Size=82026.06 | 208.28 | 2.1 | 3.91 | |
| ClassicSDModel=Qwen2.5-7B-Instruct, Batch Size=162026.06 | 198.47 | 2.4 | 1.1 | |
| DustinModel=Qwen2.5-32B-Instruct, Batch Size=82026.06 | 186.89 | 2.2 | 4.85 | |
| VanillaModel=Qwen2.5-7B-Instruct, Batch Size=162026.06 | 180.8 | — | 1 | |
| MagicDecModel=Qwen2.5-7B-Instruct, Batch Size=82026.06 | 171.16 | 2.3 | 1.09 | |
| MagicDecBatch Size=16, Backbone=Llama-3.1-8B-Instruct2026.06 | 160.96 | 2.6 | 1.85 | |
| ClassicSDModel=Qwen2.5-7B-Instruct, Batch Size=82026.06 | 158.03 | 2.4 | 1 | |
| VanillaModel=Qwen2.5-7B-Instruct, Batch Size=82026.06 | 157.37 | — | 1 | |
| MagicDecBatch Size=8, Backbone=Llama-3.1-8B-Instruct2026.06 | 133.37 | 2.7 | 1.66 | |
| ClassicSDBatch Size=16, Backbone=Llama-3.1-8B-Instruct2026.06 | 117.92 | 2.7 | 1.35 | |
| ClassicSDBatch Size=8, Backbone=Llama-3.1-8B-Instruct2026.06 | 107.71 | 2.8 | 1.34 | |
| MagicDecModel=Qwen2.5-14B-Instruct, Batch Size=162026.06 | 102.09 | 2.1 | 1.76 | |
| ClassicSDModel=Qwen2.5-14B-Instruct, Batch Size=162026.06 | 94.75 | 2.1 | 1.63 | |
| MagicDecModel=Qwen2.5-32B-Instruct, Batch Size=162026.06 | 92.1 | 2.3 | 2.16 | |
| VanillaBatch Size=16, Backbone=Llama-3.1-8B-Instruct2026.06 | 87.21 | — | 1 | |
| ClassicSDModel=Qwen2.5-32B-Instruct, Batch Size=162026.06 | 85.88 | 2.3 | 2.01 | |
| VanillaBatch Size=8, Backbone=Llama-3.1-8B-Instruct2026.06 | 80.31 | — | 1 | |
| MagicDecModel=Qwen2.5-14B-Instruct, Batch Size=82026.06 | 79.72 | 2.1 | 1.49 | |
| ClassicSDModel=Qwen2.5-14B-Instruct, Batch Size=82026.06 | 77.29 | 2.2 | 1.45 | |
| MagicDecModel=Qwen2.5-32B-Instruct, Batch Size=82026.06 | 69.52 | 2.2 | 1.8 | |
| ClassicSDModel=Qwen2.5-32B-Instruct, Batch Size=82026.06 | 68.15 | 2.3 | 1.77 | |
| VanillaModel=Qwen2.5-14B-Instruct, Batch Size=162026.06 | 58.14 | — | 1 | |
| VanillaModel=Qwen2.5-14B-Instruct, Batch Size=82026.06 | 53.33 | — | 1 | |
| VanillaModel=Qwen2.5-32B-Instruct, Batch Size=162026.06 | 42.73 | — | 1 | |
| VanillaModel=Qwen2.5-32B-Instruct, Batch Size=82026.06 | 38.56 | — | 1 |