Conditional Generation on Pile
11.2PerplexityA3-8B
Evaluation results
| Method | Links | |
|---|---|---|
| A3-8BSampling Strategy=Entropy, Sampling Steps=1024, Evaluation Model=Llama-3.1-8B2026.01 | 11.2 | |
| DiffuLlamaSampling Strategy=Entropy, Sampling Steps=1024, Evaluation Model=Llama-3.1-8B2026.01 | 14.3 | |
| A3-8BSampling Strategy=Entropy, Sampling Steps=512, Evaluation Model=Llama-3.1-8B2026.01 | 14.3 | |
| DreamSampling Strategy=Entropy, Sampling Steps=1024, Evaluation Model=Llama-3.1-8B2026.01 | 16.4 | |
| A3-8BSampling Strategy=Confidence, Sampling Steps=1024, Evaluation Model=Llama-3.1-8B2026.01 | 16.8 | |
| DreamSampling Strategy=Confidence, Sampling Steps=1024, Evaluation Model=Llama-3.1-8B2026.01 | 17.2 | |
| DiffuLlamaSampling Strategy=Confidence, Sampling Steps=1024, Evaluation Model=Llama-3.1-8B2026.01 | 18.3 | |
| DreamSampling Strategy=Entropy, Sampling Steps=512, Evaluation Model=Llama-3.1-8B2026.01 | 18.7 | |
| A3-8BSampling Strategy=Confidence, Sampling Steps=512, Evaluation Model=Llama-3.1-8B2026.01 | 20.1 | |
| DiffuLlamaSampling Strategy=Entropy, Sampling Steps=512, Evaluation Model=Llama-3.1-8B2026.01 | 20.9 | |
| DreamSampling Strategy=Confidence, Sampling Steps=512, Evaluation Model=Llama-3.1-8B2026.01 | 21.3 | |
| DiffuLlamaSampling Strategy=Confidence, Sampling Steps=512, Evaluation Model=Llama-3.1-8B2026.01 | 24.1 | |
| DreamSampling Strategy=Random, Sampling Steps=1024, Evaluation Model=Llama-3.1-8B2026.01 | 46.2 | |
| A3-8BSampling Strategy=Random, Sampling Steps=1024, Evaluation Model=Llama-3.1-8B2026.01 | 49.3 | |
| DreamSampling Strategy=Random, Sampling Steps=512, Evaluation Model=Llama-3.1-8B2026.01 | 58.4 | |
| DiffuLlamaSampling Strategy=Random, Sampling Steps=1024, Evaluation Model=Llama-3.1-8B2026.01 | 58.4 | |
| A3-8BSampling Strategy=Random, Sampling Steps=512, Evaluation Model=Llama-3.1-8B2026.01 | 66.4 | |
| DiffuLlamaSampling Strategy=Random, Sampling Steps=512, Evaluation Model=Llama-3.1-8B2026.01 | 72.3 |