Dialogue Generation on UnNI
23.2Rouge-LXPERT-DeepSeek
Evaluation Results
| Method | Links | |
|---|---|---|
| XPERT-DeepSeek#Params=570M, #Size=dim=2048 16 Layers, Pre-training Tokens=5B, Fine-tuning Dataset=Dolly2026.05 | 23.2 | |
| XPERT-OLMoE#Params=570M, #Size=dim=2048 16 Layers, Pre-training Tokens=5B, Fine-tuning Dataset=Dolly2026.05 | 22.6 | |
| XPERT-OLMoE#Params=480M, #Size=dim=2048 12 Layers, Pre-training Tokens=5B, Fine-tuning Dataset=Dolly2026.05 | 21.83 | |
| XPERT-OLMoE#Params=270M, #Size=dim=1024 16 Layers, Pre-training Tokens=5B, Fine-tuning Dataset=Dolly2026.05 | 21.55 | |
| XPERT-OLMoE#Params=391M, #Size=dim=2048 8 Layers, Pre-training Tokens=5B, Fine-tuning Dataset=Dolly2026.05 | 21.47 | |
| Distillation#Params=480M, #Size=dim=2048 12 Layers, Pre-training Tokens=5B, Fine-tuning Dataset=Dolly2026.05 | 21.47 | |
| XPERT-DeepSeek#Params=270M, #Size=dim=1024 16 Layers, Pre-training Tokens=5B, Fine-tuning Dataset=Dolly2026.05 | 21.33 | |
| Scratch#Params=480M, #Size=dim=2048 12 Layers, Pre-training Tokens=5B, Fine-tuning Dataset=Dolly2026.05 | 20.76 | |
| Distillation#Params=270M, #Size=dim=1024 16 Layers, Pre-training Tokens=5B, Fine-tuning Dataset=Dolly2026.05 | 20.5 | |
| XPERT-DeepSeek#Params=480M, #Size=dim=2048 12 Layers, Pre-training Tokens=5B, Fine-tuning Dataset=Dolly2026.05 | 20.48 | |
| Distillation#Params=570M, #Size=dim=2048 16 Layers, Pre-training Tokens=5B, Fine-tuning Dataset=Dolly2026.05 | 20.27 | |
| XPERT-DeepSeek#Params=391M, #Size=dim=2048 8 Layers, Pre-training Tokens=5B, Fine-tuning Dataset=Dolly2026.05 | 20.02 | |
| Scratch#Params=570M, #Size=dim=2048 16 Layers, Pre-training Tokens=5B, Fine-tuning Dataset=Dolly2026.05 | 19.67 | |
| Scratch#Params=270M, #Size=dim=1024 16 Layers, Pre-training Tokens=5B, Fine-tuning Dataset=Dolly2026.05 | 19.32 | |
| Scratch#Params=391M, #Size=dim=2048 8 Layers, Pre-training Tokens=5B, Fine-tuning Dataset=Dolly2026.05 | 18.16 | |
| Distillation#Params=391M, #Size=dim=2048 8 Layers, Pre-training Tokens=5B, Fine-tuning Dataset=Dolly2026.05 | 18.14 |