List your company
ResearchFormerly WizWand

Dialogue Generation on SelfInst

11.31Rouge-LXPERT-OLMoE
8.1999.8110.62May 9, 2026
Updated 5mo ago

Evaluation results

MethodLinks
XPERT-OLMoE#Params=570M, #Size=dim=2048 16 Layers, Pre-training Tokens=5B, Fine-tuning Dataset=Dolly2026.0511.31
XPERT-DeepSeek#Params=570M, #Size=dim=2048 16 Layers, Pre-training Tokens=5B, Fine-tuning Dataset=Dolly2026.0510.43
XPERT-DeepSeek#Params=480M, #Size=dim=2048 12 Layers, Pre-training Tokens=5B, Fine-tuning Dataset=Dolly2026.0510.3
Distillation#Params=570M, #Size=dim=2048 16 Layers, Pre-training Tokens=5B, Fine-tuning Dataset=Dolly2026.0510.2
XPERT-OLMoE#Params=480M, #Size=dim=2048 12 Layers, Pre-training Tokens=5B, Fine-tuning Dataset=Dolly2026.059.57
XPERT-DeepSeek#Params=270M, #Size=dim=1024 16 Layers, Pre-training Tokens=5B, Fine-tuning Dataset=Dolly2026.059.56
Scratch#Params=270M, #Size=dim=1024 16 Layers, Pre-training Tokens=5B, Fine-tuning Dataset=Dolly2026.059.49
Scratch#Params=480M, #Size=dim=2048 12 Layers, Pre-training Tokens=5B, Fine-tuning Dataset=Dolly2026.059.41
Distillation#Params=270M, #Size=dim=1024 16 Layers, Pre-training Tokens=5B, Fine-tuning Dataset=Dolly2026.059.26
XPERT-OLMoE#Params=391M, #Size=dim=2048 8 Layers, Pre-training Tokens=5B, Fine-tuning Dataset=Dolly2026.059.18
Distillation#Params=480M, #Size=dim=2048 12 Layers, Pre-training Tokens=5B, Fine-tuning Dataset=Dolly2026.059.01
XPERT-DeepSeek#Params=391M, #Size=dim=2048 8 Layers, Pre-training Tokens=5B, Fine-tuning Dataset=Dolly2026.058.72
Scratch#Params=391M, #Size=dim=2048 8 Layers, Pre-training Tokens=5B, Fine-tuning Dataset=Dolly2026.058.5
XPERT-OLMoE#Params=270M, #Size=dim=1024 16 Layers, Pre-training Tokens=5B, Fine-tuning Dataset=Dolly2026.058.44
Distillation#Params=391M, #Size=dim=2048 8 Layers, Pre-training Tokens=5B, Fine-tuning Dataset=Dolly2026.058.34
Scratch#Params=570M, #Size=dim=2048 16 Layers, Pre-training Tokens=5B, Fine-tuning Dataset=Dolly2026.058.31