List your company
ResearchFormerly WizWand

Language Modeling on Tiny-Shakespeare (o.o.d)

569.3PerplexityFinetuning + KL
569.176570.013570.85571.687May 15, 2025
Updated 8mo ago

Evaluation results

MethodLinks
Finetuning + KLDistillation Task=Shuffle Dyck2025.05569.3
No editingDistillation Task=Shuffle Dyck2025.05569.7
No editingDistillation Task=Integer Addition2025.05569.7
No editingDistillation Task=Count2025.05569.7
Tracr InjectionDistillation Task=Shuffle Dyck2025.05569.9
Finetuning + KLDistillation Task=Integer Addition2025.05570.1
Finetuning + KLDistillation Task=Count2025.05571.2
Tracr InjectionDistillation Task=Count2025.05571.4
Tracr InjectionDistillation Task=Integer Addition2025.05572.4