List your company
ResearchFormerly WizWand

Language Modeling on Wikipedia 20k sentences

9.06Perplexity (Wikipedia 20k)Original
8.813610.476812.1413.8032Oct 5, 2025
Updated 7mo ago

Evaluation results

MethodLinks
OriginalModel=Llama3-8B, Sequential=false2025.109.06
Linear-AcTModel=Llama3-8B, Sequential=false2025.109.35
Mean-AcTModel=Llama3-8B, Sequential=false2025.109.36
CAAModel=Llama3-8B, Sequential=false2025.109.4
ITI-CModel=Llama3-8B, Sequential=false2025.109.48
Linear-AcTModel=Llama3-8B, Sequential=true2025.109.48
AURAModel=Llama3-8B, Sequential=false2025.109.52
PID-AcTModel=Llama3-8B, Sequential=true2025.109.56
ActADDModel=Llama3-8B, Sequential=false2025.109.71
Mean-AcTModel=Llama3-8B, Sequential=true2025.109.83
OriginalModel=Gemma2-2B, Sequential=false2025.1013.98
AURAModel=Gemma2-2B, Sequential=false2025.1014.18
Mean-AcTModel=Gemma2-2B, Sequential=false2025.1014.53
CAAModel=Gemma2-2B, Sequential=false2025.1014.6
ActADDModel=Gemma2-2B, Sequential=false2025.1014.69
Linear-AcTModel=Gemma2-2B, Sequential=false2025.1014.75
ITI-CModel=Gemma2-2B, Sequential=false2025.1014.9
Mean-AcTModel=Gemma2-2B, Sequential=true2025.1014.92
Linear-AcTModel=Gemma2-2B, Sequential=true2025.1014.98
PID-AcTModel=Gemma2-2B, Sequential=true2025.1015.22