List your company
ResearchFormerly WizWand

Language Modeling on Wiki-40B (val)

14.955PerplexityFLASH-Quad
14.7562816.0976417.43918.78036Feb 21, 2022
Updated 8mo ago

Evaluation results

MethodLinks
FLASH-QuadContext Length=40962022.0214.95596.1
FLASH-QuadContext Length=81922022.0214.998141.3
FLASHContext Length=81922022.0215.10962.5
Transformer++Context Length=81922022.0215.254261
FLASHContext Length=40962022.0215.25957
Transformer++Context Length=40962022.0215.282149.2
FLASH-QuadContext Length=20482022.0215.30571.3
Transformer+Context Length=81922022.0215.478261.9
Transformer++Context Length=20482022.0215.48996.6
Transformer+Context Length=40962022.0215.515149.3
FLASHContext Length=20482022.0215.52556.7
Transformer+Context Length=20482022.0215.65396.1
FLASH-QuadContext Length=10242022.0215.87959.5
FLASHContext Length=10242022.0215.93556.9
Transformer++Context Length=10242022.0215.94370.9
Transformer+Context Length=10242022.0215.99970.3
CombinerContext Length=81922022.0216.11977.9
CombinerContext Length=40962022.0216.17171.7
CombinerContext Length=20482022.0216.34471.8
FLASHContext Length=5122022.0216.58157.2
FLASH-QuadContext Length=5122022.0216.63354.1
CombinerContext Length=10242022.0216.7174.4
Transformer++Context Length=5122022.0216.83554.7
Transformer+Context Length=5122022.0216.90755.6
CombinerContext Length=5122022.0217.33875.5
TransformerContext Length=5122022.0217.34154
TransformerContext Length=40962022.0217.731149.1
TransformerContext Length=20482022.0218.15496.3
TransformerContext Length=81922022.0218.254260.7
PerformerContext Length=10242022.0218.521,386.9
PerformerContext Length=20482022.0218.5471,518.9
PerformerContext Length=40962022.0218.9871,526.7
PerformerContext Length=5122022.0218.9891,439.7
TransformerContext Length=10242022.0219.80870.9
PerformerContext Length=81922022.0219.9231,526.8