List your company
ResearchFormerly WizWand

Language Modeling on Lambada Standard

14.42PPLSPIRALFORMER-L
7.84652.220596.595140.9695Oct 9, 2025Oct 30, 2025Nov 20, 2025Dec 11, 2025Jan 1, 2026Jan 22, 2026Feb 12, 2026
Updated 6mo ago

Evaluation results

MethodLinks
SPIRALFORMER-LModel Scale=1.4B, Topology=MeSH2026.0214.42—
MeSHModel Size=Pythia-1.4B, Scheme=Recursive, Layers=4+8R2+4, Variant=+mesh, Parameter reduction percentage=-33.3%2025.1019.39—
ConceptLMModel Size=410M2026.0223.215.31
ContextLMModel Size=410M2026.0224.9515.82
MeSHModel Size=Pythia-1B, Scheme=Recursive, Layers=3+5R2+3, Variant=+mesh, Parameter reduction percentage=-31.3%2025.1026.71—
Pythia-410MModel Size=410M2026.0231.5317.84
MeSHModel Size=Pythia-410M, Scheme=Recursive, Layers=4+8R2+4, Variant=+mesh, Parameter reduction percentage=-33.3%2025.1042.51—
ContextLMModel Size=1.5B2026.0244.6225.93
ConceptLMModel Size=1.5B2026.0247.0626.38
MeSHModel Size=Pythia-410M, Scheme=Recursive, Layers=3+6R3+3, Variant=+mesh, Parameter reduction percentage=-50.0%2025.1052.07—
GPT2-1.5BModel Size=1.5B2026.0255.1229.68
VanillaModel Size=160M, Scheme=Vanilla, Layers=122025.10129.89—
MeSHModel Size=160M, Scheme=Recursive, Layers=2+4R2+2, Variant=+mesh, Parameter reduction percentage=-33.3%2025.10178.77—