List your company
ResearchFormerly WizWand

Natural Language Understanding on Winogrande

59AccuracySpaceByte + SP
52.312854.048955.78557.5211Nov 21, 2024Feb 19, 2025May 21, 2025Aug 19, 2025Nov 18, 2025Feb 16, 2026May 18, 2026
Updated 5mo ago

Evaluation results

MethodLinks
SpaceByte + SPSequence Reduction=6.3, FLOPs/byte Reduction=2.72026.0559
H-Net + SPSequence Reduction=5.3†, FLOPs/byte Reduction=2.42026.0559
Fixed (p = 4) + SPSequence Reduction=4.0, FLOPs/byte Reduction=2.12026.0558.8
Fixed (p = 4)Sequence Reduction=4.0, FLOPs/byte Reduction=3.12026.0558.6
Fixed (p = 16) + SPSequence Reduction=16.0, FLOPs/byte Reduction=2.92026.0558.2
Entropy-basedSequence Reduction=6.4, FLOPs/byte Reduction=4.02026.0557.9
Tokenizer-basedSequence Reduction=3.7, FLOPs/byte Reduction=4.12026.0557.8
SpaceByteSequence Reduction=6.3, FLOPs/byte Reduction=4.02026.0557.7
Fixed (p = 8) + SPSequence Reduction=8.0, FLOPs/byte Reduction=2.62026.0557.4
Entropy-based + SPSequence Reduction=6.3†, FLOPs/byte Reduction=2.72026.0557.4
H-NetSequence Reduction=4.8, FLOPs/byte Reduction=3.42026.0556.7
Fixed (p = 8)Sequence Reduction=8.0, FLOPs/byte Reduction=4.52026.0556.2
Byte-levelSequence Reduction=1.0, FLOPs/byte Reduction=1.02026.0556
Fixed (p = 16)Sequence Reduction=16.0, FLOPs/byte Reduction=5.72026.0555.2
SYNPROModel Size=1.1B, Alpha (organic token ratio)=10%2026.0553.91
ProDiaLProjection Type=Out-Proj, Number of Parameters=0.92M2024.1153.75
ProDiaLProjection Type=Both-Proj, Number of Parameters=2.42M2024.1153.28
FTProjection Type=In-Proj, Number of Parameters=56.62M2024.1153.2
Full-FTProjection Type=Baseline, Number of Parameters=130.00M2024.1153.12
BitFitProjection Type=Baseline, Number of Parameters=0.07M2024.1153.12
LoRAProjection Type=Both-Proj, Number of Parameters=2.36M2024.1153.12
LoRAProjection Type=Out-Proj, Number of Parameters=0.89M2024.1153.12
StrongProjection Type=Baseline, Number of Parameters=3.80M2024.1153.04
ProDiaLProjection Type=In-Proj, Number of Parameters=1.49M2024.1152.96
DoRAProjection Type=Both-Proj, Number of Parameters=2.45M2024.1152.88
DoRAProjection Type=Out-Proj, Number of Parameters=0.90M2024.1152.88
LoRAProjection Type=In-Proj, Number of Parameters=1.48M2024.1152.8
FTProjection Type=Out-Proj, Number of Parameters=28.31M2024.1152.8
DoRAProjection Type=In-Proj, Number of Parameters=1.55M2024.1152.64
FTProjection Type=Both-Proj, Number of Parameters=84.94M2024.1152.57