List your company

Commonsense Reasoning on LMEval

45.6Average ScoreTransformer
43.93644.36844.845.232Jun 5, 2025

Evaluation results

MethodLinks
TransformerLayers=24, Protocol=Zero-shot2025.0645.6
Log-Linear Gated DeltaNetLayers=21, Log-Linear variation=true, Protocol=Zero-shot2025.0645.5
Gated DeltaNetLayers=21, Log-Linear variation=false, Protocol=Zero-shot2025.0645
Log-Linear Mamba-2Layers=21, Log-Linear variation=true, Protocol=Zero-shot2025.0644.9
Mamba-2Layers=21, Log-Linear variation=false, Protocol=Zero-shot2025.0644.8
TransformerLayers=21, Protocol=Zero-shot2025.0644