List your company
ResearchFormerly WizWand

Language Modeling on NLP Standard Suite

2.278CE LossMOE
2.257962.393232.52852.66377Dec 16, 2025
Updated 8mo ago

Evaluation results

MethodLinks
MOEBase Model Params=1.21B, Protocol=Zero-shot2025.122.278
VERSATILEFFNBase Model Params=1.21B, Protocol=Zero-shot2025.122.319
6-LOOPBase Model Params=1.21B, Protocol=Zero-shot2025.122.32
4-LOOPBase Model Params=1.21B, Protocol=Zero-shot2025.122.322
2-LOOPBase Model Params=1.21B, Protocol=Zero-shot2025.122.328
BASEBase Model Params=1.21B, Protocol=Zero-shot2025.122.385
MOEBase Model Params=720.81M, Protocol=Zero-shot2025.122.411
6-LOOPBase Model Params=720.81M, Protocol=Zero-shot2025.122.43
VERSATILEFFNBase Model Params=720.81M, Protocol=Zero-shot2025.122.43
4-LOOPBase Model Params=720.81M, Protocol=Zero-shot2025.122.441
2-LOOPBase Model Params=720.81M, Protocol=Zero-shot2025.122.448
BASEBase Model Params=720.81M, Protocol=Zero-shot2025.122.519
MOEBase Model Params=354.71M, Protocol=Zero-shot2025.122.585
VERSATILEFFNBase Model Params=354.71M, Protocol=Zero-shot2025.122.617
6-LOOPBase Model Params=354.71M, Protocol=Zero-shot2025.122.623
4-LOOPBase Model Params=354.71M, Protocol=Zero-shot2025.122.625
2-LOOPBase Model Params=354.71M, Protocol=Zero-shot2025.122.631
BASEBase Model Params=354.71M, Protocol=Zero-shot2025.122.779