Question Answering on TriviaQA (Accuracy)
49.1AccuracyMoE + L_ERC
Evaluation results
| Method | Links | |
|---|---|---|
| MoE + L_ERCNumber of Parameters=15B, Activated Parameters=700M, Loss Function=ERC loss2025.12 | 49.1 | |
| MoENumber of Parameters=15B, Activated Parameters=700M2025.12 | 47.2 |