Language Evaluation on NaturalQuestions (Accuracy)
0.433AccuracyYuan3.0-1T Base
Evaluation results
| Method | Links | |
|---|---|---|
| Yuan3.0-1T Base#Shots=1-shot, Architecture=MoE, # activated params=68.5B, # total params=1010B2026.01 | 0.433 | |
| LLaMA-3.1-405B Base#Shots=5-shot, Architecture=Dense, # activated params=405B, # total params=405B2026.01 | 0.415 | |
| DeepSeek-V3-Base#Shots=5-shot, Architecture=MoE, # activated params=37B, # total params=671B2026.01 | 0.4 |