List your company

ResearchFormerly WizWand

Mixtral

Benchmarks

TaskDatasetSOTA resultTrendResults

Training Efficiency

Mixtral-8x22b-G8T8 Fine-grained

28.8MFU

5

Training Efficiency

Mixtral-8x22B Coarse-grained

49.3MFU

5

Training Stability Analysis

Mixtral 8x1B pre-training

0Num Spikes

2