Inference Efficiency on MolmoE-1B-7B (test)
12.65Avg kTop-p
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Top-pParam (B)=7.05, Memory (GB)=32.952026.06 | 12.65 | 98.44 | 1,643 | 0.178 | |
| MolmoE-1B-7BParam (B)=7.05, Memory (GB)=32.952026.06 | 8 | 80.65 | 1,709 | 0.169 | |
| MoE++Param (B)=7.05, Memory (GB)=32.952026.06 | 7.03 | 75.45 | 1,741 | 0.165 | |
| DYNMoEParam (B)=7.05, Memory (GB)=32.952026.06 | 6.19 | 72.58 | 1,757 | 0.162 | |
| AdaMoEParam (B)=7.05, Memory (GB)=32.952026.06 | 6.13 | 71.22 | 1,786 | 0.161 | |
| GeMoEParam (B)=7.05, Memory (GB)=32.952026.06 | 5.43 | 68.45 | 1,828 | 0.152 |