Mathematical Reasoning on GSM8K (Throughput)
1,828.7Throughput (tokens/s)DFLARE
Evaluation results
| Method | Links | |
|---|---|---|
| DFLAREConcurrency=162026.06 | 1,828.7 | |
| DFLAREConcurrency=82026.06 | 1,815.2 | |
| DFLAREConcurrency=322026.06 | 1,809.3 | |
| DFLAREConcurrency=42026.06 | 1,764.8 | |
| DFlashConcurrency=322026.06 | 1,068.6 | |
| BaselineConcurrency=82026.06 | 1,058.8 | |
| DFlashConcurrency=82026.06 | 1,057.6 | |
| BaselineConcurrency=322026.06 | 1,053.7 | |
| DFlashConcurrency=42026.06 | 1,048.1 | |
| BaselineConcurrency=162026.06 | 1,046.9 | |
| DFlashConcurrency=162026.06 | 1,045.5 | |
| DFLAREConcurrency=12026.06 | 642.6 | |
| BaselineConcurrency=42026.06 | 610.8 | |
| DFlashConcurrency=12026.06 | 596.6 | |
| BaselineConcurrency=12026.06 | 162.5 |