Question Answering on C-Eval
82.7AccuracyBD3-LM 7B
Evaluation results
| Method | Links | |
|---|---|---|
| BD3-LM 7BShots=5, E2E Latency (s)=14.2, Inference Speed (tokens/s)=282026.02 | 82.7 | |
| Evo 8BShots=5, E2E Latency (s)=8.6, Inference Speed (tokens/s)=522026.02 | 80.4 | |
| LLaDA 8BShots=5, E2E Latency (s)=21.8, Inference Speed (tokens/s)=162026.02 | 70.1 | |
| LLaMA3 8BShots=5, E2E Latency (s)=7.4, Inference Speed (tokens/s)=582026.02 | 52 | |
| MDLM 7BShots=5, E2E Latency (s)=18.9, Inference Speed (tokens/s)=222026.02 | 45.4 | |
| ARD 7BShots=5, E2E Latency (s)=32.5, Inference Speed (tokens/s)=122026.02 | 34.6 |