Multi-task Evaluation Suite

Benchmarks

TaskDatasetSOTA resultTrendResults

49Average Performance

Multi-task Evaluation Suite Instruction, Math, Multilingual, Safety

1.015Average Score

Multi-task Evaluation Suite Llama-3.2-1B (test)

394.81MT Throughput (token/s)