List your company

Composite

Benchmarks

TaskDatasetSOTA resultTrendResults
Composite IFEval-strict-prompt, BFCL v3, CodeIF-Bench, Nexus FC
86.9IFEval Strict Prompt Score
4
Composite (GSM8K, MATH, OlympiadBench, AIME 2025, HARDMath2, Omni-MATH, GSM-Plus, CMATH)
94.62GSM8K
4
Composite CRUXEval-O, MBPP, MBPP+, MultiPL-E, HumanEval, HumanEval+, HumanEvalFix, HumanEval-cn, BigCodeBench-Full, LiveCodeBench, Aider, BIRD-SQL, Spider
76.12CRUXEval-O Score
4
Composite (BIG-Bench Hard, BIG-Bench Extra Hard, bbh-zh, MuSR, ZebraLogic, PrOntoQA, PIQA, OCNLI, HellaSwag, KOR-Bench, DROP, SQuAD 2.0)
83.7BBH
4
Composite (MMLU, MMLU-Pro, CMMLU, C-EVAL, GAOKAO-Bench, ARC-c, GPQA, SciBench, PHYBench, TriviaQA)
65.77Overall Average Score
4