HumanEval, MBPP, MedQA, MedMCQA, FinEval, FinanceIQ, GSM8K, MATH

Benchmarks

Task NameDataset NameSOTA ResultTrendResults

HumanEval, MBPP, MedQA, MedMCQA, FinEval, FinanceIQ, GSM8K, MATH In-Domain (test)

61.19Average In-Domain Performance

16