Performance Prediction Evaluation Suite
Benchmarks
TaskDatasetSOTA resultTrendResults
Performance Prediction Evaluation Suite 70B Model on GSM8k, MATH, BBH, TriviaQA, MBPP, AGIEval, DROP, MMLU-pro (evaluation sets)
1.55Mean Absolute Prediction Error (%)
6