# General Capability on BBH, GSM8K, MMLU, TruthfulQA, HumanEval, MBPP

Source: [General Capability on BBH, GSM8K, MMLU, TruthfulQA, HumanEval, MBPP](<https://www.sota2.com/research/sota/general-capability-on-bbh-gsm8k-mmlu-truthfulqa-humaneval-mbpp>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-14T09:12:21.797Z

Aggregate evaluation assessing general model capabilities across the BBH, GSM8K, MMLU, TruthfulQA, HumanEval, and MBPP benchmark suites, reporting the average score.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | General Capability |
| Dataset (including any stated split) | BBH, GSM8K, MMLU, TruthfulQA, HumanEval, MBPP |
| Metric | Average Score |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 30 of 30 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Average Score](<https://www.sota2.com/research/sota/general-capability-on-bbh-gsm8k-mmlu-truthfulqa-humaneval-mbpp.md?metric=Average%20Score>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Average Score | Result date | Report paper |
| --- | --- | --- | --- |
| ADG | 26.77 | Not recorded | 69ddca3f7d0172140ec79c29 |
| ADG | 26.23 | Not recorded | 69ddca3f7d0172140ec79c29 |
| ADG | 26.13 | Not recorded | 69ddca3f7d0172140ec79c29 |
| SuperFiltering | 26.03 | Not recorded | 69ddca3f7d0172140ec79c29 |
| ZIP | 25.95 | Not recorded | 69ddca3f7d0172140ec79c29 |
| SelectIT | 25.85 | Not recorded | 69ddca3f7d0172140ec79c29 |
| ZIP | 25.61 | Not recorded | 69ddca3f7d0172140ec79c29 |
| Rethinking | 25.57 | Not recorded | 69ddca3f7d0172140ec79c29 |
| Rethinking | 25.45 | Not recorded | 69ddca3f7d0172140ec79c29 |
| IFD | 25.33 | Not recorded | 69ddca3f7d0172140ec79c29 |
| SelectIT | 25.32 | Not recorded | 69ddca3f7d0172140ec79c29 |
| SCAR | 25.14 | Not recorded | 69ddca3f7d0172140ec79c29 |
| MIG | 25.06 | Not recorded | 69ddca3f7d0172140ec79c29 |
| Random | 25.01 | Not recorded | 69ddca3f7d0172140ec79c29 |
| SCAR | 24.99 | Not recorded | 69ddca3f7d0172140ec79c29 |
| SuperFiltering | 24.99 | Not recorded | 69ddca3f7d0172140ec79c29 |
| Random | 24.95 | Not recorded | 69ddca3f7d0172140ec79c29 |
| Rethinking | 24.8 | Not recorded | 69ddca3f7d0172140ec79c29 |
| ZIP | 24.79 | Not recorded | 69ddca3f7d0172140ec79c29 |
| IFD | 24.74 | Not recorded | 69ddca3f7d0172140ec79c29 |
| SCAR | 24.74 | Not recorded | 69ddca3f7d0172140ec79c29 |
| All Data | 24.73 | Not recorded | 69ddca3f7d0172140ec79c29 |
| SuperFiltering | 24.73 | Not recorded | 69ddca3f7d0172140ec79c29 |
| SelectIT | 24.68 | Not recorded | 69ddca3f7d0172140ec79c29 |
| MIG | 24.67 | Not recorded | 69ddca3f7d0172140ec79c29 |
| Random | 24.55 | Not recorded | 69ddca3f7d0172140ec79c29 |
| IFD | 24.52 | Not recorded | 69ddca3f7d0172140ec79c29 |
| All Data | 24.21 | Not recorded | 69ddca3f7d0172140ec79c29 |
| MIG | 24.2 | Not recorded | 69ddca3f7d0172140ec79c29 |
| All Data | 23.12 | Not recorded | 69ddca3f7d0172140ec79c29 |

### ADG

Average Score: 26.77. Result ID: 69de04f147f34ce924c5abce.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca3f7d0172140ec79c29.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69ddca3f7d0172140ec79c29.md>)

Recorded evaluation configuration: {"Backbone":"LLaMA3.2-1B-Instruct","Selection Pool":"Alpaca-GPT4(52K)","Selection Budget":"10K"}. This record does not assert independent reproduction.

### ADG

Average Score: 26.23. Result ID: 69de04f147f34ce924c5abe2.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca3f7d0172140ec79c29.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69ddca3f7d0172140ec79c29.md>)

Recorded evaluation configuration: {"Backbone":"LLaMA3.2-1B-Instruct","Selection Pool":"CoT(100K)","Selection Budget":"10K"}. This record does not assert independent reproduction.

### ADG

Average Score: 26.13. Result ID: 69de04f147f34ce924c5abd8.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca3f7d0172140ec79c29.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69ddca3f7d0172140ec79c29.md>)

Recorded evaluation configuration: {"Backbone":"LLaMA3.2-1B-Instruct","Selection Pool":"WizardLM(70K)","Selection Budget":"10K"}. This record does not assert independent reproduction.

### SuperFiltering

Average Score: 26.03. Result ID: 69de04f147f34ce924c5abc8.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca3f7d0172140ec79c29.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73851e209131cea5ceb4.md>)

Recorded evaluation configuration: {"Backbone":"LLaMA3.2-1B-Instruct","Selection Pool":"Alpaca-GPT4(52K)","Selection Budget":"10K"}. This record does not assert independent reproduction.

### ZIP

Average Score: 25.95. Result ID: 69de04f147f34ce924c5abcd.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca3f7d0172140ec79c29.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74131e209131cea5fad7.md>)

Recorded evaluation configuration: {"Backbone":"LLaMA3.2-1B-Instruct","Selection Pool":"Alpaca-GPT4(52K)","Selection Budget":"10K"}. This record does not assert independent reproduction.

### SelectIT

Average Score: 25.85. Result ID: 69de04f147f34ce924c5abc9.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca3f7d0172140ec79c29.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76981e209131cea6e06c.md>)

[Implementation](<https://github.com/Blue-Raincoat/SelectIT>)

Recorded evaluation configuration: {"Backbone":"LLaMA3.2-1B-Instruct","Selection Pool":"Alpaca-GPT4(52K)","Selection Budget":"10K"}. This record does not assert independent reproduction.

### ZIP

Average Score: 25.61. Result ID: 69de04f147f34ce924c5abe1.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca3f7d0172140ec79c29.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74131e209131cea5fad7.md>)

Recorded evaluation configuration: {"Backbone":"LLaMA3.2-1B-Instruct","Selection Pool":"CoT(100K)","Selection Budget":"10K"}. This record does not assert independent reproduction.

### Rethinking

Average Score: 25.57. Result ID: 69de04f147f34ce924c5abcc.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca3f7d0172140ec79c29.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa760a1e209131cea6b0c1.md>)

Recorded evaluation configuration: {"Backbone":"LLaMA3.2-1B-Instruct","Selection Pool":"Alpaca-GPT4(52K)","Selection Budget":"10K"}. This record does not assert independent reproduction.

### Rethinking

Average Score: 25.45. Result ID: 69de04f147f34ce924c5abe0.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca3f7d0172140ec79c29.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa760a1e209131cea6b0c1.md>)

Recorded evaluation configuration: {"Backbone":"LLaMA3.2-1B-Instruct","Selection Pool":"CoT(100K)","Selection Budget":"10K"}. This record does not assert independent reproduction.

### IFD

Average Score: 25.33. Result ID: 69de04f147f34ce924c5abc7.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca3f7d0172140ec79c29.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72d61e209131cea58d61.md>)

Recorded evaluation configuration: {"Backbone":"LLaMA3.2-1B-Instruct","Selection Pool":"Alpaca-GPT4(52K)","Selection Budget":"10K"}. This record does not assert independent reproduction.

### SelectIT

Average Score: 25.32. Result ID: 69de04f147f34ce924c5abd3.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca3f7d0172140ec79c29.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76981e209131cea6e06c.md>)

[Implementation](<https://github.com/Blue-Raincoat/SelectIT>)

Recorded evaluation configuration: {"Backbone":"LLaMA3.2-1B-Instruct","Selection Pool":"WizardLM(70K)","Selection Budget":"10K"}. This record does not assert independent reproduction.

### SCAR

Average Score: 25.14. Result ID: 69de04f147f34ce924c5abd5.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca3f7d0172140ec79c29.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79051e209131cea7bbc2.md>)

Recorded evaluation configuration: {"Backbone":"LLaMA3.2-1B-Instruct","Selection Pool":"WizardLM(70K)","Selection Budget":"10K"}. This record does not assert independent reproduction.

### MIG

Average Score: 25.06. Result ID: 69de04f147f34ce924c5abd4.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca3f7d0172140ec79c29.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78201e209131cea76e63.md>)

Recorded evaluation configuration: {"Backbone":"LLaMA3.2-1B-Instruct","Selection Pool":"WizardLM(70K)","Selection Budget":"10K"}. This record does not assert independent reproduction.

### Random

Average Score: 25.01. Result ID: 69de04f147f34ce924c5abd0.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca3f7d0172140ec79c29.md>)

Recorded evaluation configuration: {"Backbone":"LLaMA3.2-1B-Instruct","Selection Pool":"WizardLM(70K)","Selection Budget":"10K"}. This record does not assert independent reproduction.

### SCAR

Average Score: 24.99. Result ID: 69de04f147f34ce924c5abcb.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca3f7d0172140ec79c29.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79051e209131cea7bbc2.md>)

Recorded evaluation configuration: {"Backbone":"LLaMA3.2-1B-Instruct","Selection Pool":"Alpaca-GPT4(52K)","Selection Budget":"10K"}. This record does not assert independent reproduction.

### SuperFiltering

Average Score: 24.99. Result ID: 69de04f147f34ce924c5abdc.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca3f7d0172140ec79c29.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73851e209131cea5ceb4.md>)

Recorded evaluation configuration: {"Backbone":"LLaMA3.2-1B-Instruct","Selection Pool":"CoT(100K)","Selection Budget":"10K"}. This record does not assert independent reproduction.

### Random

Average Score: 24.95. Result ID: 69de04f147f34ce924c5abda.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca3f7d0172140ec79c29.md>)

Recorded evaluation configuration: {"Backbone":"LLaMA3.2-1B-Instruct","Selection Pool":"CoT(100K)","Selection Budget":"10K"}. This record does not assert independent reproduction.

### Rethinking

Average Score: 24.8. Result ID: 69de04f147f34ce924c5abd6.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca3f7d0172140ec79c29.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa760a1e209131cea6b0c1.md>)

Recorded evaluation configuration: {"Backbone":"LLaMA3.2-1B-Instruct","Selection Pool":"WizardLM(70K)","Selection Budget":"10K"}. This record does not assert independent reproduction.

### ZIP

Average Score: 24.79. Result ID: 69de04f147f34ce924c5abd7.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca3f7d0172140ec79c29.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74131e209131cea5fad7.md>)

Recorded evaluation configuration: {"Backbone":"LLaMA3.2-1B-Instruct","Selection Pool":"WizardLM(70K)","Selection Budget":"10K"}. This record does not assert independent reproduction.

### IFD

Average Score: 24.74. Result ID: 69de04f147f34ce924c5abdb.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca3f7d0172140ec79c29.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72d61e209131cea58d61.md>)

Recorded evaluation configuration: {"Backbone":"LLaMA3.2-1B-Instruct","Selection Pool":"CoT(100K)","Selection Budget":"10K"}. This record does not assert independent reproduction.

### SCAR

Average Score: 24.74. Result ID: 69de04f147f34ce924c5abdf.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca3f7d0172140ec79c29.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79051e209131cea7bbc2.md>)

Recorded evaluation configuration: {"Backbone":"LLaMA3.2-1B-Instruct","Selection Pool":"CoT(100K)","Selection Budget":"10K"}. This record does not assert independent reproduction.

### All Data

Average Score: 24.73. Result ID: 69de04f147f34ce924c5abc5.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca3f7d0172140ec79c29.md>)

Recorded evaluation configuration: {"Backbone":"LLaMA3.2-1B-Instruct","Selection Pool":"Alpaca-GPT4(52K)","Selection Budget":"10K"}. This record does not assert independent reproduction.

### SuperFiltering

Average Score: 24.73. Result ID: 69de04f147f34ce924c5abd2.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca3f7d0172140ec79c29.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73851e209131cea5ceb4.md>)

Recorded evaluation configuration: {"Backbone":"LLaMA3.2-1B-Instruct","Selection Pool":"WizardLM(70K)","Selection Budget":"10K"}. This record does not assert independent reproduction.

### SelectIT

Average Score: 24.68. Result ID: 69de04f147f34ce924c5abdd.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca3f7d0172140ec79c29.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76981e209131cea6e06c.md>)

[Implementation](<https://github.com/Blue-Raincoat/SelectIT>)

Recorded evaluation configuration: {"Backbone":"LLaMA3.2-1B-Instruct","Selection Pool":"CoT(100K)","Selection Budget":"10K"}. This record does not assert independent reproduction.

### MIG

Average Score: 24.67. Result ID: 69de04f147f34ce924c5abca.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca3f7d0172140ec79c29.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78201e209131cea76e63.md>)

Recorded evaluation configuration: {"Backbone":"LLaMA3.2-1B-Instruct","Selection Pool":"Alpaca-GPT4(52K)","Selection Budget":"10K"}. This record does not assert independent reproduction.

### Random

Average Score: 24.55. Result ID: 69de04f147f34ce924c5abc6.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca3f7d0172140ec79c29.md>)

Recorded evaluation configuration: {"Backbone":"LLaMA3.2-1B-Instruct","Selection Pool":"Alpaca-GPT4(52K)","Selection Budget":"10K"}. This record does not assert independent reproduction.

### IFD

Average Score: 24.52. Result ID: 69de04f147f34ce924c5abd1.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca3f7d0172140ec79c29.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72d61e209131cea58d61.md>)

Recorded evaluation configuration: {"Backbone":"LLaMA3.2-1B-Instruct","Selection Pool":"WizardLM(70K)","Selection Budget":"10K"}. This record does not assert independent reproduction.

### All Data

Average Score: 24.21. Result ID: 69de04f147f34ce924c5abcf.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca3f7d0172140ec79c29.md>)

Recorded evaluation configuration: {"Backbone":"LLaMA3.2-1B-Instruct","Selection Pool":"WizardLM(70K)","Selection Budget":"10K"}. This record does not assert independent reproduction.

### MIG

Average Score: 24.2. Result ID: 69de04f147f34ce924c5abde.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca3f7d0172140ec79c29.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78201e209131cea76e63.md>)

Recorded evaluation configuration: {"Backbone":"LLaMA3.2-1B-Instruct","Selection Pool":"CoT(100K)","Selection Budget":"10K"}. This record does not assert independent reproduction.

### All Data

Average Score: 23.12. Result ID: 69de04f147f34ce924c5abd9.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca3f7d0172140ec79c29.md>)

Recorded evaluation configuration: {"Backbone":"LLaMA3.2-1B-Instruct","Selection Pool":"CoT(100K)","Selection Budget":"10K"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
