Loading the SOTA2 catalog…
SOTA2 Research · benchmarks
Compare state-of-the-art methods across the tasks and datasets used to measure AI progress.
| Task | Dataset | Domain | Trend | Results | Last Update |
|---|---|---|---|---|---|
| Rhyme Identification | Modern Greek Rhyme Identification (test) | 32 | Feb 26, 2026 | ||
| Abstract generation | LongLaMP | 32 | Feb 26, 2026 | ||
| Multitask Language Understanding | GlobalMMLU | 32 | Jun 25, 2026 | ||
| Question Answering | ARC (25-shot), MMLU (5-shot), HellaSwag (10-shot), TruthfulQA (0-shot), and WinoGrande (0-shot) (test) | 32 | Feb 26, 2026 | ||
| Age | Patchscopes few-shot 1.0 (test) |
| 32 |
| Feb 26, 2026 |
| Culture | Patchscopes few-shot 1.0 (test) | 32 | Feb 26, 2026 |
|---|
| Gender | Patchscopes few-shot 1.0 (test) | 32 | Feb 26, 2026 |
|---|
| Color | Patchscopes few-shot 1.0 (test) | 32 | Feb 26, 2026 |
|---|
| Age | Patchscopes (test) | 32 | Feb 26, 2026 |
|---|
| Culture | Patchscopes (test) | 32 | Feb 26, 2026 |
|---|
| Gender | Patchscopes (test) | 32 | Feb 26, 2026 |
|---|
| Color | Patchscopes (test) | 32 | Feb 26, 2026 |
|---|
| Headline Generation | News Headline | 32 | Mar 4, 2026 |
|---|
| Mathematical Reasoning | Minerva | 32 | Feb 26, 2026 |
|---|
| Reasoning | MuSR | 32 | Jul 8, 2026 |
|---|
| Summarization | CNN/DM | 32 | May 4, 2026 |
|---|
| Meme Abuse Detection | GOAT-Bench 1.0 (test) | 32 | Feb 26, 2026 |
|---|
| Mathematical Reasoning | MATH500 | 32 | Feb 26, 2026 |
|---|
| Mathematical Reasoning | GSM8K | 32 | Feb 26, 2026 |
|---|
| Code Generation | MBPP | 32 | Feb 26, 2026 |
|---|
| Funny caption generation | Electric sheep Low-Humor | 32 | Feb 26, 2026 |
|---|
| Funny caption generation | Electric sheep High-Humor | 32 | Feb 26, 2026 |
|---|
| Funny caption generation | Humor in AI (#1000-1009) | 32 | Feb 26, 2026 |
|---|
| Funny caption generation | Humor in AI (#200-209) | 32 | Feb 26, 2026 |
|---|
| Funny caption generation | Humor in AI (#Top10) | 32 | Feb 26, 2026 |
|---|