Question Answering on BIG-Bench Hard (BBH) (Specific Metrics)
55.96BBH MCQ AccuracyMCQ-Matched
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MCQ-MatchedCondition=MCQ-Matched2026.06 | 55.96 | 62.63 | 22.3 | |
| Full-Format SFTCondition=Full-Format2026.06 | 55.23 | 62.28 | 24.6 | |
| Random-FormatMixCondition=Random-FormatMix2026.06 | 55.06 | 60.68 | 23.5 | |
| Targeted-FormatMixCondition=Targeted-FormatMix2026.06 | 54.93 | 60.54 | 24.5 | |
| GLM4-9BCondition=Baseline2026.06 | 54.3 | 62.14 | 23.4 |