# Text Question Answering on KMMLU-Redux

Source: [Text Question Answering on KMMLU-Redux](<https://www.sota2.com/research/sota/text-question-answering-on-kmmlu-redux>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-26T07:17:57.169Z

Evaluation of model performance on the KMMLU-Redux dataset for Text Question Answering tasks, measured by Accuracy.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Text Question Answering |
| Dataset (including any stated split) | KMMLU-Redux |
| Metric | Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 8 of 8 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Accuracy](<https://www.sota2.com/research/sota/text-question-answering-on-kmmlu-redux.md?metric=Accuracy>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| Raon-Speech | 51.8 | Not recorded | 6a1528fddbd7150506f7dd84 |
| MiniCPM-o 4.5 | 46.27 | Not recorded | 6a1528fddbd7150506f7dd84 |
| Fun-Audio Chat | 45.07 | Not recorded | 6a1528fddbd7150506f7dd84 |
| Step-Audio 2 mini | 35.41 | Not recorded | 6a1528fddbd7150506f7dd84 |
| Interactive Omni | 34.98 | Not recorded | 6a1528fddbd7150506f7dd84 |
| HyperCLOVA X 8B Omni | 30.58 | Not recorded | 6a1528fddbd7150506f7dd84 |
| Qwen2.5-Omni | 30.54 | Not recorded | 6a1528fddbd7150506f7dd84 |
| Audio Flamingo 3 | 0.27 | Not recorded | 6a1528fddbd7150506f7dd84 |

### Raon-Speech

Accuracy: 51.8. Result ID: 6a154806fbc373592c0c2f25.

[Reporting paper](<https://www.sota2.com/research/paper/6a1528fddbd7150506f7dd84.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a1528fddbd7150506f7dd84.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### MiniCPM-o 4.5

Accuracy: 46.27. Result ID: 6a154806fbc373592c0c2f2c.

[Reporting paper](<https://www.sota2.com/research/paper/6a1528fddbd7150506f7dd84.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Fun-Audio Chat

Accuracy: 45.07. Result ID: 6a154806fbc373592c0c2f2a.

[Reporting paper](<https://www.sota2.com/research/paper/6a1528fddbd7150506f7dd84.md>)

[Method origin paper](<https://www.sota2.com/research/paper/694b737353fdd5c361739931.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Step-Audio 2 mini

Accuracy: 35.41. Result ID: 6a154806fbc373592c0c2f28.

[Reporting paper](<https://www.sota2.com/research/paper/6a1528fddbd7150506f7dd84.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b021e209131cea8635d.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Interactive Omni

Accuracy: 34.98. Result ID: 6a154806fbc373592c0c2f29.

[Reporting paper](<https://www.sota2.com/research/paper/6a1528fddbd7150506f7dd84.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c2d1e209131cea8ce0b.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### HyperCLOVA X 8B Omni

Accuracy: 30.58. Result ID: 6a154806fbc373592c0c2f2b.

[Reporting paper](<https://www.sota2.com/research/paper/6a1528fddbd7150506f7dd84.md>)

[Method origin paper](<https://www.sota2.com/research/paper/695c971053fdd5c361743866.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Qwen2.5-Omni

Accuracy: 30.54. Result ID: 6a154806fbc373592c0c2f26.

[Reporting paper](<https://www.sota2.com/research/paper/6a1528fddbd7150506f7dd84.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b881e209131cea88f3d.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Audio Flamingo 3

Accuracy: 0.27. Result ID: 6a154806fbc373592c0c2f27.

[Reporting paper](<https://www.sota2.com/research/paper/6a1528fddbd7150506f7dd84.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7a4d1e209131cea82504.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
