# All tasks combined on AOP-Wiki structured question answering set (test)

Source: [All tasks combined on AOP-Wiki structured question answering set (test)](<https://www.sota2.com/research/sota/all-tasks-combined-on-aop-wiki-structured-question-answering-set-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-14T06:40:27.721Z

Evaluation across all combined tasks on the test split of the AOP-Wiki structured question answering dataset, measured by accuracy.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | All tasks combined |
| Dataset (including any stated split) | AOP-Wiki structured question answering set (test) |
| Metric | Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 8 of 8 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Accuracy](<https://www.sota2.com/research/sota/all-tasks-combined-on-aop-wiki-structured-question-answering-set-test.md?metric=Accuracy>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| DeepSeek | 100 | Not recorded | 69ddca617d0172140ec79dd4 |
| Overall | 96.67 | Not recorded | 69ddca617d0172140ec79dd4 |
| Gemini | 95 | Not recorded | 69ddca617d0172140ec79dd4 |
| GPT | 95 | Not recorded | 69ddca617d0172140ec79dd4 |
| DeepSeek | 35 | Not recorded | 69ddca617d0172140ec79dd4 |
| Overall | 23.33 | Not recorded | 69ddca617d0172140ec79dd4 |
| Gemini | 20 | Not recorded | 69ddca617d0172140ec79dd4 |
| GPT | 15 | Not recorded | 69ddca617d0172140ec79dd4 |

### DeepSeek

Accuracy: 100. Result ID: 69dddf7e47f34ce924c4be9b.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca617d0172140ec79dd4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69ddca617d0172140ec79dd4.md>)

Recorded evaluation configuration: {"RAG enhancement":"W/ RAG"}. This record does not assert independent reproduction.

### Overall

Accuracy: 96.67. Result ID: 69dddf7e47f34ce924c4bea1.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca617d0172140ec79dd4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69ddca617d0172140ec79dd4.md>)

Recorded evaluation configuration: {"RAG enhancement":"W/ RAG"}. This record does not assert independent reproduction.

### Gemini

Accuracy: 95. Result ID: 69dddf7e47f34ce924c4be9d.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca617d0172140ec79dd4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69ddca617d0172140ec79dd4.md>)

Recorded evaluation configuration: {"RAG enhancement":"W/ RAG"}. This record does not assert independent reproduction.

### GPT

Accuracy: 95. Result ID: 69dddf7e47f34ce924c4be9f.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca617d0172140ec79dd4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69ddca617d0172140ec79dd4.md>)

Recorded evaluation configuration: {"RAG enhancement":"W/ RAG"}. This record does not assert independent reproduction.

### DeepSeek

Accuracy: 35. Result ID: 69dddf7e47f34ce924c4be9a.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca617d0172140ec79dd4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69ddca617d0172140ec79dd4.md>)

Recorded evaluation configuration: {"RAG enhancement":"W/O RAG"}. This record does not assert independent reproduction.

### Overall

Accuracy: 23.33. Result ID: 69dddf7e47f34ce924c4bea0.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca617d0172140ec79dd4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69ddca617d0172140ec79dd4.md>)

Recorded evaluation configuration: {"RAG enhancement":"W/O RAG"}. This record does not assert independent reproduction.

### Gemini

Accuracy: 20. Result ID: 69dddf7e47f34ce924c4be9c.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca617d0172140ec79dd4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69ddca617d0172140ec79dd4.md>)

Recorded evaluation configuration: {"RAG enhancement":"W/O RAG"}. This record does not assert independent reproduction.

### GPT

Accuracy: 15. Result ID: 69dddf7e47f34ce924c4be9e.

[Reporting paper](<https://www.sota2.com/research/paper/69ddca617d0172140ec79dd4.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69ddca617d0172140ec79dd4.md>)

Recorded evaluation configuration: {"RAG enhancement":"W/O RAG"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
