# KE Identification on AOP-Wiki structured question answering set (test) Source: [KE Identification on AOP-Wiki structured question answering set (test)]() Collection index: [llms.txt]() Data updated: 2026-04-14T06:40:27.645Z Evaluation of Knowledge Element (KE) Identification performance on the test split of the AOP-Wiki structured question answering dataset, reporting accuracy. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | KE Identification | | Dataset (including any stated split) | AOP-Wiki structured question answering set (test) | | Metric | Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 16 of 16 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy](): Higher is better; unit: PERCENT. ## Recorded results | Method | Accuracy | Result date | Report paper | | --- | --- | --- | --- | | DeepSeek | 100 | Not recorded | 69ddca617d0172140ec79dd4 | | Gemini | 100 | Not recorded | 69ddca617d0172140ec79dd4 | | GPT | 100 | Not recorded | 69ddca617d0172140ec79dd4 | | Overall | 100 | Not recorded | 69ddca617d0172140ec79dd4 | | DeepSeek | 100 | Not recorded | 69ddca617d0172140ec79dd4 | | GPT | 100 | Not recorded | 69ddca617d0172140ec79dd4 | | Overall | 93.33 | Not recorded | 69ddca617d0172140ec79dd4 | | DeepSeek | 80 | Not recorded | 69ddca617d0172140ec79dd4 | | Gemini | 80 | Not recorded | 69ddca617d0172140ec79dd4 | | Overall | 66.67 | Not recorded | 69ddca617d0172140ec79dd4 | | Gemini | 60 | Not recorded | 69ddca617d0172140ec79dd4 | | GPT | 60 | Not recorded | 69ddca617d0172140ec79dd4 | | DeepSeek | 20 | Not recorded | 69ddca617d0172140ec79dd4 | | Overall | 6.67 | Not recorded | 69ddca617d0172140ec79dd4 | | Gemini | 0 | Not recorded | 69ddca617d0172140ec79dd4 | | GPT | 0 | Not recorded | 69ddca617d0172140ec79dd4 | ### DeepSeek Accuracy: 100. Result ID: 69dddf7e47f34ce924c4be7b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"RAG enhancement":"W/ RAG"}. This record does not assert independent reproduction. ### Gemini Accuracy: 100. Result ID: 69dddf7e47f34ce924c4be7d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"RAG enhancement":"W/ RAG"}. This record does not assert independent reproduction. ### GPT Accuracy: 100. Result ID: 69dddf7e47f34ce924c4be7f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"RAG enhancement":"W/ RAG"}. This record does not assert independent reproduction. ### Overall Accuracy: 100. Result ID: 69dddf7e47f34ce924c4be81. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"RAG enhancement":"W/ RAG"}. This record does not assert independent reproduction. ### DeepSeek Accuracy: 100. Result ID: 69dddf7e47f34ce924c4be8b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"RAG enhancement":"W/ RAG"}. This record does not assert independent reproduction. ### GPT Accuracy: 100. Result ID: 69dddf7e47f34ce924c4be8f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"RAG enhancement":"W/ RAG"}. This record does not assert independent reproduction. ### Overall Accuracy: 93.33. Result ID: 69dddf7e47f34ce924c4be91. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"RAG enhancement":"W/ RAG"}. This record does not assert independent reproduction. ### DeepSeek Accuracy: 80. Result ID: 69dddf7e47f34ce924c4be7a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"RAG enhancement":"W/O RAG"}. This record does not assert independent reproduction. ### Gemini Accuracy: 80. Result ID: 69dddf7e47f34ce924c4be8d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"RAG enhancement":"W/ RAG"}. This record does not assert independent reproduction. ### Overall Accuracy: 66.67. Result ID: 69dddf7e47f34ce924c4be80. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"RAG enhancement":"W/O RAG"}. This record does not assert independent reproduction. ### Gemini Accuracy: 60. Result ID: 69dddf7e47f34ce924c4be7c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"RAG enhancement":"W/O RAG"}. This record does not assert independent reproduction. ### GPT Accuracy: 60. Result ID: 69dddf7e47f34ce924c4be7e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"RAG enhancement":"W/O RAG"}. This record does not assert independent reproduction. ### DeepSeek Accuracy: 20. Result ID: 69dddf7e47f34ce924c4be8a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"RAG enhancement":"W/O RAG"}. This record does not assert independent reproduction. ### Overall Accuracy: 6.67. Result ID: 69dddf7e47f34ce924c4be90. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"RAG enhancement":"W/O RAG"}. This record does not assert independent reproduction. ### Gemini Accuracy: 0. Result ID: 69dddf7e47f34ce924c4be8c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"RAG enhancement":"W/O RAG"}. This record does not assert independent reproduction. ### GPT Accuracy: 0. Result ID: 69dddf7e47f34ce924c4be8e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"RAG enhancement":"W/O RAG"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.