# KG^2: Learning to Reason Science Exam Questions with Contextual Knowledge Graph Embeddings

Source: [KG^2: Learning to Reason Science Exam Questions with Contextual Knowledge Graph Embeddings](<https://www.sota2.com/research/paper/68fa646b1e209131cea049a5>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T21:04:03.574Z

Authors: Yuyu Zhang, Hanjun Dai, Kamil Toraman, Le Song

Published: 2018-05-31T09:39:14.000Z

## Abstract

The AI2 Reasoning Challenge (ARC), a new benchmark dataset for question answering (QA) has been recently released. ARC only contains natural science questions authored for human exams, which are hard to answer and require advanced logic reasoning. On the ARC Challenge Set, existing state-of-the-art QA systems fail to significantly outperform random baseline, reflecting the difficult nature of this task. In this paper, we propose a novel framework for answering science exam questions, which mimics human solving process in an open-book exam. To address the reasoning challenge, we construct contextual knowledge graphs respectively for the question itself and supporting sentences. Our model learns to reason with neural embeddings of both knowledge graphs. Experiments on the ARC Challenge Set show that our model outperforms the previous state-of-the-art QA systems.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/1805.12393>)

[PDF](<https://arxiv.org/pdf/1805.12393.pdf>)
