# Causal Question Answering on CausalNet Source: [Causal Question Answering on CausalNet]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:41:31.958Z Evaluation of model performance on the CausalNet dataset for Causal Question Answering tasks, typically measured by Exact Match (EM). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Causal Question Answering | | Dataset (including any stated split) | CausalNet | | Metric | EM | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 32 of 32 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [EM](): Higher is better; unit: PERCENT. ## Recorded results | Method | EM | Result date | Report paper | | --- | --- | --- | --- | | Vanilla | 93.3 | Not recorded | 68fa79b31e209131cea7ef6d | | Vanilla | 93 | Not recorded | 68fa79b31e209131cea7ef6d | | G²-Reasoner | 92.9 | Not recorded | 68fa79b31e209131cea7ef6d | | G²-Reasoner | 92.9 | Not recorded | 68fa79b31e209131cea7ef6d | | RAG | 92.2 | Not recorded | 68fa79b31e209131cea7ef6d | | RAG | 91 | Not recorded | 68fa79b31e209131cea7ef6d | | CoT | 91 | Not recorded | 68fa79b31e209131cea7ef6d | | CoT | 90.7 | Not recorded | 68fa79b31e209131cea7ef6d | | G²-Reasoner | 90.4 | Not recorded | 68fa79b31e209131cea7ef6d | | RAG | 89.8 | Not recorded | 68fa79b31e209131cea7ef6d | | G²-Reasoner | 89.8 | Not recorded | 68fa79b31e209131cea7ef6d | | Vanilla | 89.7 | Not recorded | 68fa79b31e209131cea7ef6d | | Vanilla | 89.5 | Not recorded | 68fa79b31e209131cea7ef6d | | RAG | 89.4 | Not recorded | 68fa79b31e209131cea7ef6d | | CoT | 87.4 | Not recorded | 68fa79b31e209131cea7ef6d | | CoT | 87.2 | Not recorded | 68fa79b31e209131cea7ef6d | | RAG | 86 | Not recorded | 68fa79b31e209131cea7ef6d | | RAG | 86 | Not recorded | 68fa79b31e209131cea7ef6d | | Vanilla | 85.7 | Not recorded | 68fa79b31e209131cea7ef6d | | Vanilla | 85.7 | Not recorded | 68fa79b31e209131cea7ef6d | | G²-Reasoner | 85.5 | Not recorded | 68fa79b31e209131cea7ef6d | | G²-Reasoner | 85.5 | Not recorded | 68fa79b31e209131cea7ef6d | | CoT | 76.7 | Not recorded | 68fa79b31e209131cea7ef6d | | CoT | 76.7 | Not recorded | 68fa79b31e209131cea7ef6d | | G²-Reasoner | 68.1 | Not recorded | 68fa79b31e209131cea7ef6d | | G²-Reasoner | 68.1 | Not recorded | 68fa79b31e209131cea7ef6d | | Vanilla | 67.3 | Not recorded | 68fa79b31e209131cea7ef6d | | Vanilla | 67.3 | Not recorded | 68fa79b31e209131cea7ef6d | | CoT | 66.6 | Not recorded | 68fa79b31e209131cea7ef6d | | CoT | 66.6 | Not recorded | 68fa79b31e209131cea7ef6d | | RAG | 65 | Not recorded | 68fa79b31e209131cea7ef6d | | RAG | 65 | Not recorded | 68fa79b31e209131cea7ef6d | ### Vanilla EM: 93.3. Result ID: 698c535b37894ef7d9cd8c23. [Reporting paper]() Recorded evaluation configuration: {"Model":"Claude 3"}. This record does not assert independent reproduction. ### Vanilla EM: 93. Result ID: 698b59957a967eddb76ddbef. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Claude 3 opus","Temperature":"1.0"}. This record does not assert independent reproduction. ### G²-Reasoner EM: 92.9. Result ID: 698b59957a967eddb76ddbf2. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Claude 3 opus","Temperature":"1.0"}. This record does not assert independent reproduction. ### G²-Reasoner EM: 92.9. Result ID: 698c535b37894ef7d9cd8c26. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Claude 3"}. This record does not assert independent reproduction. ### RAG EM: 92.2. Result ID: 698c535b37894ef7d9cd8c25. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Claude 3"}. This record does not assert independent reproduction. ### RAG EM: 91. Result ID: 698b59957a967eddb76ddbf1. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Claude 3 opus","Temperature":"1.0"}. This record does not assert independent reproduction. ### CoT EM: 91. Result ID: 698c535b37894ef7d9cd8c24. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Claude 3"}. This record does not assert independent reproduction. ### CoT EM: 90.7. Result ID: 698b59957a967eddb76ddbf0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Claude 3 opus","Temperature":"1.0"}. This record does not assert independent reproduction. ### G²-Reasoner EM: 90.4. Result ID: 698b59957a967eddb76ddbee. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"GPT 3.5 turbo","Temperature":"1.0"}. This record does not assert independent reproduction. ### RAG EM: 89.8. Result ID: 698c535b37894ef7d9cd8c21. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"GPT 3.5"}. This record does not assert independent reproduction. ### G²-Reasoner EM: 89.8. Result ID: 698c535b37894ef7d9cd8c22. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"GPT 3.5"}. This record does not assert independent reproduction. ### Vanilla EM: 89.7. Result ID: 698c535b37894ef7d9cd8c1f. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT 3.5"}. This record does not assert independent reproduction. ### Vanilla EM: 89.5. Result ID: 698b59957a967eddb76ddbeb. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"GPT 3.5 turbo","Temperature":"1.0"}. This record does not assert independent reproduction. ### RAG EM: 89.4. Result ID: 698b59957a967eddb76ddbed. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"GPT 3.5 turbo","Temperature":"1.0"}. This record does not assert independent reproduction. ### CoT EM: 87.4. Result ID: 698c535b37894ef7d9cd8c20. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT 3.5"}. This record does not assert independent reproduction. ### CoT EM: 87.2. Result ID: 698b59957a967eddb76ddbec. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"GPT 3.5 turbo","Temperature":"1.0"}. This record does not assert independent reproduction. ### RAG EM: 86. Result ID: 698b59957a967eddb76ddbe9. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"LLaMA 3"}. This record does not assert independent reproduction. ### RAG EM: 86. Result ID: 698c535b37894ef7d9cd8c1d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"LLaMA 3 8B"}. This record does not assert independent reproduction. ### Vanilla EM: 85.7. Result ID: 698b59957a967eddb76ddbe7. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"LLaMA 3"}. This record does not assert independent reproduction. ### Vanilla EM: 85.7. Result ID: 698c535b37894ef7d9cd8c1b. [Reporting paper]() Recorded evaluation configuration: {"Model":"LLaMA 3 8B"}. This record does not assert independent reproduction. ### G²-Reasoner EM: 85.5. Result ID: 698b59957a967eddb76ddbea. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"LLaMA 3"}. This record does not assert independent reproduction. ### G²-Reasoner EM: 85.5. Result ID: 698c535b37894ef7d9cd8c1e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"LLaMA 3 8B"}. This record does not assert independent reproduction. ### CoT EM: 76.7. Result ID: 698b59957a967eddb76ddbe8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"LLaMA 3"}. This record does not assert independent reproduction. ### CoT EM: 76.7. Result ID: 698c535b37894ef7d9cd8c1c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"LLaMA 3 8B"}. This record does not assert independent reproduction. ### G²-Reasoner EM: 68.1. Result ID: 698b59957a967eddb76ddbe6. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"LLaMA 2"}. This record does not assert independent reproduction. ### G²-Reasoner EM: 68.1. Result ID: 698c535b37894ef7d9cd8c1a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"LLaMA 2 7B"}. This record does not assert independent reproduction. ### Vanilla EM: 67.3. Result ID: 698b59957a967eddb76ddbe3. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"LLaMA 2"}. This record does not assert independent reproduction. ### Vanilla EM: 67.3. Result ID: 698c535b37894ef7d9cd8c17. [Reporting paper]() Recorded evaluation configuration: {"Model":"LLaMA 2 7B"}. This record does not assert independent reproduction. ### CoT EM: 66.6. Result ID: 698b59957a967eddb76ddbe4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"LLaMA 2"}. This record does not assert independent reproduction. ### CoT EM: 66.6. Result ID: 698c535b37894ef7d9cd8c18. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"LLaMA 2 7B"}. This record does not assert independent reproduction. ### RAG EM: 65. Result ID: 698b59957a967eddb76ddbe5. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"LLaMA 2"}. This record does not assert independent reproduction. ### RAG EM: 65. Result ID: 698c535b37894ef7d9cd8c19. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"LLaMA 2 7B"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.