# Causal Question Answering on CausalProbe-E Source: [Causal Question Answering on CausalProbe-E]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:41:31.975Z Evaluation of model performance on the CausalProbe-E dataset for Causal Question Answering tasks, typically measured by Exact Match (EM). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Causal Question Answering | | Dataset (including any stated split) | CausalProbe-E | | Metric | EM | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 32 of 32 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [EM](): Higher is better; unit: PERCENT. ## Recorded results | Method | EM | Result date | Report paper | | --- | --- | --- | --- | | G²-Reasoner | 76.2 | Not recorded | 68fa79b31e209131cea7ef6d | | Vanilla | 75.8 | Not recorded | 68fa79b31e209131cea7ef6d | | G²-Reasoner | 75.8 | Not recorded | 68fa79b31e209131cea7ef6d | | RAG | 75.6 | Not recorded | 68fa79b31e209131cea7ef6d | | RAG | 75.6 | Not recorded | 68fa79b31e209131cea7ef6d | | Vanilla | 75.5 | Not recorded | 68fa79b31e209131cea7ef6d | | CoT | 75.3 | Not recorded | 68fa79b31e209131cea7ef6d | | CoT | 75.1 | Not recorded | 68fa79b31e209131cea7ef6d | | G²-Reasoner | 74.7 | Not recorded | 68fa79b31e209131cea7ef6d | | G²-Reasoner | 74.6 | Not recorded | 68fa79b31e209131cea7ef6d | | RAG | 74.3 | Not recorded | 68fa79b31e209131cea7ef6d | | RAG | 74.1 | Not recorded | 68fa79b31e209131cea7ef6d | | CoT | 74 | Not recorded | 68fa79b31e209131cea7ef6d | | CoT | 73.7 | Not recorded | 68fa79b31e209131cea7ef6d | | Vanilla | 73.2 | Not recorded | 68fa79b31e209131cea7ef6d | | Vanilla | 73 | Not recorded | 68fa79b31e209131cea7ef6d | | CoT | 72 | Not recorded | 68fa79b31e209131cea7ef6d | | CoT | 72 | Not recorded | 68fa79b31e209131cea7ef6d | | G²-Reasoner | 71.8 | Not recorded | 68fa79b31e209131cea7ef6d | | G²-Reasoner | 71.8 | Not recorded | 68fa79b31e209131cea7ef6d | | Vanilla | 71.5 | Not recorded | 68fa79b31e209131cea7ef6d | | Vanilla | 71.5 | Not recorded | 68fa79b31e209131cea7ef6d | | RAG | 70.4 | Not recorded | 68fa79b31e209131cea7ef6d | | RAG | 70.4 | Not recorded | 68fa79b31e209131cea7ef6d | | G²-Reasoner | 64.2 | Not recorded | 68fa79b31e209131cea7ef6d | | G²-Reasoner | 64.2 | Not recorded | 68fa79b31e209131cea7ef6d | | CoT | 63.6 | Not recorded | 68fa79b31e209131cea7ef6d | | CoT | 63.6 | Not recorded | 68fa79b31e209131cea7ef6d | | RAG | 62.1 | Not recorded | 68fa79b31e209131cea7ef6d | | RAG | 62.1 | Not recorded | 68fa79b31e209131cea7ef6d | | Vanilla | 61.6 | Not recorded | 68fa79b31e209131cea7ef6d | | Vanilla | 61.6 | Not recorded | 68fa79b31e209131cea7ef6d | ### G²-Reasoner EM: 76.2. Result ID: 698b59957a967eddb76ddc02. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Claude 3 opus","Temperature":"1.0"}. This record does not assert independent reproduction. ### Vanilla EM: 75.8. Result ID: 698c535b37894ef7d9cd8c33. [Reporting paper]() Recorded evaluation configuration: {"Model":"Claude 3"}. This record does not assert independent reproduction. ### G²-Reasoner EM: 75.8. Result ID: 698c535b37894ef7d9cd8c36. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Claude 3"}. This record does not assert independent reproduction. ### RAG EM: 75.6. Result ID: 698b59957a967eddb76ddc01. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Claude 3 opus","Temperature":"1.0"}. This record does not assert independent reproduction. ### RAG EM: 75.6. Result ID: 698c535b37894ef7d9cd8c35. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"Claude 3"}. This record does not assert independent reproduction. ### Vanilla EM: 75.5. Result ID: 698b59957a967eddb76ddbff. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"Claude 3 opus","Temperature":"1.0"}. This record does not assert independent reproduction. ### CoT EM: 75.3. Result ID: 698c535b37894ef7d9cd8c34. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Claude 3"}. This record does not assert independent reproduction. ### CoT EM: 75.1. Result ID: 698b59957a967eddb76ddc00. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Claude 3 opus","Temperature":"1.0"}. This record does not assert independent reproduction. ### G²-Reasoner EM: 74.7. Result ID: 698b59957a967eddb76ddbfe. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"GPT 3.5 turbo","Temperature":"1.0"}. This record does not assert independent reproduction. ### G²-Reasoner EM: 74.6. Result ID: 698c535b37894ef7d9cd8c32. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"GPT 3.5"}. This record does not assert independent reproduction. ### RAG EM: 74.3. Result ID: 698b59957a967eddb76ddbfd. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"GPT 3.5 turbo","Temperature":"1.0"}. This record does not assert independent reproduction. ### RAG EM: 74.1. Result ID: 698c535b37894ef7d9cd8c31. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"GPT 3.5"}. This record does not assert independent reproduction. ### CoT EM: 74. Result ID: 698b59957a967eddb76ddbfc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"GPT 3.5 turbo","Temperature":"1.0"}. This record does not assert independent reproduction. ### CoT EM: 73.7. Result ID: 698c535b37894ef7d9cd8c30. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT 3.5"}. This record does not assert independent reproduction. ### Vanilla EM: 73.2. Result ID: 698c535b37894ef7d9cd8c2f. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT 3.5"}. This record does not assert independent reproduction. ### Vanilla EM: 73. Result ID: 698b59957a967eddb76ddbfb. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"GPT 3.5 turbo","Temperature":"1.0"}. This record does not assert independent reproduction. ### CoT EM: 72. Result ID: 698b59957a967eddb76ddbf8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"LLaMA 3"}. This record does not assert independent reproduction. ### CoT EM: 72. Result ID: 698c535b37894ef7d9cd8c2c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"LLaMA 3 8B"}. This record does not assert independent reproduction. ### G²-Reasoner EM: 71.8. Result ID: 698b59957a967eddb76ddbfa. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"LLaMA 3"}. This record does not assert independent reproduction. ### G²-Reasoner EM: 71.8. Result ID: 698c535b37894ef7d9cd8c2e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"LLaMA 3 8B"}. This record does not assert independent reproduction. ### Vanilla EM: 71.5. Result ID: 698b59957a967eddb76ddbf7. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"LLaMA 3"}. This record does not assert independent reproduction. ### Vanilla EM: 71.5. Result ID: 698c535b37894ef7d9cd8c2b. [Reporting paper]() Recorded evaluation configuration: {"Model":"LLaMA 3 8B"}. This record does not assert independent reproduction. ### RAG EM: 70.4. Result ID: 698b59957a967eddb76ddbf9. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"LLaMA 3"}. This record does not assert independent reproduction. ### RAG EM: 70.4. Result ID: 698c535b37894ef7d9cd8c2d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"LLaMA 3 8B"}. This record does not assert independent reproduction. ### G²-Reasoner EM: 64.2. Result ID: 698b59957a967eddb76ddbf6. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"LLaMA 2"}. This record does not assert independent reproduction. ### G²-Reasoner EM: 64.2. Result ID: 698c535b37894ef7d9cd8c2a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"LLaMA 2 7B"}. This record does not assert independent reproduction. ### CoT EM: 63.6. Result ID: 698b59957a967eddb76ddbf4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"LLaMA 2"}. This record does not assert independent reproduction. ### CoT EM: 63.6. Result ID: 698c535b37894ef7d9cd8c28. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"LLaMA 2 7B"}. This record does not assert independent reproduction. ### RAG EM: 62.1. Result ID: 698b59957a967eddb76ddbf5. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"LLaMA 2"}. This record does not assert independent reproduction. ### RAG EM: 62.1. Result ID: 698c535b37894ef7d9cd8c29. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model":"LLaMA 2 7B"}. This record does not assert independent reproduction. ### Vanilla EM: 61.6. Result ID: 698b59957a967eddb76ddbf3. [Reporting paper]() Recorded evaluation configuration: {"Backbone":"LLaMA 2"}. This record does not assert independent reproduction. ### Vanilla EM: 61.6. Result ID: 698c535b37894ef7d9cd8c27. [Reporting paper]() Recorded evaluation configuration: {"Model":"LLaMA 2 7B"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.