# Event Causal Identification on EventStoryLine Source: [Event Causal Identification on EventStoryLine]() Collection index: [llms.txt]() Data updated: 2026-04-15T09:42:47.041Z Evaluation of model performance on Event Causal Identification using the EventStoryLine dataset, measured by CHR and mAcc. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Event Causal Identification | | Dataset (including any stated split) | EventStoryLine | | Metric | CHR | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 17 of 17 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [CHR](): Higher is better; unit: PERCENT. - [Mean Accuracy](): Higher is better; unit: PERCENT. ## Recorded results | Method | CHR | Result date | Report paper | | --- | --- | --- | --- | | Dr.ECI | 100 | Not recorded | 69df1bbe7d0172140ec7bb0d | | Qwen2.5-1.5B | 83.54 | Not recorded | 69df1bbe7d0172140ec7bb0d | | MRBalance | 82.45 | Not recorded | 69df1bbe7d0172140ec7bb0d | | Llama3.2-1B | 76.43 | Not recorded | 69df1bbe7d0172140ec7bb0d | | Qwen2.5-1.5B | 69.77 | Not recorded | 69df1bbe7d0172140ec7bb0d | | Qwen2.5-1.5B | 69.57 | Not recorded | 69df1bbe7d0172140ec7bb0d | | Qwen2.5-1.5B | 66.67 | Not recorded | 69df1bbe7d0172140ec7bb0d | | Llama3.1-8B | 60.59 | Not recorded | 69df1bbe7d0172140ec7bb0d | | Llama3.2-1B | 60.43 | Not recorded | 69df1bbe7d0172140ec7bb0d | | Qwen3-30B-A3B | 60.27 | Not recorded | 69df1bbe7d0172140ec7bb0d | | Llama3.2-1B | 58.42 | Not recorded | 69df1bbe7d0172140ec7bb0d | | Llama3.2-1B | 56.55 | Not recorded | 69df1bbe7d0172140ec7bb0d | | GPT4 | 53.3 | Not recorded | 69df1bbe7d0172140ec7bb0d | | MuTQA | 46.03 | Not recorded | 69df1bbe7d0172140ec7bb0d | | GPT3.5-turbo | 43.43 | Not recorded | 69df1bbe7d0172140ec7bb0d | | Llama3.2-1B | 9.14 | Not recorded | 69df1bbe7d0172140ec7bb0d | | Qwen2.5-1.5B | 6.26 | Not recorded | 69df1bbe7d0172140ec7bb0d | ### Dr.ECI CHR: 100. Result ID: 69df5d5a47f34ce924c87f61. [Reporting paper]() Recorded evaluation configuration: {"mode":"Not specified"}. This record does not assert independent reproduction. ### Qwen2.5-1.5B CHR: 83.54. Result ID: 69df5d5a47f34ce924c87f64. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"Vanilla (original model)"}. This record does not assert independent reproduction. ### MRBalance CHR: 82.45. Result ID: 69df5d5a47f34ce924c87f63. [Reporting paper]() Recorded evaluation configuration: {"mode":"Not specified"}. This record does not assert independent reproduction. ### Llama3.2-1B CHR: 76.43. Result ID: 69df5d5a47f34ce924c87f69. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"Vanilla (original model)"}. This record does not assert independent reproduction. ### Qwen2.5-1.5B CHR: 69.77. Result ID: 69df5d5a47f34ce924c87f65. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"Zero-shot CoT prompting"}. This record does not assert independent reproduction. ### Qwen2.5-1.5B CHR: 69.57. Result ID: 69df5d5a47f34ce924c87f66. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"In-context learning"}. This record does not assert independent reproduction. ### Qwen2.5-1.5B CHR: 66.67. Result ID: 69df5d5a47f34ce924c87f67. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"Fine-tuning with binary labels"}. This record does not assert independent reproduction. ### Llama3.1-8B CHR: 60.59. Result ID: 69df5d5a47f34ce924c87f5f. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"mode":"Not specified"}. This record does not assert independent reproduction. ### Llama3.2-1B CHR: 60.43. Result ID: 69df5d5a47f34ce924c87f6a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"Zero-shot CoT prompting"}. This record does not assert independent reproduction. ### Qwen3-30B-A3B CHR: 60.27. Result ID: 69df5d5a47f34ce924c87f60. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"Not specified"}. This record does not assert independent reproduction. ### Llama3.2-1B CHR: 58.42. Result ID: 69df5d5a47f34ce924c87f6b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"In-context learning"}. This record does not assert independent reproduction. ### Llama3.2-1B CHR: 56.55. Result ID: 69df5d5a47f34ce924c87f6c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"Fine-tuning with binary labels"}. This record does not assert independent reproduction. ### GPT4 CHR: 53.3. Result ID: 69df5d5a47f34ce924c87f5e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"mode":"Not specified"}. This record does not assert independent reproduction. ### MuTQA CHR: 46.03. Result ID: 69df5d5a47f34ce924c87f62. [Reporting paper]() Recorded evaluation configuration: {"mode":"Not specified"}. This record does not assert independent reproduction. ### GPT3.5-turbo CHR: 43.43. Result ID: 69df5d5a47f34ce924c87f5d. [Reporting paper]() Recorded evaluation configuration: {"mode":"Not specified"}. This record does not assert independent reproduction. ### Llama3.2-1B CHR: 9.14. Result ID: 69df5d5a47f34ce924c87f6d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"Fine-tuning using CoT trace data (Our)"}. This record does not assert independent reproduction. ### Qwen2.5-1.5B CHR: 6.26. Result ID: 69df5d5a47f34ce924c87f68. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"mode":"Fine-tuning using CoT trace data (Our)"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.