# Event Mention Extraction on M2E2 Visual Events Source: [Event Mention Extraction on M2E2 Visual Events]() Collection index: [llms.txt]() Data updated: 2026-03-10T07:52:33.629Z Evaluation of Event Mention Extraction performance on the Visual Events version of the M2E2 dataset, typically measured using Precision, Recall, and F1 scores. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Event Mention Extraction | | Dataset (including any stated split) | M2E2 Visual Events | | Metric | F1 Score | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 16 of 16 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [F1 Score](): Higher is better; unit: PERCENT. - [Precision](): Higher is better; unit: PERCENT. - [Recall](): Higher is better; unit: PERCENT. ## Recorded results | Method | F1 Score | Result date | Report paper | | --- | --- | --- | --- | | ECHO | 82.1 | Not recorded | 69afa57f2d603e6de3e439f7 | | ECHO | 82.1 | Not recorded | 69afa57f2d603e6de3e439f7 | | ECHO | 80.3 | Not recorded | 69afa57f2d603e6de3e439f7 | | ECHO | 78.4 | Not recorded | 69afa57f2d603e6de3e439f7 | | ECHO | 77.7 | Not recorded | 69afa57f2d603e6de3e439f7 | | X-MTL | 71.7 | Not recorded | 69afa57f2d603e6de3e439f7 | | UMIE | 62.1 | Not recorded | 69afa57f2d603e6de3e439f7 | | CAMEL | 58.5 | Not recorded | 69afa57f2d603e6de3e439f7 | | UniCL | 57.6 | Not recorded | 69afa57f2d603e6de3e439f7 | | MMUTF | 57 | Not recorded | 69afa57f2d603e6de3e439f7 | | CLIP-Event | 52.7 | Not recorded | 69afa57f2d603e6de3e439f7 | | WASE-obj | 49.9 | Not recorded | 69afa57f2d603e6de3e439f7 | | WASE-att | 42.8 | Not recorded | 69afa57f2d603e6de3e439f7 | | WASE-V\_att | 40.1 | Not recorded | 69afa57f2d603e6de3e439f7 | | WASE-V\_obj | 38.7 | Not recorded | 69afa57f2d603e6de3e439f7 | | Flat | 36.7 | Not recorded | 69afa57f2d603e6de3e439f7 | ### ECHO F1 Score: 82.1. Result ID: 69afcda56dbb7075b957ea8a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"GPT-5"}. This record does not assert independent reproduction. ### ECHO F1 Score: 82.1. Result ID: 69afcda56dbb7075b957ea8b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"DeepSeek-V3.2"}. This record does not assert independent reproduction. ### ECHO F1 Score: 80.3. Result ID: 69afcda56dbb7075b957ea89. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-32B"}. This record does not assert independent reproduction. ### ECHO F1 Score: 78.4. Result ID: 69afcda56dbb7075b957ea87. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-8B"}. This record does not assert independent reproduction. ### ECHO F1 Score: 77.7. Result ID: 69afcda56dbb7075b957ea88. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen3-14B"}. This record does not assert independent reproduction. ### X-MTL F1 Score: 71.7. Result ID: 69afcda56dbb7075b957ea86. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### UMIE F1 Score: 62.1. Result ID: 69afcda56dbb7075b957ea83. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### CAMEL F1 Score: 58.5. Result ID: 69afcda56dbb7075b957ea85. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### UniCL F1 Score: 57.6. Result ID: 69afcda56dbb7075b957ea82. [Reporting paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### MMUTF F1 Score: 57. Result ID: 69afcda56dbb7075b957ea84. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### CLIP-Event F1 Score: 52.7. Result ID: 69afcda56dbb7075b957ea81. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### WASE-obj F1 Score: 49.9. Result ID: 69afcda56dbb7075b957ea80. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### WASE-att F1 Score: 42.8. Result ID: 69afcda56dbb7075b957ea7f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### WASE-V\_att F1 Score: 40.1. Result ID: 69afcda56dbb7075b957ea7d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### WASE-V\_obj F1 Score: 38.7. Result ID: 69afcda56dbb7075b957ea7e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Flat F1 Score: 36.7. Result ID: 69afcda56dbb7075b957ea7c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.