Event Mention Extraction on M2E2 Visual Events
82.1F1 ScoreECHO
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ECHOBackbone=GPT-52026.03 | 82.1 | 82.4 | 81.9 | |
| ECHOBackbone=DeepSeek-V3.22026.03 | 82.1 | 82.4 | 81.9 | |
| ECHOBackbone=Qwen3-32B2026.03 | 80.3 | 80.3 | 80.3 | |
| ECHOBackbone=Qwen3-8B2026.03 | 78.4 | 78.6 | 78.2 | |
| ECHOBackbone=Qwen3-14B2026.03 | 77.7 | 77.7 | 77.7 | |
| X-MTL2026.03 | 71.7 | 73.1 | 70.3 | |
| UMIE2026.03 | 62.1 | — | — | |
| CAMEL2026.03 | 58.5 | 52.1 | 66.8 | |
| UniCL2026.03 | 57.6 | 54.6 | 60.9 | |
| MMUTF2026.03 | 57 | 55.1 | 59.1 | |
| CLIP-Event2026.03 | 52.7 | 41.3 | 72.8 | |
| WASE-obj2026.03 | 49.9 | 43.1 | 59.2 | |
| WASE-att2026.03 | 42.8 | 32.3 | 63.4 | |
| WASE-V_att2026.03 | 40.1 | 29.7 | 61.9 | |
| WASE-V_obj2026.03 | 38.7 | 28.6 | 59.2 | |
| Flat2026.03 | 36.7 | 27.1 | 57.3 |