Argument Role Extraction on M2E2 multimedia
55F1 ScoreECHO
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ECHOBackbone=DeepSeek-V3.22026.03 | 55 | 47.2 | 65.8 | |
| ECHOBackbone=Qwen3-32B2026.03 | 54.9 | 49.8 | 61.2 | |
| ECHOBackbone=Qwen3-14B2026.03 | 53.3 | 48.6 | 59 | |
| ECHOBackbone=GPT-52026.03 | 52.5 | 44.8 | 63.5 | |
| ECHOBackbone=Qwen3-8B2026.03 | 52.3 | 47 | 58.9 | |
| RMPL (Mc)Backbone=Qwen3-VL-8B2026.02 | 46.9 | 49.6 | 44.6 | |
| RMPL (Mb)Backbone=InternVL3_5-8B2026.02 | 45.8 | 42.4 | 49.9 | |
| RMPL (Ma)Backbone=Qwen2-VL-7B2026.02 | 45.2 | 42.9 | 47.7 | |
| KE-MME2026.02 | 44.3 | 48.1 | 43.9 | |
| X-MTL2026.02 | 41.4 | 40.3 | 42.6 | |
| X-MTL2026.03 | 41.4 | 40.3 | 42.6 | |
| SSGPF2026.02 | 36 | 33.8 | 38.5 | |
| CAMEL2026.02 | 33.2 | 31.4 | 35.1 | |
| CAMEL2026.03 | 33.2 | 31.4 | 35.1 | |
| MMUTF2026.02 | 27.4 | 39.9 | 20.8 | |
| MMUTF2026.03 | 27.4 | 39.9 | 20.8 | |
| MGIM2026.02 | 24.6 | 25.2 | 21.7 | |
| UMIE2026.02 | 24.5 | — | — | |
| UMIE2026.03 | 24.5 | — | — | |
| UniCL2026.02 | 23.4 | 24.3 | 22.6 | |
| UniCL2026.03 | 23.4 | 24.3 | 22.6 | |
| FSMEE2026.02 | 21.2 | 20.6 | 21.9 | |
| WASE_att2026.02 | 19.9 | 18.6 | 21.6 | |
| WASE-att2026.03 | 19.9 | 18.6 | 21.6 | |
| WASE_obj2026.02 | 19.2 | 19.5 | 18.9 | |
| WASE-obj2026.03 | 19.2 | 19.5 | 18.9 | |
| FLAT2026.02 | 14.9 | 12.9 | 17.6 | |
| Flat2026.03 | 14.9 | 12.9 | 17.6 |