Grounded Multimodal Named Entity Recognition on Twitter-FMNERG
100Avg. SR (%)VKEL
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| VKELCategory=External Knowledge Exploration, E2E=false, Using LLM=LLaVA-1.5-7B2026.04 | 100 | 57.44 | 72.59 | 68.46 | |
| Qwen2.5-VL-7B (MoRE)*Category=External Knowledge Exploration, E2E=false, Using LLM=Qwen2.5-VL-7B2026.04 | 100 | 58.37 | 69.14 | 72.38 | |
| MAKARCategory=LLM Agent, E2E=false, Using LLM=Qwen2.5-VL-7B2026.04 | 100 | 60.54 | 71.24 | 75.66 | |
| SAKECategory=LLM Agent, E2E=true, Using LLM=Qwen2.5-VL-7B2026.04 | 68.8 | 63.45 | 73.37 | 77.12 | |
| GPT4oCategory=Few-shot MLLM, E2E=false, Using LLM=GPT4o2026.04 | 0 | 32.37 | 52.26 | 41.6 | |
| Gemini-2.5 ProCategory=Few-shot MLLM, E2E=false, Using LLM=Gemini-2.5 Pro2026.04 | 0 | 34.02 | 51.14 | 45.89 | |
| Qwen3-VL-PlusCategory=Few-shot MLLM, E2E=false, Using LLM=Qwen3-VL-Plus2026.04 | 0 | 31.43 | 48.57 | 47.04 | |
| UMT-OD-EVGCategory=Supervised Fine-tuning, E2E=false2026.04 | 0 | 41.32 | 61.63 | 54.43 | |
| UMGF-OD-EVGCategory=Supervised Fine-tuning, E2E=false2026.04 | 0 | 41.92 | 61.79 | 54.75 | |
| ITA-OD-EVGCategory=Supervised Fine-tuning, E2E=false2026.04 | 0 | 42.78 | 63.21 | 57.26 | |
| MMT5 / BART-OD-EVGCategory=Supervised Fine-tuning, E2E=false2026.04 | 0 | 45.21 | 66.61 | 58.18 | |
| H-IndexCategory=Supervised Fine-tuning, E2E=true2026.04 | 0 | 46.55 | 64.84 | 60.46 | |
| TIGERCategory=Supervised Fine-tuning, E2E=true2026.04 | 0 | 47.2 | 64.91 | 61.96 | |
| MQSPNCategory=Supervised Fine-tuning, E2E=true2026.04 | 0 | 47.86 | 66.83 | 61.95 | |
| Qwen2.5-VL-7B (SFT)*Category=Supervised Fine-tuning, E2E=true, Using LLM=Qwen2.5-VL-7B2026.04 | 0 | 58.2 | 68.93 | 72.01 | |
| GEMCategory=Internal Knowledge Exploitation, E2E=false, Using LLM=ChatGPT2026.04 | 0 | 52.48 | 70.8 | 65.52 | |
| UnCoCategory=Internal Knowledge Exploitation, E2E=false, Using LLM=Gemini-2.5 Pro2026.04 | 0 | 53.56 | 67.7 | 68.25 | |
| Qwen2.5-VL-7B (SFT+GRPO)*Category=Internal Knowledge Exploitation, E2E=true, Using LLM=Qwen2.5-VL-7B2026.04 | 0 | 59.91 | 69.57 | 73.8 |