Grounding on E.T. Bench
62.5TVG F1MeCo (ETChat 7B)
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| MeCo (ETChat 7B)SFT Data=164K, Epochs=1, LoRA=true, Backbone=QWen2-7B2025.03 | 62.5 | 15.4 | 35.1 | 35.1 | 66.3 | |
| MeCo (ETChat 3.8B)SFT Data=164K, Epochs=1, LoRA=true, Backbone=Phi-3-Mini-3.8B2025.03 | 59.1 | 11.2 | 32.6 | 33.2 | 66.9 | |
| MeCo (QWen2VL 7B)SFT Data=164K, Epochs=1, LoRA=true, Backbone=QWen2-VL-7B2025.03 | 59 | 17.5 | 34.2 | 35.5 | 67.9 | |
| TRACE (7B)SFT Data=900K, Epochs=2, LoRA=false, Setting=Original temporal localization setting2025.03 | 44.3 | 11.1 | 19.1 | 27.4 | 65.9 | |
| Dispider (7b)SFT Data=639K, Epochs=1, LoRA=false, Setting=Original temporal localization setting2025.03 | 43.6 | 17.2 | 29.9 | — | 51.5 | |
| QWen2-VL (7B)Fine-tuned by=Yuan et al. (2025)2025.03 | 39.7 | 7 | 26.9 | 17.1 | 66.9 | |
| Tarsier (7B)Fine-tuned by=Yuan et al. (2025)2025.03 | 39.6 | 9 | 25 | 25.4 | 47.6 | |
| E.T.Chat (3.8B)SFT Data=164K, Epochs=1, LoRA=true, Setting=Original temporal localization setting2025.03 | 38.6 | 10.2 | 30.8 | 25.4 | 62.5 | |
| Tarsier2 (7B)Fine-tuned by=Yuan et al. (2025)2025.03 | 38.4 | 11 | 31.8 | 19.4 | 66.8 | |
| TimeChat (7B)SFT Data=198K, Epochs=3, LoRA=true, Setting=Original temporal localization setting2025.03 | 26.2 | 3.9 | 10.1 | 29.1 | 40.5 | |
| TimeChat (7B)SFT Data=164K, Epochs=1, LoRA=true, Setting=Fine-tuned on E.T.Instruct (Self-implemented)2025.03 | 24.3 | 2.3 | 17.7 | 23.6 | 43 | |
| LITA (13B)SFT Data=500K, Epochs=1, LoRA=false, Setting=Original temporal localization setting2025.03 | 22.2 | 4.6 | 18 | 29.7 | 23.9 | |
| VTG-LLM (7B)SFT Data=164K, Epochs=1, LoRA=true, Setting=Fine-tuned on E.T.Instruct (Self-implemented)2025.03 | 20 | 1.5 | 17.6 | 19.5 | 41.6 | |
| TRACE (7B)SFT Data=164K, Epochs=1, LoRA=true, Setting=Fine-tuned on E.T.Instruct (Self-implemented)2025.03 | 18.5 | 2.2 | 22.3 | 26.7 | 38.2 | |
| VTG-LLM (7B)SFT Data=217K, Epochs=10, LoRA=true, Setting=Original temporal localization setting2025.03 | 15.9 | 3.7 | 14.4 | — | 26.8 | |
| VTimeLLM (7B)SFT Data=142K, Epochs=2, LoRA=true, Setting=Original temporal localization setting2025.03 | 7.6 | 1.9 | 18.2 | 15.9 | 28.9 | |
| Video-ChatGPT (7B)Setting=Zero-shot baseline2025.03 | 7 | 1.3 | 15.1 | 8.4 | 28.8 | |
| Video-LLaVA (7B)Setting=Zero-shot baseline2025.03 | 7 | 1.9 | 15 | 0.3 | 28.9 | |
| PLLaVA (7B)Setting=Zero-shot baseline2025.03 | 6.9 | 1.1 | 5.7 | 0.3 | 28.9 | |
| Video-LLaMA-2 (7B)Setting=Zero-shot baseline2025.03 | 0.1 | 0 | 0 | 0 | 1.5 |