Emotion Understanding and Analysis on HitEmotion
59.21DPTM (MF)Gemini-2.5-Pro
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Gemini-2.5-ProCategory=Closed Source, ToM prompt=true2026.02 | 59.21 | 28.68 | 71.83 | 77.2 | 75.43 | 44.47 | 73.79 | 58.9 | |
| Gemini-2.5-FlashCategory=Closed Source, ToM prompt=true2026.02 | 56.35 | 24.87 | 65.74 | 72.63 | 73.21 | 38.12 | 61.83 | 55.56 | |
| TMPOCategory=Ours, Training=GRPO2026.02 | 56.23 | 32.82 | 78.64 | 73.39 | 78.16 | 45.68 | 71.56 | 61.08 | |
| GPT-4.1Category=Closed Source, ToM prompt=true2026.02 | 49.47 | 27.65 | 78 | 72.91 | 77.7 | 40.91 | 66.18 | 57.85 | |
| Gemini-2.5-ProCategory=Closed Source, ToM prompt=false2026.02 | 49.23 | 19.25 | 69.39 | 70.67 | 67.61 | 39.23 | 64.95 | 52.65 | |
| GPT-4.1Category=Closed Source, ToM prompt=false2026.02 | 47.5 | 18.62 | 70.19 | 67.68 | 70.81 | 37.98 | 65.76 | 53.82 | |
| Gemini-2.5-FlashCategory=Closed Source, ToM prompt=false2026.02 | 47.18 | 16.34 | 64.66 | 64.14 | 66.71 | 36.55 | 57.65 | 51.41 | |
| TMPOCategory=Ours, Training=SFT2026.02 | 46.42 | 23.11 | 68.4 | 64.18 | 69.47 | 37.24 | 60.45 | 51.83 | |
| GPT-4oCategory=Closed Source, ToM prompt=true2026.02 | 45.9 | 25.7 | 66.63 | 71.19 | 68.3 | 36.45 | 61.04 | 53.72 | |
| GPT-4oCategory=Closed Source, ToM prompt=false2026.02 | 42.33 | 17.45 | 60 | 66.13 | 64.76 | 35.32 | 55.76 | 49.68 | |
| InternVL3-38BCategory=Open Source2026.02 | 40.55 | 16.49 | 59.25 | 64.74 | 64.8 | 32.64 | 53.85 | 46 | |
| Qwen2.5-VL-32BCategory=Open Source2026.02 | 40.22 | 14.62 | 57.5 | 62.67 | 63.29 | 32.38 | 52.08 | 48.2 | |
| Emotion-LLaMA-7BCategory=Open Source2026.02 | 39.54 | 15.46 | 57.92 | 52.08 | 60.13 | 34.18 | 44.15 | 47.59 | |
| R1-Omni-0.5BCategory=Open Source2026.02 | 37.54 | 13.45 | 46.25 | 50.03 | 58.4 | 29.58 | 47.85 | 29.81 | |
| InternVL3-8BCategory=Open Source2026.02 | 36.77 | 14.79 | 53.5 | 60.13 | 63.11 | 33.13 | 50.9 | 39.48 | |
| HumanOmni-7BCategory=Open Source2026.02 | 35.59 | 12.55 | 49.5 | 53.5 | 59.89 | 32.98 | 47.9 | 36.2 | |
| AffectGPT-7BCategory=Open Source2026.02 | 34.17 | 12.27 | 56.5 | 40.07 | 60.48 | 30.95 | 42.4 | 37.92 | |
| Qwen2.5-Omni-7BCategory=Open Source2026.02 | 31.63 | 11.42 | 53 | 55.79 | 61.93 | 31.09 | 44.65 | 37.68 | |
| LLaVA-One-Vision-7BCategory=Open Source2026.02 | 31.54 | 11.33 | 42.25 | 60.37 | 63.89 | 14.02 | 39.75 | 33 | |
| Qwen2.5-VL-7BCategory=Open Source2026.02 | 31.41 | 11.02 | 54.25 | 64.49 | 64.65 | 32.59 | 52.55 | 45.6 | |
| LLaVA-NeXT-Video-7BCategory=Open Source2026.02 | 31.28 | 12.37 | 43.5 | 40.5 | 59.4 | 13.45 | 44.75 | 25.25 | |
| VideoLLaMA3-7BCategory=Open Source2026.02 | 31.17 | 14.42 | 44.89 | 62.5 | 61.96 | 23.67 | 51.15 | 42.61 | |
| MiniCPM-V-2.6-8BCategory=Open Source2026.02 | 30.8 | 14.51 | 49.25 | 55.03 | 61.82 | 27.77 | 39.85 | 43.51 |