Emotion Perception and Recognition on HitEmotion Level 1
79.11FESDGemini-2.5-Pro
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Gemini-2.5-ProCategory=Closed Source, ToM prompt=true2026.02 | 79.11 | 63.13 | 31.02 | 72.92 | 77.97 | 79.19 | 51.74 | 69 | 69.31 | 62.25 | |
| Gemini-2.5-ProCategory=Closed Source2026.02 | 78.39 | 61.12 | 28.96 | 72.11 | 74.2 | 75.71 | 46.53 | 67.96 | 65 | 55.02 | |
| TMPOCategory=Ours, GRPO=true2026.02 | 77.12 | 67.63 | 37.18 | 75.41 | 79.12 | 77.03 | 53.91 | 66.13 | 65.91 | 58.74 | |
| Gemini-2.5-FlashCategory=Closed Source, ToM prompt=true2026.02 | 76.44 | 59.01 | 29.2 | 64.19 | 74.84 | 76.03 | 43.36 | 63.33 | 62.22 | 53.04 | |
| GPT-4.1Category=Closed Source, ToM prompt=true2026.02 | 74.74 | 58.06 | 34.55 | 66 | 76.06 | 74.8 | 43.17 | 69.19 | 57.2 | 56.01 | |
| GPT-4oCategory=Closed Source, ToM prompt=true2026.02 | 74 | 56.44 | 33.18 | 63.32 | 74.6 | 73.87 | 41.34 | 56.1 | 54.31 | 52.8 | |
| GPT-4.1Category=Closed Source2026.02 | 71.46 | 56.8 | 31.43 | 64 | 72.46 | 69.6 | 40.81 | 66.19 | 55.2 | 53.2 | |
| GPT-4oCategory=Closed Source2026.02 | 70.22 | 54.48 | 30.12 | 57.64 | 69.2 | 69.53 | 40 | 54 | 49.6 | 49.96 | |
| TMPOCategory=Ours, SFT=true2026.02 | 69.39 | 60.85 | 31.34 | 66.23 | 72.49 | 71.33 | 45.58 | 58.71 | 55.43 | 50.2 | |
| Gemini-2.5-FlashCategory=Closed Source2026.02 | 67.11 | 55.41 | 27.12 | 58.73 | 68.4 | 70.91 | 38.44 | 57.47 | 56.51 | 50.83 | |
| AffectGPT-7BCategory=Open Source2026.02 | 66.67 | 50.33 | 25.46 | 38.69 | 66.6 | 67.76 | 34.5 | 49.19 | 41.25 | 38.8 | |
| Qwen2.5-Omni-7BCategory=Open Source2026.02 | 64.67 | 51.56 | 22.71 | 56.08 | 64 | 68 | 32.3 | 54.72 | 44.6 | 48.6 | |
| HumanOmni-7BCategory=Open Source2026.02 | 64.44 | 53.77 | 23.82 | 56.75 | 48.2 | 35.2 | 33.9 | 50.31 | 46.2 | 47.6 | |
| Qwen2.5-VL-32BCategory=Open Source2026.02 | 63.78 | 53.7 | 25.28 | 57.14 | 65.8 | 68.8 | 34.2 | 43.4 | 41.8 | 47.6 | |
| LLaVA-One-Vision-7BCategory=Open Source2026.02 | 63.44 | 49.19 | 17.05 | 39.5 | 65.4 | 63 | 27 | 53.4 | 44.6 | 34.8 | |
| InternVL3-38BCategory=Open Source2026.02 | 63.22 | 53.58 | 24 | 57.16 | 68.8 | 68.8 | 35.73 | 53.46 | 48 | 50.6 | |
| InternVL3-8BCategory=Open Source2026.02 | 62.33 | 50.65 | 21.4 | 53 | 63.8 | 68 | 31.2 | 49 | 42.6 | 48.6 | |
| Qwen2.5-VL-7BCategory=Open Source2026.02 | 62 | 43.15 | 21.25 | 56.75 | 61.21 | 64.2 | 32.6 | 52.8 | 41.8 | 47.2 | |
| VideoLLaMA3-7BCategory=Open Source2026.02 | 61.78 | 46.85 | 21.6 | 52.18 | 64.62 | 67.89 | 35.2 | 45.8 | 41.8 | 42 | |
| MiniCPM-V-2.6-8BCategory=Open Source2026.02 | 57.53 | 49.39 | 25.15 | 50.13 | 62.65 | 52.45 | 37.42 | 44.9 | 37.59 | 45.21 | |
| LLaVA-NeXT-Video-7BCategory=Open Source2026.02 | 54.44 | 41.2 | 11.85 | 41.31 | 56.11 | 65.8 | 25.03 | 48.6 | 43.4 | 31.2 | |
| R1-Omni-0.5BCategory=Open Source2026.02 | 42.28 | 51.55 | 23.72 | 50.88 | 41.74 | 32.2 | 19.5 | 30.12 | 24.38 | 43.6 | |
| Emotion-LLaMA-7BCategory=Open Source2026.02 | 33.11 | 53.63 | 24 | 43.75 | 44.4 | 56.6 | 37 | 47 | 47.27 | 48.44 |