# Fine-grained Multimodal Emotion Recognition on OV-MERD+

Source: [Fine-grained Multimodal Emotion Recognition on OV-MERD+](<https://www.sota2.com/research/sota/fine-grained-multimodal-emotion-recognition-on-ov-merd-plus>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-22T08:03:41.148Z

Evaluation of Fine-grained Multimodal Emotion Recognition performance on the OV-MERD+ dataset, reporting Weighted Average F-score (WAF).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Fine-grained Multimodal Emotion Recognition |
| Dataset (including any stated split) | OV-MERD+ |
| Metric | WAF |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 18 of 18 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [WAF](<https://www.sota2.com/research/sota/fine-grained-multimodal-emotion-recognition-on-ov-merd-plus.md?metric=WAF>): Higher is better; unit: PERCENT.

## Recorded results

| Method | WAF | Result date | Report paper |
| --- | --- | --- | --- |
| AffectAgent | 65.13 | Not recorded | 69df1bbe7d0172140ec7bb00 |
| AffectGPT | 62.52 | Not recorded | 69df1bbe7d0172140ec7bb00 |
| AffectAgent | 57.72 | Not recorded | 69df1bbe7d0172140ec7bb00 |
| Emotion-LLaMA | 52.97 | Not recorded | 69df1bbe7d0172140ec7bb00 |
| VEENA | 49.67 | Not recorded | 6a0fe327f984739ed6739e88 |
| PAI | 46.32 | Not recorded | 6a0fe327f984739ed6739e88 |
| AffectAgent | 43.67 | Not recorded | 69df1bbe7d0172140ec7bb00 |
| VISTA | 40.82 | Not recorded | 6a0fe327f984739ed6739e88 |
| Baseline | 40.42 | Not recorded | 6a0fe327f984739ed6739e88 |
| PandaGPT | 37.12 | Not recorded | 69df1bbe7d0172140ec7bb00 |
| AffectAgent | 24.44 | Not recorded | 69df1bbe7d0172140ec7bb00 |
| AffectAgent | 23.8 | Not recorded | 69df1bbe7d0172140ec7bb00 |
| AffectAgent | 22.65 | Not recorded | 69df1bbe7d0172140ec7bb00 |
| AffectAgent | 22.36 | Not recorded | 69df1bbe7d0172140ec7bb00 |
| Video-LLaMA 2 | 16.58 | Not recorded | 69df1bbe7d0172140ec7bb00 |
| ChatBridge | 15.35 | Not recorded | 69df1bbe7d0172140ec7bb00 |
| VideoChat | 15.02 | Not recorded | 69df1bbe7d0172140ec7bb00 |
| Video-LLaMA | 13.98 | Not recorded | 69df1bbe7d0172140ec7bb00 |

### AffectAgent

WAF: 65.13. Result ID: 69df5d3c47f34ce924c87e5c.

[Reporting paper](<https://www.sota2.com/research/paper/69df1bbe7d0172140ec7bb00.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69df1bbe7d0172140ec7bb00.md>)

Recorded evaluation configuration: {"Modality":"A, V, T","Backbone":"AffectGPT"}. This record does not assert independent reproduction.

### AffectGPT

WAF: 62.52. Result ID: 69df5d3c47f34ce924c87e5b.

[Reporting paper](<https://www.sota2.com/research/paper/69df1bbe7d0172140ec7bb00.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78621e209131cea781ae.md>)

Recorded evaluation configuration: {"Modality":"A, V, T"}. This record does not assert independent reproduction.

### AffectAgent

WAF: 57.72. Result ID: 69df5d3c47f34ce924c87e5a.

[Reporting paper](<https://www.sota2.com/research/paper/69df1bbe7d0172140ec7bb00.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69df1bbe7d0172140ec7bb00.md>)

Recorded evaluation configuration: {"Modality":"A, V, T","Backbone":"Emotion-LLaMA"}. This record does not assert independent reproduction.

### Emotion-LLaMA

WAF: 52.97. Result ID: 69df5d3c47f34ce924c87e59.

[Reporting paper](<https://www.sota2.com/research/paper/69df1bbe7d0172140ec7bb00.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75901e209131cea68a90.md>)

[Implementation](<https://github.com/ZebangCheng/Emotion-LLaMA>)

Recorded evaluation configuration: {"Modality":"A, V, T"}. This record does not assert independent reproduction.

### VEENA

WAF: 49.67. Result ID: 6a100dd8fbc373592c08d7a9.

[Reporting paper](<https://www.sota2.com/research/paper/6a0fe327f984739ed6739e88.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a0fe327f984739ed6739e88.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-VL-4B-Instruct"}. This record does not assert independent reproduction.

### PAI

WAF: 46.32. Result ID: 6a100dd8fbc373592c08d7a8.

[Reporting paper](<https://www.sota2.com/research/paper/6a0fe327f984739ed6739e88.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa744d1e209131cea60e2d.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-VL-4B-Instruct"}. This record does not assert independent reproduction.

### AffectAgent

WAF: 43.67. Result ID: 69df5d3c47f34ce924c87e58.

[Reporting paper](<https://www.sota2.com/research/paper/69df1bbe7d0172140ec7bb00.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69df1bbe7d0172140ec7bb00.md>)

Recorded evaluation configuration: {"Modality":"A, V, T","Backbone":"PandaGPT"}. This record does not assert independent reproduction.

### VISTA

WAF: 40.82. Result ID: 6a100dd8fbc373592c08d7a7.

[Reporting paper](<https://www.sota2.com/research/paper/6a0fe327f984739ed6739e88.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa79cb1e209131cea7f678.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-VL-4B-Instruct"}. This record does not assert independent reproduction.

### Baseline

WAF: 40.42. Result ID: 6a100dd8fbc373592c08d7a6.

[Reporting paper](<https://www.sota2.com/research/paper/6a0fe327f984739ed6739e88.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6927db54d6b0dd3342930f66.md>)

Recorded evaluation configuration: {"Backbone":"Qwen3-VL-4B-Instruct"}. This record does not assert independent reproduction.

### PandaGPT

WAF: 37.12. Result ID: 69df5d3c47f34ce924c87e57.

[Reporting paper](<https://www.sota2.com/research/paper/69df1bbe7d0172140ec7bb00.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f7f1e209131cea46009.md>)

Recorded evaluation configuration: {"Modality":"A, V, T"}. This record does not assert independent reproduction.

### AffectAgent

WAF: 24.44. Result ID: 69df5d3c47f34ce924c87e56.

[Reporting paper](<https://www.sota2.com/research/paper/69df1bbe7d0172140ec7bb00.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69df1bbe7d0172140ec7bb00.md>)

Recorded evaluation configuration: {"Modality":"A, V, T","Backbone":"Video-LLaMA 2"}. This record does not assert independent reproduction.

### AffectAgent

WAF: 23.8. Result ID: 69df5d3c47f34ce924c87e54.

[Reporting paper](<https://www.sota2.com/research/paper/69df1bbe7d0172140ec7bb00.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69df1bbe7d0172140ec7bb00.md>)

Recorded evaluation configuration: {"Modality":"A, V, T","Backbone":"ChatBridge"}. This record does not assert independent reproduction.

### AffectAgent

WAF: 22.65. Result ID: 69df5d3c47f34ce924c87e50.

[Reporting paper](<https://www.sota2.com/research/paper/69df1bbe7d0172140ec7bb00.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69df1bbe7d0172140ec7bb00.md>)

Recorded evaluation configuration: {"Modality":"A, V, T","Backbone":"Video-LLaMA"}. This record does not assert independent reproduction.

### AffectAgent

WAF: 22.36. Result ID: 69df5d3c47f34ce924c87e52.

[Reporting paper](<https://www.sota2.com/research/paper/69df1bbe7d0172140ec7bb00.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69df1bbe7d0172140ec7bb00.md>)

Recorded evaluation configuration: {"Modality":"A, V, T","Backbone":"VideoChat"}. This record does not assert independent reproduction.

### Video-LLaMA 2

WAF: 16.58. Result ID: 69df5d3c47f34ce924c87e55.

[Reporting paper](<https://www.sota2.com/research/paper/69df1bbe7d0172140ec7bb00.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75761e209131cea681dd.md>)

[Implementation](<https://github.com/DAMO-NLP-SG/VideoLLaMA2>)

Recorded evaluation configuration: {"Modality":"A, V, T"}. This record does not assert independent reproduction.

### ChatBridge

WAF: 15.35. Result ID: 69df5d3c47f34ce924c87e53.

[Reporting paper](<https://www.sota2.com/research/paper/69df1bbe7d0172140ec7bb00.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f651e209131cea454e4.md>)

Recorded evaluation configuration: {"Modality":"A, V, T"}. This record does not assert independent reproduction.

### VideoChat

WAF: 15.02. Result ID: 69df5d3c47f34ce924c87e51.

[Reporting paper](<https://www.sota2.com/research/paper/69df1bbe7d0172140ec7bb00.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71ba1e209131cea52cc7.md>)

Recorded evaluation configuration: {"Modality":"A, V, T"}. This record does not assert independent reproduction.

### Video-LLaMA

WAF: 13.98. Result ID: 69df5d3c47f34ce924c87e4f.

[Reporting paper](<https://www.sota2.com/research/paper/69df1bbe7d0172140ec7bb00.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70f11e209131cea4e393.md>)

[Implementation](<https://github.com/DAMO-NLP-SG/Video-LLaMA>)

Recorded evaluation configuration: {"Modality":"A, V, T"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
