Depressive symptom classification on RESTOREx (test)
72.73Macro F1 ScoreMAMA-Memeia
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MAMA-MemeiaModality=Multimodal2025.12 | 72.73 | 72.45 | |
| Yadav et al.Modality=Multimodal, Note=Previous SOTA2025.12 | 65.18 | 64.67 | |
| MentalBARTModality=Unimodal Text, Text Input=Explanation2025.12 | 64.96 | 64.3 | |
| MentalBERTModality=Unimodal Text, Text Input=Explanation2025.12 | 64.62 | 65.27 | |
| MentalBERTModality=Unimodal Text, Text Input=OCR2025.12 | 63.77 | 64.47 | |
| BERTModality=Unimodal Text, Text Input=Explanation2025.12 | 63.39 | 63.96 | |
| VisualBERTModality=Multimodal, Inputs=Image + OCR2025.12 | 62.7 | 63.67 | |
| VisualBERTModality=Multimodal, Inputs=Image + Explanation2025.12 | 62.37 | 62.25 | |
| BERTModality=Unimodal Text, Text Input=OCR2025.12 | 62.02 | 62.63 | |
| MentalBARTModality=Unimodal Text, Text Input=OCR2025.12 | 61.76 | 62.43 | |
| BARTModality=Unimodal Text, Text Input=Explanation2025.12 | 55.81 | 57.11 | |
| CLIPModality=Multimodal, Inputs=Image + OCR2025.12 | 45.83 | 48.09 | |
| BARTModality=Unimodal Text, Text Input=OCR2025.12 | 44.71 | 49.46 | |
| CLIPModality=Multimodal, Inputs=Image + Explanation2025.12 | 39.23 | 42.56 | |
| ViT + BERTModality=Multimodal, Inputs=Image + OCR2025.12 | 38.57 | 42.24 | |
| ViT + BERTModality=Multimodal, Inputs=Image + Explanation2025.12 | 37.78 | 40.58 | |
| ViTModality=Unimodal Image2025.12 | 34.96 | 39.04 | |
| ResNetModality=Unimodal Image2025.12 | 27.14 | 33.46 | |
| EfficientNetModality=Unimodal Image2025.12 | 25.18 | 31.61 |