Stance Detection on U-MStance BMW target
75.8F1 Score (Against)PRISM
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| PRISMModality=Multimodal, Fine-tuning status=fine-tuned, Backbone=MiMo2025.11 | 75.8 | 76.86 | 76.33 | |
| PRISMModality=Multimodal, Fine-tuning status=fine-tuned, Backbone=Qwen-VL2025.11 | 75 | 67.61 | 71.3 | |
| GPT4-IModality=Multimodal, Fine-tuning status=non-fine-tuned2025.11 | 70.2 | 70.52 | 70.36 | |
| GPT-4Modality=Text-only, Fine-tuning status=non-fine-tuned2025.11 | 67.76 | 61.32 | 64.54 | |
| PRISMModality=Multimodal, Fine-tuning status=fine-tuned, Backbone=LLaVA2025.11 | 67.63 | 68.44 | 68.04 | |
| PRISMModality=Multimodal, Backbone=Qwen-VL2025.11 | 66.06 | 51.02 | 58.54 | |
| BERT+ViTModality=Multimodal, Fine-tuning status=fine-tuned, Backbone=BERT+ViT2025.11 | 65 | 55.56 | 60.28 | |
| PRISMModality=Multimodal, Backbone=MiMo2025.11 | 64.47 | 53.63 | 59.05 | |
| RoBERTaModality=Text-only, Fine-tuning status=fine-tuned, Backbone=RoBERTa2025.11 | 64.45 | 54.07 | 59.26 | |
| BERTModality=Text-only, Fine-tuning status=fine-tuned, Backbone=BERT2025.11 | 64.22 | 53.66 | 58.94 | |
| TMPTModality=Multimodal, Fine-tuning status=fine-tuned2025.11 | 61.3 | 58.38 | 59.84 | |
| GPT-3.5Modality=Text-only, Fine-tuning status=non-fine-tuned2025.11 | 60.73 | 50.22 | 55.47 | |
| PoliBERTweetModality=Text-only, Fine-tuning status=fine-tuned, Backbone=PoliBERTweet2025.11 | 60 | 54.28 | 57.14 | |
| PRISMModality=Multimodal, Backbone=LLaVA2025.11 | 58.52 | 58.82 | 58.67 | |
| Qwen-VLModality=Multimodal, Fine-tuning status=non-fine-tuned, Backbone=Qwen-VL2025.11 | 53.87 | 42.64 | 48.26 | |
| RoBERTaModality=Text-only2025.11 | 53.04 | 35.78 | 47.15 | |
| MiMoModality=Multimodal, Fine-tuning status=non-fine-tuned, Backbone=MiMo2025.11 | 52.6 | 30.65 | 41.62 | |
| PoliBERTweetModality=Text-only2025.11 | 48.49 | 31.03 | 39.76 | |
| TMPTModality=Multimodal2025.11 | 47.39 | 19.86 | 33.62 | |
| BERT+ViTModality=Multimodal2025.11 | 44.5 | 32.71 | 38.6 | |
| LLaVAModality=Multimodal, Fine-tuning status=non-fine-tuned, Backbone=LLaVA2025.11 | 40.3 | 26.89 | 33.6 | |
| BERTModality=Text-only2025.11 | 39.46 | 36.69 | 34.02 | |
| LLaMA2Modality=Text-only, Fine-tuning status=non-fine-tuned, Backbone=LLaMA22025.11 | 35.74 | 33.45 | 34.6 |