Stance Detection on U-MStance Costco target
74.88F1 (Against)GPT4-I
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| GPT4-IModality=Multimodal, Fine-tuning status=non-fine-tuned2025.11 | 74.88 | 72.4 | 73.64 | |
| PRISMModality=Multimodal, Fine-tuning status=fine-tuned, Backbone=Qwen-VL2025.11 | 72.44 | 65.72 | 69.08 | |
| PRISMModality=Multimodal, Fine-tuning status=fine-tuned, Backbone=MiMo2025.11 | 71.72 | 68.36 | 70.04 | |
| PRISMModality=Multimodal, Fine-tuning status=fine-tuned, Backbone=LLaVA2025.11 | 69.93 | 63.6 | 66.77 | |
| GPT-4Modality=Text-only, Fine-tuning status=non-fine-tuned2025.11 | 63.35 | 60.95 | 62.15 | |
| BERT+ViTModality=Multimodal, Fine-tuning status=fine-tuned, Backbone=BERT+ViT2025.11 | 62.84 | 51.9 | 57.37 | |
| Qwen-VLModality=Multimodal, Fine-tuning status=non-fine-tuned, Backbone=Qwen-VL2025.11 | 62.6 | 54.82 | 58.71 | |
| RoBERTaModality=Text-only, Fine-tuning status=fine-tuned, Backbone=RoBERTa2025.11 | 62.14 | 54.94 | 58.54 | |
| GPT-3.5Modality=Text-only, Fine-tuning status=non-fine-tuned2025.11 | 62.03 | 52.31 | 57.17 | |
| TMPTModality=Multimodal, Fine-tuning status=fine-tuned2025.11 | 60.68 | 52.39 | 56.54 | |
| PoliBERTweetModality=Text-only, Fine-tuning status=fine-tuned, Backbone=PoliBERTweet2025.11 | 57.56 | 51.41 | 54.48 | |
| MiMoModality=Multimodal, Fine-tuning status=non-fine-tuned, Backbone=MiMo2025.11 | 54.76 | 38.06 | 46.41 | |
| BERTModality=Text-only, Fine-tuning status=fine-tuned, Backbone=BERT2025.11 | 51.83 | 41.94 | 46.89 | |
| PRISMModality=Multimodal, Backbone=MiMo2025.11 | 47.47 | 56.92 | 52.2 | |
| PRISMModality=Multimodal, Backbone=LLaVA2025.11 | 46.63 | 43.26 | 44.94 | |
| PRISMModality=Multimodal, Backbone=Qwen-VL2025.11 | 45.16 | 57.75 | 51.45 | |
| LLaVAModality=Multimodal, Fine-tuning status=non-fine-tuned, Backbone=LLaVA2025.11 | 44.92 | 31.39 | 38.16 | |
| BERTModality=Text-only2025.11 | 38.06 | 16.35 | 28.99 | |
| LLaMA2Modality=Text-only, Fine-tuning status=non-fine-tuned, Backbone=LLaMA22025.11 | 30.73 | 38.76 | 34.75 | |
| TMPTModality=Multimodal2025.11 | 11.63 | 15.31 | 13.47 | |
| PoliBERTweetModality=Text-only2025.11 | 9.71 | 20 | 14.85 | |
| BERT+ViTModality=Multimodal2025.11 | 7.58 | 23.77 | 15.68 | |
| RoBERTaModality=Text-only2025.11 | 2.89 | 5.66 | 6.44 |