Stance Detection on U-MStance Bitcoin target
73.22F1 (against)PRISM
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| PRISMModality=Multimodal, Fine-tuning status=fine-tuned, Backbone=MiMo2025.11 | 73.22 | 81.53 | 77.38 | |
| PRISMModality=Multimodal, Fine-tuning status=fine-tuned, Backbone=Qwen-VL2025.11 | 72 | 79.45 | 75.72 | |
| PRISMModality=Multimodal, Fine-tuning status=fine-tuned, Backbone=LLaVA2025.11 | 60.91 | 73.47 | 67.19 | |
| PRISMModality=Multimodal, Backbone=Qwen-VL2025.11 | 60.5 | 67.7 | 64.1 | |
| PRISMModality=Multimodal, Backbone=MiMo2025.11 | 60.26 | 68.9 | 64.58 | |
| GPT4-IModality=Multimodal, Fine-tuning status=non-fine-tuned2025.11 | 58.94 | 72.82 | 65.88 | |
| GPT-4Modality=Text-only, Fine-tuning status=non-fine-tuned2025.11 | 56.44 | 67.73 | 62.08 | |
| PRISMModality=Multimodal, Backbone=LLaVA2025.11 | 56.07 | 61.02 | 58.55 | |
| Qwen-VLModality=Multimodal, Fine-tuning status=non-fine-tuned, Backbone=Qwen-VL2025.11 | 50.45 | 69.6 | 60.03 | |
| RoBERTaModality=Text-only, Fine-tuning status=fine-tuned, Backbone=RoBERTa2025.11 | 49.24 | 68.89 | 59.07 | |
| GPT-3.5Modality=Text-only, Fine-tuning status=non-fine-tuned2025.11 | 47.97 | 65.44 | 56.71 | |
| TMPTModality=Multimodal, Fine-tuning status=fine-tuned2025.11 | 44.07 | 66.31 | 55.18 | |
| MiMoModality=Multimodal, Fine-tuning status=non-fine-tuned, Backbone=MiMo2025.11 | 39.02 | 57.22 | 48.12 | |
| BERTModality=Text-only, Fine-tuning status=fine-tuned, Backbone=BERT2025.11 | 36.96 | 63.43 | 50.19 | |
| RoBERTaModality=Text-only2025.11 | 35.08 | 29.64 | 32.36 | |
| BERT+ViTModality=Multimodal, Fine-tuning status=fine-tuned, Backbone=BERT+ViT2025.11 | 34.67 | 67.37 | 51.02 | |
| TMPTModality=Multimodal2025.11 | 30.61 | 38.68 | 34.65 | |
| PoliBERTweetModality=Text-only, Fine-tuning status=fine-tuned, Backbone=PoliBERTweet2025.11 | 28.07 | 58.97 | 43.52 | |
| BERT+ViTModality=Multimodal2025.11 | 27.11 | 21.82 | 28.19 | |
| LLaMA2Modality=Text-only, Fine-tuning status=non-fine-tuned, Backbone=LLaMA22025.11 | 26.6 | 42.74 | 34.67 | |
| PoliBERTweetModality=Text-only2025.11 | 25 | 36.36 | 30.68 | |
| LLaVAModality=Multimodal, Fine-tuning status=non-fine-tuned, Backbone=LLaVA2025.11 | 22.88 | 55.13 | 39 | |
| BERTModality=Text-only2025.11 | 21.27 | 29.3 | 25.28 |