Stance Detection on DGTA
87.46PrecisionDeepSeek-R1-Qwen
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| DeepSeek-R1-QwenFine-tuning Strategy=Integrated fine-tuning2026.01 | 87.46 | 77.08 | 79.26 | |
| DeepSeek-R1-QwenFine-tuning Strategy=Two-stage fine-tuning, Evaluation Stage=Stance determination stage2026.01 | 83.25 | 74.52 | 75.37 | |
| GPT-4oPrompt Strategy=Instruction prompting2026.01 | 74.22 | 74.75 | 74.45 | |
| DeepSeek-V3Prompt Strategy=Instruction prompting2026.01 | 69.25 | 72.6 | 70.64 | |
| GLM4-9BPrompt Strategy=Instruction prompting2026.01 | 68.5 | 69.2 | 66.9 | |
| BertFine-tuning Strategy=Two-stage fine-tuning, Evaluation Stage=Stance determination stage2026.01 | 67.89 | 67.11 | 67.51 | |
| mT5-e2eFine-tuning Strategy=Integrated fine-tuning2026.01 | 66.12 | 63.41 | 64.74 | |
| RoBERTa-largeFine-tuning Strategy=Two-stage fine-tuning, Evaluation Stage=Stance determination stage2026.01 | 65.74 | 59.01 | 62.19 | |
| Qwen2.5-7BFine-tuning Strategy=Integrated fine-tuning2026.01 | 65.31 | 65.33 | 64.16 | |
| Qwen2.5-7BPrompt Strategy=Instruction prompting2026.01 | 64.22 | 67.54 | 65.05 | |
| Llama3-8BPrompt Strategy=Instruction prompting2026.01 | 58.45 | 65.03 | 59.52 |