Counterspeech Generation on CheckCovid (cross generalization)
99PolitenessControlled-Literacy
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Controlled-LiteracyBackbone=LLaMA-8B, Literacy Level=high2025.09 | 99 | 0 | 75 | 96 | |
| Controlled-LiteracyBackbone=Qwen-7B, Literacy Level=high2025.09 | 88 | 0 | 74 | 98 | |
| Controlled-LiteracyBackbone=LLaMA-8B, Literacy Level=Avg.2025.09 | 85 | 1.05 | 75 | 93 | |
| Instructional PromptBackbone=LLaMA-1B, Literacy Level=high2025.09 | 84 | 0.06 | 65 | 46 | |
| Controlled-LiteracyBackbone=LLaMA-1B, Literacy Level=high2025.09 | 83 | 0.05 | 68 | 75 | |
| Controlled-LiteracyBackbone=LLaMA-8B, Literacy Level=low2025.09 | 82 | 0.74 | 75 | 92 | |
| Controlled-LiteracyBackbone=LLaMA-1B, Literacy Level=Avg.2025.09 | 81 | 1.52 | 70 | 73 | |
| Controlled-LiteracyBackbone=LLaMA-1B, Literacy Level=low2025.09 | 80 | 2.29 | 71 | 69 | |
| Controlled-LiteracyBackbone=LLaMA-1B, Literacy Level=medium2025.09 | 79 | 2.22 | 72 | 74 | |
| Controlled-LiteracyBackbone=Qwen-7B, Literacy Level=low2025.09 | 79 | 1.94 | 75 | 90 | |
| Controlled-LiteracyBackbone=Qwen-7B, Literacy Level=Avg.2025.09 | 76 | 1.1 | 75 | 95 | |
| Controlled-LiteracyBackbone=LLaMA-8B, Literacy Level=medium2025.09 | 75 | 2.4 | 75 | 91 | |
| RAGBackbone=LLaMA-8B, Literacy Level=medium2025.09 | 74 | 3.21 | 74 | 85 | |
| RAGBackbone=LLaMA-8B, Literacy Level=low2025.09 | 72 | 2.11 | 74 | 82 | |
| RAGBackbone=LLaMA-8B, Literacy Level=Avg.2025.09 | 68 | 1.79 | 73 | 85 | |
| Instructional PromptBackbone=LLaMA-1B, Literacy Level=low2025.09 | 68 | 4.36 | 65 | 57 | |
| Instructional PromptBackbone=LLaMA-1B, Literacy Level=Avg.2025.09 | 67 | 7.24 | 62 | 54 | |
| RAGBackbone=Qwen-7B, Literacy Level=medium2025.09 | 64 | 7.09 | 75 | 95 | |
| RAGBackbone=Qwen-7B, Literacy Level=high2025.09 | 63 | 0.03 | 73 | 92 | |
| RAGBackbone=Qwen-7B, Literacy Level=Avg.2025.09 | 62 | 4.11 | 74 | 92 | |
| Controlled-LiteracyBackbone=Qwen-7B, Literacy Level=medium2025.09 | 62 | 1.36 | 75 | 97 | |
| Instructional PromptBackbone=LLaMA-8B, Literacy Level=medium2025.09 | 60 | 4.94 | 74 | 86 | |
| Instructional PromptBackbone=Qwen-7B, Literacy Level=medium2025.09 | 59 | 4.79 | 74 | 95 | |
| RAGBackbone=Qwen-7B, Literacy Level=low2025.09 | 58 | 5.2 | 74 | 88 | |
| RAGBackbone=LLaMA-8B, Literacy Level=high2025.09 | 57 | 0.05 | 70 | 88 | |
| RAGBackbone=LLaMA-1B, Literacy Level=high2025.09 | 57 | 0.11 | 43 | 51 | |
| RAGBackbone=LLaMA-1B, Literacy Level=medium2025.09 | 55 | 9.19 | 43 | 59 | |
| RAGBackbone=LLaMA-1B, Literacy Level=Avg.2025.09 | 55 | 8.73 | 42 | 60 | |
| Instructional PromptBackbone=LLaMA-8B, Literacy Level=Avg.2025.09 | 54 | 2.55 | 74 | 83 | |
| Instructional PromptBackbone=Qwen-7B, Literacy Level=high2025.09 | 53 | 0.58 | 74 | 97 | |
| Instructional PromptBackbone=Qwen-7B, Literacy Level=Avg.2025.09 | 53 | 3.43 | 74 | 92 | |
| Instructional PromptBackbone=LLaMA-8B, Literacy Level=low2025.09 | 52 | 2.69 | 74 | 87 | |
| RAGBackbone=LLaMA-1B, Literacy Level=low2025.09 | 52 | 16.9 | 41 | 69 | |
| Instructional PromptBackbone=LLaMA-8B, Literacy Level=high2025.09 | 51 | 0.03 | 74 | 76 | |
| Instructional PromptBackbone=LLaMA-1B, Literacy Level=medium2025.09 | 50 | 17.29 | 55 | 59 | |
| Instructional PromptBackbone=Qwen-7B, Literacy Level=low2025.09 | 46 | 4.93 | 73 | 84 |