Hate Speech Classification on MHS
70.6F1 ScoreZero-shot
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Zero-shotModel=Qwen-72B, Prompting Condition=Zero-shot2026.05 | 70.6 | 70.03 | 54.86 | 99.02 | |
| DefinitionModel=Qwen-72B, Prompting Condition=Definition2026.05 | 69.64 | 69.11 | 54.17 | 97.49 | |
| Attr. awareModel=Qwen-72B, Prompting Condition=Attr. aware2026.05 | 69.45 | 68.26 | 53.42 | 99.26 | |
| VanillaModel=Qwen-72B, Prompting Condition=Vanilla2026.05 | 69.2 | 83.95 | 70.08 | 68.34 | |
| PersonaModel=Llama-70B, Prompting Condition=Persona2026.05 | 68.95 | 84.49 | 73.07 | 65.27 | |
| VanillaModel=Llama-70B, Prompting Condition=Vanilla2026.05 | 68.63 | 84.02 | 71.15 | 66.29 | |
| PersonaModel=Qwen-72B, Prompting Condition=Persona2026.05 | 67.63 | 83.83 | 71.67 | 64.03 | |
| DefinitionModel=Llama-70B, Prompting Condition=Definition2026.05 | 61.61 | 70.79 | 47.15 | 88.88 | |
| Few-shotModel=Llama-70B, Prompting Condition=Few-shot2026.05 | 60.63 | 67.47 | 44.53 | 94.93 | |
| Zero-shotModel=Llama-70B, Prompting Condition=Zero-shot2026.05 | 60.3 | 66.64 | 43.95 | 96.02 | |
| Attr. awareModel=Llama-70B, Prompting Condition=Attr. aware2026.05 | 60.3 | 66.97 | 44.15 | 95.12 | |
| Attr. valueModel=Llama-70B, Prompting Condition=Attr. value2026.05 | 54.91 | 57.49 | 38.12 | 98.14 | |
| Attr. valueModel=Qwen-72B, Prompting Condition=Attr. value2026.05 | 50.71 | 48.98 | 34.02 | 99.48 | |
| Few-shotModel=Qwen-72B, Prompting Condition=Few-shot2026.05 | 50.33 | 51.36 | 34.62 | 99.4 |