Offensiveness detection on MD (test)
83.55AccuracyDPUA
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| DPUABackbone=Qwen-3-Instruct (8B)2026.05 | 83.55 | 81.68 | 15.98 | 74.92 | |
| DPUABackbone=LLaMa-3.1-Instruct (8B)2026.05 | 83.32 | 81.45 | 16.86 | 72.15 | |
| w/ GRPOBackbone=Qwen-3-Instruct (8B)2026.05 | 83.09 | 80.86 | 20.22 | 60.77 | |
| w/ GRPOBackbone=LLaMa-3.1-Instruct (8B)2026.05 | 82.53 | 79.97 | 20.22 | 60.77 | |
| w/ GRPO*Backbone=Qwen-3-Instruct (8B)2026.05 | 81.88 | 79.92 | 16.81 | 71.26 | |
| w/ SFTBackbone=LLaMa-3.1-Instruct (8B)2026.05 | 81.78 | 79.78 | 23.97 | 61.74 | |
| w/ SFTBackbone=Qwen-3-Instruct (8B)2026.05 | 81.71 | 76.74 | 19.57 | 62.7 | |
| w/ GRPO*Backbone=LLaMa-3.1-Instruct (8B)2026.05 | 81.71 | 76.74 | 18.18 | 66.98 | |
| w/ SFT*Backbone=LLaMa-3.1-Instruct (8B)2026.05 | 80.86 | 77.29 | 19.34 | 66.43 | |
| w/ SFT*Backbone=Qwen-3-Instruct (8B)2026.05 | 80.44 | 78.92 | 17.27 | 67.12 | |
| few-shotBackbone=Qwen-3-Instruct (8B)2026.05 | 70.45 | 69.99 | 26.49 | 57.72 | |
| few-shotBackbone=LLaMa-3.1-Instruct (8B)2026.05 | 68.99 | 68.55 | 27.46 | 55.49 | |
| zero-shotBackbone=LLaMa-3.1-Instruct (8B)2026.05 | 68.3 | 67.53 | 31.62 | 50.34 | |
| zero-shotBackbone=Qwen-3-Instruct (8B)2026.05 | 67.48 | 67.33 | 26.94 | 57.66 |