Toxicity Classification on ToxiCN (test)
91.47AccuracyCITD
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| CITDBackbone=Qwen3-8B, Training Source=CITD (CITA-generated + public)2026.05 | 91.47 | — | — | — | — | |
| MixedBackbone=Qwen3-8B, Training Source=Mixed2026.05 | 89.27 | — | — | — | — | |
| ToxiCNBackbone=Qwen3-8B, Training Source=ToxiCN2026.05 | 88.07 | — | — | — | — | |
| SCCDBackbone=Qwen3-8B, Training Source=SCCD2026.05 | 84.27 | — | — | — | — | |
| MacBERT + ToxiTraceTraining Strategy=ToxiTrace, Backbone=Chinese-MacBERT-base2026.04 | 83.87 | 87.99 | 82.61 | 85.21 | 83.83 | |
| RoBERTa + ToxiTraceTraining Strategy=ToxiTrace, Backbone=Chinese-RoBERTa-wwm-ext2026.04 | 83.62 | 87.05 | 82.82 | 84.88 | 83.56 | |
| LLaMA3.1-8B (SFT)Training Strategy=SFT, Adaptation=LoRA2026.04 | 83.02 | 86.08 | 82.52 | 84.26 | 82.96 | |
| Qwen3-8B + ToxiTraceTraining Strategy=ToxiTrace, Adaptation=LoRA2026.04 | 82.91 | 83.44 | 84.1 | 83.77 | 82.86 | |
| RoBERTaBackbone=Chinese-RoBERTa-wwm-ext2026.04 | 82.7 | 84.38 | 83.4 | 83.89 | 82.81 | |
| LLaMA3.1-8B + ToxiTraceTraining Strategy=ToxiTrace, Adaptation=LoRA2026.04 | 82.33 | 84.93 | 82.22 | 83.55 | 82.23 | |
| Qwen3-8B (SFT)Training Strategy=SFT, Adaptation=LoRA2026.04 | 82.08 | 83.52 | 82.74 | 83.12 | 82.02 | |
| LLaMA2-7B (SFT)Training Strategy=SFT, Adaptation=LoRA2026.04 | 81.25 | 84.62 | 80.81 | 82.67 | 81.18 | |
| CNTPBackbone=Qwen3-8B, Training Source=CNTP2026.05 | 77.33 | — | — | — | — | |
| GPT-4oTraining Strategy=Zero-shot2026.04 | 73.2 | 65.66 | 66.98 | 67.38 | 73.22 | |
| COLDBackbone=Qwen3-8B, Training Source=COLD2026.05 | 72.67 | — | — | — | — | |
| Qwen3-8BTraining Strategy=Zero-shot2026.04 | 71.44 | 82.94 | 69.13 | 75.41 | 71.51 | |
| LLaMA3.1-8BTraining Strategy=Zero-shot2026.04 | 65.18 | 44.29 | 81.61 | 57.42 | 68.25 | |
| DeepSeek-V3.2Training Strategy=Zero-shot2026.04 | 60.66 | 36.19 | 77.35 | 49.3 | 64.14 | |
| SWSRBackbone=Qwen3-8B, Training Source=SWSR2026.05 | 52.2 | — | — | — | — |