Toxicity Detection on HateXplain
90.44AUCSFT
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| SFTBackbone Model=BERT2024.12 | 90.44 | 78.17 | 81.34 | 24.94 | — | |
| SFTBackbone Model=HateBERT2024.12 | 88.82 | 77.96 | 81.96 | 31.33 | — | |
| MetaToxBackbone Model=Qwen2.5-14B-Instruct2024.12 | 84.02 | 73.39 | 72.48 | 32.1 | — | |
| MetaToxBackbone Model=Qwen2.5-14B-Instruct2024.12 | 83.8 | 73.28 | 72.38 | 32.1 | — | |
| RAGBackbone Model=Qwen2.5-14B-Instruct2024.12 | 83.7 | 73.13 | 70.18 | 48.72 | — | |
| MetaToxBackbone Model=Llama3.1-8B-Instruct2024.12 | 82.27 | 68.87 | 62.5 | 38.74 | — | |
| MetaToxBackbone Model=Llama3.1-8B-Instruct2024.12 | 81.67 | 68.24 | 61.63 | 67.13 | — | |
| RAGBackbone Model=Llama3.1-8B-Instruct2024.12 | 81.5 | 65.96 | 54.32 | 80.95 | — | |
| RAGBackbone Model=Qwen2.5-14B-Instruct2024.12 | 81.29 | 71.21 | 64.97 | 64.32 | — | |
| RAGBackbone Model=Llama3.1-8B-Instruct2024.12 | 80.5 | 69.59 | 62.02 | 40.69 | — | |
| Vanilla LLMBackbone Model=Llama3.1-8B-Instruct2024.12 | 79.77 | 63.36 | 48.11 | 88.75 | — | |
| Vanilla LLMBackbone Model=Llama3.1-8B-Instruct2024.12 | 79.77 | 63.36 | 48.11 | 88.75 | — | |
| Vanilla LLMBackbone Model=Qwen2.5-14B-Instruct2024.12 | 76.36 | 70.95 | 64.04 | 66.62 | — | |
| Vanilla LLMBackbone Model=Qwen2.5-14B-Instruct2024.12 | 76.36 | 70.95 | 64.04 | 66.62 | — | |
| HateBERTMode=SFT2024.12 | 72.63 | 59.3 | 69.11 | 66.11 | — | |
| LIME-LLMBackbone=Claude Sonnet 4.52026.01 | 62.7 | — | — | — | 48.5 | |
| BERTMode=SFT2024.12 | 58.57 | 57.38 | 45.78 | 86.32 | — | |
| Integrated Gradients2026.01 | 57.9 | — | — | — | 49.1 | |
| Partition SHAP2026.01 | 52.1 | — | — | — | 41.5 | |
| LLimeMode=Generative2026.01 | 48 | — | — | — | 31.2 | |
| LIMEMode=Standard2026.01 | 33.6 | — | — | — | 23.4 |