Toxicity Detection on IHC (in-domain)
78.72AccuracySFT
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| SFTBackbone Model=BERT2024.12 | 78.72 | 70.57 | 79.74 | 14.19 | |
| SFTBackbone Model=HateBERT2024.12 | 78.35 | 71.52 | 79.7 | 17.49 | |
| MetaToxBackbone Model=Qwen2.5-14B-Instruct2024.12 | 73.65 | 69.95 | 70.1 | 12.32 | |
| MetaToxBackbone Model=Llama3.1-8B-Instruct2024.12 | 69.04 | 68.55 | 63.75 | 34.23 | |
| RAGBackbone Model=Qwen2.5-14B-Instruct2024.12 | 66.71 | 66.67 | 66.79 | 43.24 | |
| Vanilla LLMBackbone Model=Qwen2.5-14B-Instruct2024.12 | 66.34 | 66.32 | 64.38 | 48.42 | |
| RAGBackbone Model=Llama3.1-8B-Instruct2024.12 | 64.29 | 64.23 | 66.74 | 51.58 | |
| Vanilla LLMBackbone Model=Llama3.1-8B-Instruct2024.12 | 50.79 | 48.03 | 62.97 | 77.63 |