Toxic span extraction on CNTP
86.5Overlap RecallGemini2.5-Pro
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Gemini2.5-ProUsage=Refiner model used in the CuSA, Inference Time=About 1.5 hours2026.04 | 86.5 | 75.09 | 80.39 | 85.98 | 74.24 | 79.67 | 66.22 | |
| RoBERTa + ToxiTrace*Extraction algorithm=BiCSE bidirectional algorithm, Inference Time=01m 58s2026.04 | 86.36 | 70.95 | 77.9 | 83.53 | 70.06 | 77.63 | 61.56 | |
| Qwen3-8BExtraction algorithm=top-15% most salient tokens, Inference Time=14m 33s2026.04 | 84.83 | 71.97 | 77.87 | 90.03 | 63.89 | 74.74 | 59.67 | |
| Llama-3.1-8BExtraction algorithm=top-15% most salient tokens, Inference Time=12m 56s2026.04 | 81.32 | 69.21 | 74.78 | 79.94 | 62.97 | 70.87 | 54.33 | |
| Qwen3-1.7BExtraction algorithm=top-15% most salient tokens, Inference Time=09m 28s2026.04 | 77.53 | 71.48 | 74.38 | 76.01 | 66.72 | 71.29 | 55.11 | |
| Qwen3-0.6BExtraction algorithm=top-15% most salient tokens, Inference Time=09m 20s2026.04 | 73.68 | 67.1 | 70.23 | 73.15 | 62.8 | 68.23 | 51.78 | |
| RoBERTa*Extraction algorithm=BiCSE bidirectional algorithm, Inference Time=01m 58s2026.04 | 71.27 | 59.87 | 65.08 | 58.29 | 61.82 | 55.2 | 42.86 | |
| IGExtraction algorithm=top-15% most salient tokens, Inference Time=About 1.2 hours2026.04 | 58.3 | 60.01 | 59.14 | 36.99 | 76.46 | 49.86 | 33.21 | |
| CRFExtraction algorithm=top-15% most salient tokens, Inference Time=01m 10s2026.04 | 44.48 | 78.01 | 56.66 | 39.24 | 81.85 | 53.05 | 36.1 | |
| RoBERTaExtraction algorithm=top-15% most salient tokens, Inference Time=01m 58s2026.04 | 42.37 | 68.42 | 52.34 | 45.68 | 50.16 | 43.02 | 33.63 | |
| LIMEExtraction algorithm=top-15% most salient tokens, Inference Time=27m 20s2026.04 | 41.45 | 35.99 | 38.53 | 81.62 | 33.93 | 47.93 | 31.52 | |
| Llama3.2-3BExtraction algorithm=top-15% most salient tokens, Inference Time=08m 06s2026.04 | 41.03 | 71.02 | 52.01 | 37.47 | 69.42 | 48.67 | 32.16 | |
| AttentionExtraction algorithm=top-15% most salient tokens, Inference Time=00m 42s2026.04 | 39.01 | 36.15 | 37.52 | 25.43 | 47.68 | 33.17 | 19.88 |