Detection on Algospeak
4.7484Unknown Word DetectionQwen
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| QwenFramework=IMUM@0.5, Parameter=Estimated threshold x02026.05 | 4.7484 | 3.9629 | 3.9894 | 3.3518 | 4.3469 | 2.2321 | 4.4376 | |
| ClaudeFramework=IMUM@0.5, Parameter=Estimated threshold x02026.05 | 5.0999 | 3.2807 | 4.8888 | 5.1 | 3.8608 | 1.707 | 5.1 | |
| xAIFramework=IMUM@0.5, Parameter=Estimated threshold x02026.05 | 5.0999 | 2.9914 | 3.5865 | 5.1 | 3.7791 | 1.6652 | 5.1 | |
| GPT-4o miniFramework=IMUM@0.5, Parameter=Estimated threshold x02026.05 | 5.1 | 4.1783 | 4.3299 | 3.8108 | 4.4341 | 3.6979 | 4.9879 | |
| GPT-4oFramework=IMUM@0.5, Parameter=Estimated threshold x02026.05 | 5.1 | 3.6569 | 4.6984 | 3.2591 | 3.3956 | 1.9999 | 5.1 | |
| LlamaFramework=IMUM@0.5, Parameter=Estimated threshold x02026.05 | 5.1 | 4.8851 | 4.5766 | 3.0948 | 5.1 | 2.6758 | 5.1 | |
| MistralFramework=IMUM@0.5, Parameter=Estimated threshold x02026.05 | 5.1 | 5.0982 | 5.1 | 4.0951 | 5.1 | 2.5932 | 5.1 |