Profanity suppression on RealToxicityPrompts
103.6Relative ThroughputNCO
Evaluation results
| Method | Links | ||
|---|---|---|---|
| NCOModel=Falcon 3 7B, Batch Size=642026.05 | 103.6 | — | |
| NCOModel=Falcon 3 7B, Batch Size=322026.05 | 102 | — | |
| NCOModel=Falcon 3 7B, Batch Size=162026.05 | 101.8 | — | |
| NCOModel=Phi-4 14B, Batch Size=162026.05 | 101.7 | — | |
| NCOModel=Phi-4 14B, Batch Size=322026.05 | 101.5 | — | |
| NCOModel=Qwen 2.5 7B, Batch Size=42026.05 | 101.4 | — | |
| NCOModel=Falcon 3 7B, Batch Size=82026.05 | 101.4 | — | |
| NCOModel=Phi-4 14B, Batch Size=82026.05 | 101.4 | — | |
| NCOModel=Qwen 2.5 7B, Batch Size=322026.05 | 101.3 | — | |
| NCOModel=Falcon 7B, Batch Size=12026.05 | 101 | — | |
| RSModel=Falcon 7B, Batch Size=12026.05 | 100.9 | — | |
| NCOModel=Qwen 2.5 7B, Batch Size=82026.05 | 100.8 | — | |
| NCOModel=Qwen 2.5 7B, Batch Size=642026.05 | 100.8 | — | |
| NCOModel=Falcon 3 7B, Batch Size=12026.05 | 100.8 | — | |
| NCOModel=Qwen 2.5 7B, Batch Size=12026.05 | 100.7 | — | |
| NCOModel=Falcon 7B, Batch Size=82026.05 | 100.7 | — | |
| RSModel=Falcon 3 7B, Batch Size=12026.05 | 100.7 | — | |
| NCOModel=Qwen 2.5 7B, Batch Size=162026.05 | 100.6 | — | |
| NCOModel=Falcon 7B, Batch Size=42026.05 | 100.6 | — | |
| NCOModel=Falcon 7B, Batch Size=162026.05 | 100.6 | — | |
| NCOModel=Falcon 3 7B, Batch Size=42026.05 | 100.6 | — | |
| RSModel=Qwen 2.5 7B, Batch Size=12026.05 | 100.5 | — | |
| RSModel=Phi-4 14B, Batch Size=12026.05 | 100.5 | — | |
| NCOModel=Phi-4 14B, Batch Size=42026.05 | 100.5 | — | |
| NCOModel=Llama 3.1 8B, Batch Size=162026.05 | 100.4 | — | |
| NCOModel=Falcon 3 7B, Batch Size=22026.05 | 100.4 | — | |
| NCOModel=Llama 2 7B, Batch Size=642026.05 | 100.3 | — | |
| NCOModel=Llama 3.1 8B, Batch Size=322026.05 | 100.3 | — | |
| NCOModel=Llama 3.1 8B, Batch Size=642026.05 | 100.3 | — | |
| NCOModel=Phi-4 14B, Batch Size=12026.05 | 100.3 | — | |
| NCOModel=Llama 2 7B, Batch Size=82026.05 | 100.2 | — | |
| NCOModel=Llama 2 7B, Batch Size=162026.05 | 100.2 | — | |
| NCOModel=Qwen 2.5 7B, Batch Size=22026.05 | 100.2 | — | |
| NCOModel=Llama 3.1 8B, Batch Size=82026.05 | 100.1 | — | |
| NCOModel=Falcon 7B, Batch Size=322026.05 | 100 | — | |
| NCOModel=Llama 2 7B, Batch Size=12026.05 | 99.9 | — | |
| NCOModel=Llama 2 7B, Batch Size=42026.05 | 99.9 | — | |
| NCOModel=Llama 2 7B, Batch Size=322026.05 | 99.9 | — | |
| NCOModel=Llama 3.1 8B, Batch Size=12026.05 | 99.9 | — | |
| NCOModel=Phi-4 14B, Batch Size=642026.05 | 99.9 | — | |
| NCOModel=Llama 3.1 8B, Batch Size=42026.05 | 99.8 | — | |
| NCOModel=Llama 3.1 8B, Batch Size=22026.05 | 99.6 | — | |
| NCOModel=Falcon 7B, Batch Size=22026.05 | 99.6 | — | |
| NCOModel=Llama 2 7B, Batch Size=22026.05 | 99.5 | — | |
| RSModel=Llama 2 7B, Batch Size=12026.05 | 99.4 | — | |
| RSModel=Llama 3.1 8B, Batch Size=12026.05 | 99.4 | — | |
| RSModel=Phi-4 14B, Batch Size=42026.05 | 99.3 | — | |
| NCOModel=Phi-4 14B, Batch Size=22026.05 | 99.3 | — | |
| RSModel=Phi-4 14B, Batch Size=82026.05 | 99.1 | — | |
| RSModel=Phi-4 14B, Batch Size=162026.05 | 99.1 | — | |
| RSModel=Llama 2 7B, Batch Size=22026.05 | 98.8 | — | |
| RSModel=Llama 3.1 8B, Batch Size=22026.05 | 98.7 | — | |
| NCOModel=Falcon 7B, Batch Size=642026.05 | 98.7 | — | |
| RSModel=Llama 3.1 8B, Batch Size=42026.05 | 98.5 | — | |
| RSModel=Qwen 2.5 7B, Batch Size=42026.05 | 98.5 | — | |
| RSModel=Phi-4 14B, Batch Size=22026.05 | 98.5 | — | |
| RSModel=Falcon 7B, Batch Size=22026.05 | 98.3 | — | |
| RSModel=Falcon 3 7B, Batch Size=22026.05 | 98.3 | — | |
| RSModel=Llama 3.1 8B, Batch Size=82026.05 | 98.2 | — | |
| RSModel=Llama 2 7B, Batch Size=42026.05 | 98.1 | — | |
| RSModel=Falcon 3 7B, Batch Size=42026.05 | 98.1 | — | |
| RSModel=Falcon 7B, Batch Size=82026.05 | 97.7 | — | |
| RSModel=Qwen 2.5 7B, Batch Size=22026.05 | 97.6 | — | |
| RSModel=Llama 2 7B, Batch Size=82026.05 | 97.5 | — | |
| RSModel=Phi-4 14B, Batch Size=322026.05 | 97.4 | — | |
| RSModel=Llama 3.1 8B, Batch Size=162026.05 | 97.3 | — | |
| RSModel=Qwen 2.5 7B, Batch Size=82026.05 | 97 | — | |
| RSModel=Falcon 3 7B, Batch Size=82026.05 | 97 | — | |
| RSModel=Llama 2 7B, Batch Size=162026.05 | 96.7 | — | |
| RSModel=Falcon 7B, Batch Size=42026.05 | 96.5 | — | |
| RSModel=Llama 3.1 8B, Batch Size=322026.05 | 96.3 | — | |
| RSModel=Phi-4 14B, Batch Size=642026.05 | 96.3 | — | |
| RSModel=Falcon 3 7B, Batch Size=162026.05 | 96.1 | — | |
| RSModel=Falcon 7B, Batch Size=162026.05 | 96 | — | |
| RSModel=Qwen 2.5 7B, Batch Size=162026.05 | 95.5 | — | |
| RSModel=Llama 3.1 8B, Batch Size=642026.05 | 95 | — | |
| RSModel=Falcon 3 7B, Batch Size=322026.05 | 95 | — | |
| RSModel=Llama 2 7B, Batch Size=322026.05 | 94.7 | — | |
| RSModel=Llama 2 7B, Batch Size=642026.05 | 93.9 | — | |
| RSModel=Falcon 7B, Batch Size=322026.05 | 93.7 | — | |
| RSModel=Qwen 2.5 7B, Batch Size=322026.05 | 93.5 | — | |
| RSModel=Falcon 3 7B, Batch Size=642026.05 | 92.9 | — | |
| RSModel=Qwen 2.5 7B, Batch Size=642026.05 | 91.5 | — | |
| RSModel=Falcon 7B, Batch Size=642026.05 | 90.3 | — | |
| GUARDModel=Llama 2 7B, Batch Size=12026.05 | 70.1 | — | |
| GUARDModel=Phi-4 14B, Batch Size=12026.05 | 61.2 | — | |
| GUARDModel=Llama 2 7B, Batch Size=22026.05 | 55.4 | — | |
| GUARDModel=Falcon 7B, Batch Size=12026.05 | 53.5 | — | |
| GUARDModel=Llama 3.1 8B, Batch Size=12026.05 | 38.6 | — | |
| GUARDModel=Phi-4 14B, Batch Size=22026.05 | 37.9 | — | |
| GUARDModel=Llama 2 7B, Batch Size=42026.05 | 36.7 | — | |
| GUARDModel=Falcon 3 7B, Batch Size=12026.05 | 36.5 | — | |
| GUARDModel=Qwen 2.5 7B, Batch Size=12026.05 | 35.6 | — | |
| GUARDModel=Falcon 7B, Batch Size=22026.05 | 35.2 | — | |
| GUARDModel=Llama 2 7B, Batch Size=82026.05 | 24.7 | — | |
| GUARDModel=Phi-4 14B, Batch Size=42026.05 | 24.4 | — | |
| GUARDModel=Llama 3.1 8B, Batch Size=22026.05 | 23.9 | — | |
| GUARDModel=Falcon 3 7B, Batch Size=22026.05 | 20.8 | — | |
| GUARDModel=Falcon 7B, Batch Size=42026.05 | 20.1 | — | |
| GUARDModel=Qwen 2.5 7B, Batch Size=22026.05 | 19.1 | — |