Annotation on Annotation Task Suite Toxicity and Safety Domains (various)
84.4AccuracyGPT-4o-mini
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GPT-4o-miniPrompting Condition=DSPy Opt.2026.05 | 84.4 | 0.883 | |
| GPT-4o-miniPrompting Condition=DSPy Aligned2026.05 | 84.3 | 0.883 | |
| GPT-4o-miniPrompting Condition=Few-Shot2026.05 | 84.1 | 0.88 | |
| DeepSeek-V3Prompting Condition=FS + Def2026.05 | 83.8 | 0.893 | |
| Qwen-2.5-72BPrompting Condition=Few-Shot2026.05 | 83.8 | 0.894 | |
| DeepSeek-V3Prompting Condition=DSPy Aligned2026.05 | 83.3 | 0.89 | |
| GPT-4o-miniPrompting Condition=Aligned Def2026.05 | 83.3 | 0.875 | |
| GPT-4o-miniPrompting Condition=FS + Def2026.05 | 83.3 | 0.88 | |
| Qwen-2.5-72BPrompting Condition=Zero-Shot2026.05 | 83.3 | 0.876 | |
| Qwen-2.5-72BPrompting Condition=FS + Def2026.05 | 83.2 | 0.892 | |
| Qwen-2.5-72BPrompting Condition=DSPy Aligned2026.05 | 83.2 | 0.891 | |
| Llama-3.3-70BPrompting Condition=FS + Def2026.05 | 83 | 0.904 | |
| DeepSeek-V3Prompting Condition=Aligned Def2026.05 | 83 | 0.881 | |
| Mixtral-8x7BPrompting Condition=DSPy Opt.2026.05 | 82.8 | 0.86 | |
| Mixtral-8x7BPrompting Condition=Aligned Def2026.05 | 82.7 | 0.868 | |
| Mixtral-8x7BPrompting Condition=DSPy Aligned2026.05 | 82.7 | 0.861 | |
| Llama-3.1-70BPrompting Condition=DSPy Aligned2026.05 | 82.6 | 0.899 | |
| DeepSeek-V3Prompting Condition=Few-Shot2026.05 | 82.6 | 0.89 | |
| Qwen-2.5-72BPrompting Condition=DSPy Opt.2026.05 | 82.5 | 0.887 | |
| Mixtral-8x7BPrompting Condition=Few-Shot2026.05 | 82.4 | 0.868 | |
| Llama-3.3-70BPrompting Condition=Aligned Def2026.05 | 82.3 | 0.892 | |
| Mistral-Small-24BPrompting Condition=FS + Def2026.05 | 82.3 | 0.879 | |
| GPT-4o-miniPrompting Condition=Overall2026.05 | 82.3 | 0.862 | |
| Qwen-2.5-72BPrompting Condition=Aligned Def2026.05 | 82.2 | 0.879 | |
| Qwen-2.5-72BPrompting Condition=Overall2026.05 | 82.2 | 0.872 | |
| Llama-3.1-70BPrompting Condition=Aligned Def2026.05 | 82.1 | 0.888 | |
| Llama-3.1-70BPrompting Condition=FS + Def2026.05 | 82.1 | 0.898 | |
| Llama-3.3-70BPrompting Condition=Few-Shot2026.05 | 82 | 0.896 | |
| Mistral-7BPrompting Condition=DSPy Opt.2026.05 | 82 | 0.827 | |
| Mistral-7BPrompting Condition=DSPy Aligned2026.05 | 81.7 | 0.825 | |
| Mixtral-8x7BPrompting Condition=Overall2026.05 | 81.6 | 0.85 | |
| DeepSeek-V3Prompting Condition=Overall2026.05 | 81.6 | 0.865 | |
| GPT-4o-miniPrompting Condition=Zero-Shot2026.05 | 81.6 | 0.871 | |
| Mistral-7BPrompting Condition=Few-Shot2026.05 | 81.5 | 0.852 | |
| Mistral-7BPrompting Condition=Misaligned2026.05 | 81.4 | 0.823 | |
| Llama-3.3-70BPrompting Condition=DSPy Aligned2026.05 | 81.3 | 0.904 | |
| Mistral-7BPrompting Condition=Aligned Def2026.05 | 81.3 | 0.787 | |
| DeepSeek-V3Prompting Condition=Zero-Shot2026.05 | 81.3 | 0.874 | |
| Llama-3.1-70BPrompting Condition=Few-Shot2026.05 | 81.2 | 0.892 | |
| Mistral-7BPrompting Condition=Overall2026.05 | 81.2 | 0.819 | |
| Mistral-Small-24BPrompting Condition=DSPy Aligned2026.05 | 81.2 | 0.876 | |
| Mixtral-8x7BPrompting Condition=Misaligned2026.05 | 81.2 | 0.843 | |
| Qwen-2.5-72BPrompting Condition=Misaligned2026.05 | 81.2 | 0.868 | |
| GPT-4o-miniPrompting Condition=Misaligned2026.05 | 81.1 | 0.857 | |
| Mistral-Small-24BPrompting Condition=Aligned Def2026.05 | 81 | 0.863 | |
| Mixtral-8x7BPrompting Condition=Zero-Shot2026.05 | 81 | 0.868 | |
| Mixtral-8x7BPrompting Condition=FS + Def2026.05 | 80.9 | 0.859 | |
| DeepSeek-V3Prompting Condition=DSPy Opt.2026.05 | 80.9 | 0.877 | |
| Mistral-7BPrompting Condition=FS + Def2026.05 | 80.8 | 0.838 | |
| Mistral-Small-24BPrompting Condition=Few-Shot2026.05 | 80.8 | 0.87 | |
| Mistral-Small-24BPrompting Condition=Misaligned2026.05 | 80.7 | 0.85 | |
| DeepSeek-V3Prompting Condition=Misaligned2026.05 | 80.7 | 0.856 | |
| Llama-3.3-70BPrompting Condition=Zero-Shot2026.05 | 80.5 | 0.885 | |
| Mistral-7BPrompting Condition=Zero-Shot2026.05 | 80.5 | 0.858 | |
| Mistral-Small-24BPrompting Condition=Overall2026.05 | 80.5 | 0.852 | |
| Llama-3.1-8BPrompting Condition=Aligned Def2026.05 | 80.1 | 0.843 | |
| Llama-3.3-70BPrompting Condition=Overall2026.05 | 80.1 | 0.874 | |
| Llama-3.1-70BPrompting Condition=DSPy Opt.2026.05 | 79.9 | 0.889 | |
| Llama-3.1-70BPrompting Condition=Zero-Shot2026.05 | 79.8 | 0.881 | |
| Llama-3.1-70BPrompting Condition=Overall2026.05 | 79.7 | 0.869 | |
| Mistral-Small-24BPrompting Condition=DSPy Opt.2026.05 | 79.3 | 0.867 | |
| Llama-3.3-70BPrompting Condition=Misaligned2026.05 | 79 | 0.863 | |
| Llama-3.1-70BPrompting Condition=Misaligned2026.05 | 78.1 | 0.859 | |
| Mistral-Small-24BPrompting Condition=Zero-Shot2026.05 | 78 | 0.868 | |
| Llama-3.3-70BPrompting Condition=DSPy Opt.2026.05 | 77.5 | 0.884 | |
| Llama-3.1-8BPrompting Condition=Misaligned2026.05 | 77 | 0.822 | |
| Llama-3.1-8BPrompting Condition=Overall2026.05 | 76.8 | 0.818 | |
| Llama-3.1-8BPrompting Condition=Zero-Shot2026.05 | 76.7 | 0.832 | |
| Llama-3.1-8BPrompting Condition=FS + Def2026.05 | 75.4 | 0.824 | |
| Llama-3.1-8BPrompting Condition=Few-Shot2026.05 | 75.3 | 0.822 | |
| Llama-3.1-8BPrompting Condition=DSPy Aligned2026.05 | 73.5 | 0.821 | |
| Llama-3.1-8BPrompting Condition=DSPy Opt.2026.05 | 72.3 | 0.809 |