Dog Whistle Presence Detection on Synthetic-Detection 1.0 (test)
73.5AccGemini
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| GeminiProtocol=Few-shot2024.06 | 73.5 | 73.5 | |
| GPT 4Protocol=Few-shot2024.06 | 67 | 61.9 | |
| MixtralProtocol=Few-shot2024.06 | 67 | 59.3 | |
| GeminiProtocol=Zero-shot2024.06 | 66.7 | 56 | |
| GPT 3.5Protocol=Few-shot2024.06 | 60.6 | 53 | |
| MixtralProtocol=Zero-shot2024.06 | 58 | 43.2 | |
| GPT 4Protocol=Zero-shot2024.06 | 54.6 | 37.1 | |
| GPT 3.5Protocol=Zero-shot2024.06 | 52 | 46.7 | |
| HumanProtocol=Human baseline2024.06 | 47.3 | 29.7 | |
| GeminiProtocol=Few-shot2024.06 | 0.867 | 0.883 | |
| GPT 4Protocol=Few-shot2024.06 | 0.866 | 0.874 | |
| GPT 4Protocol=Zero-shot2024.06 | 0.85 | 0.857 | |
| GeminiProtocol=Zero-shot2024.06 | 0.81 | 0.8 | |
| MixtralProtocol=Few-shot2024.06 | 0.81 | 0.8 | |
| GPT 3.5Protocol=Zero-shot2024.06 | 0.8 | 0.831 | |
| GPT 3.5Protocol=Few-shot2024.06 | 0.76 | 0.76 | |
| MixtralProtocol=Zero-shot2024.06 | 0.68 | 0.619 | |
| HumanProtocol=Human baseline2024.06 | 0.668 | 0.648 |