Dog Whistle Identification on Synthetic-Detection 1.0 (test)
75.5AccuracyGemini
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GeminiProtocol=Few-shot2024.06 | 75.5 | 76 | |
| GPT 4Protocol=Few-shot2024.06 | 71.1 | 68.2 | |
| GeminiProtocol=Zero-shot2024.06 | 69.7 | 61.5 | |
| MixtralProtocol=Few-shot2024.06 | 69 | 62.7 | |
| GPT 3.5Protocol=Few-shot2024.06 | 65.7 | 61.4 | |
| GPT 4Protocol=Zero-shot2024.06 | 59.8 | 48 | |
| MixtralProtocol=Zero-shot2024.06 | 59 | 45.3 | |
| GPT 3.5Protocol=Zero-shot2024.06 | 58 | 56.3 | |
| HumanProtocol=Human baseline2024.06 | 49 | 33.6 |