Writing flaw detection on BenchMarker Writing - Out of Domain, Human
92.6AccuracyGemma-3
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Gemma-3Parameters=27B2026.02 | 92.6 | 2.6 | 0.023 | |
| SAQUET2026.02 | 92.6 | 52.4 | 0.484 | |
| Always Not Flawed2026.02 | 92.5 | 0 | 0 | |
| Gemma-3Parameters=12B2026.02 | 92.3 | 11.2 | 0.093 | |
| Qwen-3Parameters=1.7B2026.02 | 90.8 | 16.3 | 0.122 | |
| Qwen-3Parameters=0.6B2026.02 | 90.2 | 5.6 | 0.015 | |
| Command R2026.02 | 88.5 | 36.9 | 0.308 | |
| Command R+2026.02 | 88.1 | 35.9 | 0.296 | |
| GPT-5Model Variant=Nano2026.02 | 87.8 | 20.5 | 0.139 | |
| Qwen-3Parameters=4B2026.02 | 87.6 | 32.2 | 0.256 | |
| GPT-52026.02 | 87.1 | 36.5 | 0.299 | |
| Gemini 2.5Model Variant=Pro2026.02 | 85.9 | 39.4 | 0.325 | |
| LLaMA-3.1Parameters=8B2026.02 | 85.9 | 21.8 | 0.143 | |
| Gemini 2.5Model Variant=Flash2026.02 | 85.3 | 38.3 | 0.312 | |
| GPT-5Model Variant=Mini2026.02 | 84.1 | 32.2 | 0.245 | |
| Claude 4.5Model Variant=Sonnet2026.02 | 83.1 | 35.5 | 0.278 | |
| LLaMA-3.2Parameters=3B2026.02 | 81.4 | 18.5 | 0.094 | |
| Qwen-3Parameters=32B2026.02 | 80.1 | 33.3 | 0.248 | |
| Qwen-3Parameters=14B2026.02 | 79.9 | 31.6 | 0.23 | |
| Qwen-3Parameters=8B2026.02 | 79.3 | 29.1 | 0.202 | |
| Claude 4.5Model Variant=Haiku2026.02 | 76.1 | 30.7 | 0.215 | |
| Gemma-3Parameters=4B2026.02 | 73.6 | 25 | 0.15 | |
| LLaMA-3.1Parameters=70B2026.02 | 72.7 | 22.5 | 0.121 | |
| Gemini 2.5Model Variant=Lite2026.02 | 71.3 | 28.2 | 0.183 | |
| Random (50/50)2026.02 | 50 | 13 | 0 | |
| LLaMA-3.2Parameters=1B2026.02 | 42.3 | 14 | 0.008 | |
| Always Flawed2026.02 | 7.5 | 13.9 | 0 |