Incident Analysis on Incident Analysis Scenarios
100Recall: Fake AuthenticatorClaude Sonnet 4
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Claude Sonnet 42026.03 | 100 | 100 | 100 | 100 | 100 | 0 | |
| DeepSeek V32026.03 | 100 | 100 | 100 | 100 | 100 | 0 | |
| Ollama 3.1:70b2026.03 | 100 | 100 | 80 | 100 | 95 | 0.09 | |
| Cisco 8B2026.03 | 100 | 90 | 100 | 70 | 90 | 0.12 | |
| GPT-5.22026.03 | 60 | 100 | 100 | 80 | 85 | 0.17 | |
| GPT-4o2026.03 | 60 | 100 | 80 | 80 | 80 | 0.14 | |
| GPT-42026.03 | 60 | 100 | 80 | 60 | 75 | 0.17 | |
| GPT-5-mini2026.03 | 60 | 100 | 80 | 60 | 75 | 0.17 |