Threat Detection on SIEM log entries 20,000
82.8AccuracySQM
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| SQMModel Label=Proposed2026.04 | 82.8 | 79.5 | 70.8 | 74.9 | 12 | |
| gpt-4o-miniModel Type=LLM2026.04 | 82.6 | 77.3 | 79.2 | 78.2 | 15.3 | |
| Llama-3.3Model Type=LLM2026.04 | 76 | 67.2 | 77 | 71.7 | 24.6 | |
| gemmaModel Type=LLM2026.04 | 70.1 | 59.8 | 74.4 | 66.3 | 32.7 | |
| XGBoostModel Type=ML2026.04 | 67.2 | 77.5 | 24.2 | 36.8 | 4.6 | |
| AdaBoostModel Type=ML2026.04 | 67.1 | 78.9 | 23 | 35.7 | 4 | |
| DeepSeek-V3Model Type=LLM2026.04 | 67.1 | 55.5 | 84.8 | 67.1 | 44.5 | |
| gpt-4oModel Type=LLM2026.04 | 62.1 | 51.4 | 75.8 | 61.3 | 46.9 | |
| DTModel Type=ML2026.04 | 60.8 | 50.4 | 49.2 | 49.8 | 31.6 | |
| NBModel Type=ML2026.04 | 59.2 | 37.2 | 4.5 | 8 | 5 | |
| LogRegModel Type=ML2026.04 | 59 | 48.4 | 55.1 | 51.5 | 38.4 | |
| Qwen3Model Type=LLM2026.04 | 51.4 | 44.7 | 95.8 | 61 | 77.6 |