SIEM Rule Conversion on IBM QRadar to Splunk
67.9CodeBLEUARuleCon
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ARuleConLarge Language Model=GPT-52026.04 | 67.9 | 70.3 | 52.2 | |
| ARuleConLarge Language Model=DeepSeek-V32026.04 | 64.7 | 67.2 | 50.4 | |
| BaselineLarge Language Model=GPT-52026.04 | 62.6 | 65.1 | 47.1 | |
| ARuleConLarge Language Model=LLaMa-32026.04 | 61.8 | 64.1 | 48.1 | |
| BaselineLarge Language Model=DeepSeek-V32026.04 | 59.2 | 62 | 45.2 | |
| BaselineLarge Language Model=LLaMa-32026.04 | 56.4 | 59 | 43 |