SIEM Rule Conversion on Splunk to IBM QRadar
63.4CodeBLEUARuleCon
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ARuleConLarge Language Model=GPT-52026.04 | 63.4 | 64.1 | 65.5 | |
| ARuleConLarge Language Model=DeepSeek-V32026.04 | 61.1 | 62.3 | 63.1 | |
| ARuleConLarge Language Model=LLaMa-32026.04 | 59 | 60.4 | 60.8 | |
| BaselineLarge Language Model=GPT-52026.04 | 58.2 | 58.6 | 60.2 | |
| BaselineLarge Language Model=DeepSeek-V32026.04 | 55.9 | 56.9 | 57.7 | |
| BaselineLarge Language Model=LLaMa-32026.04 | 53.5 | 54.8 | 55.3 |