SIEM Rule Conversion on Google Chronicle to Splunk
62CodeBLEUARuleCon
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| ARuleConLarge Language Model=GPT-52026.04 | 62 | 68.5 | 57.6 | |
| ARuleConLarge Language Model=DeepSeek-V32026.04 | 59.4 | 66 | 55.1 | |
| ARuleConLarge Language Model=LLaMa-32026.04 | 57.2 | 63.4 | 52.7 | |
| BaselineLarge Language Model=GPT-52026.04 | 56.8 | 63.3 | 52.4 | |
| BaselineLarge Language Model=DeepSeek-V32026.04 | 54.1 | 60.7 | 50 | |
| BaselineLarge Language Model=LLaMa-32026.04 | 52.1 | 58.2 | 47.6 |