SIEM Rule Conversion on Microsoft Sentinel to Splunk
63.7CodeBLEUARuleCon
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ARuleConLarge Language Model=GPT-52026.04 | 63.7 | 65.2 | 70.9 | |
| ARuleConLarge Language Model=DeepSeek-V32026.04 | 61 | 62.7 | 67.8 | |
| ARuleConLarge Language Model=LLaMa-32026.04 | 58.9 | 60.1 | 64.2 | |
| BaselineLarge Language Model=GPT-52026.04 | 58.6 | 59.8 | 65.4 | |
| BaselineLarge Language Model=DeepSeek-V32026.04 | 55.8 | 57.4 | 62.3 | |
| BaselineLarge Language Model=LLaMa-32026.04 | 53.6 | 54.9 | 58.8 |