SIEM Rule Conversion on Splunk to Microsoft Sentinel
63.7CodeBLEUARuleCon
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ARuleConLarge Language Model=GPT-52026.04 | 63.7 | 69.3 | 73.2 | |
| ARuleConLarge Language Model=DeepSeek-V32026.04 | 60.5 | 66.1 | 69.4 | |
| BaselineLarge Language Model=GPT-52026.04 | 58.9 | 63.8 | 67.6 | |
| ARuleConLarge Language Model=LLaMa-32026.04 | 58.6 | 62.7 | 66.2 | |
| BaselineLarge Language Model=DeepSeek-V32026.04 | 55.4 | 60.3 | 63.8 | |
| BaselineLarge Language Model=LLaMa-32026.04 | 52.9 | 57.1 | 60.9 |