SIEM Rule Conversion on Splunk to Google Chronicle
63.1CodeBLEUARuleCon
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ARuleConLarge Language Model=GPT-52026.04 | 63.1 | 83.6 | 68 | |
| ARuleConLarge Language Model=DeepSeek-V32026.04 | 60.2 | 80.2 | 65.1 | |
| ARuleConLarge Language Model=LLaMa-32026.04 | 58.1 | 77.5 | 62.9 | |
| BaselineLarge Language Model=GPT-52026.04 | 58 | 77.9 | 62.6 | |
| BaselineLarge Language Model=DeepSeek-V32026.04 | 55 | 74.7 | 59.6 | |
| BaselineLarge Language Model=LLaMa-32026.04 | 53.1 | 71.8 | 57.4 |