SIEM Rule Conversion on IBM QRadar to Google Chronicle
69.1CodeBLEUARuleCon
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| ARuleConLarge Language Model=GPT-52026.04 | 69.1 | 82.4 | 56.9 | |
| ARuleConLarge Language Model=DeepSeek-V32026.04 | 65.9 | 79.3 | 54.7 | |
| BaselineLarge Language Model=GPT-52026.04 | 63.6 | 76.8 | 51.8 | |
| ARuleConLarge Language Model=LLaMa-32026.04 | 62.8 | 76.1 | 52.1 | |
| BaselineLarge Language Model=DeepSeek-V32026.04 | 60.5 | 74 | 49.6 | |
| BaselineLarge Language Model=LLaMa-32026.04 | 57.3 | 70.6 | 47.1 |