SIEM Rule Conversion on IBM QRadar to Microsoft Sentinel
67.5CodeBLEUARuleCon
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ARuleConLarge Language Model=GPT-52026.04 | 67.5 | 72.5 | 57.4 | |
| ARuleConLarge Language Model=DeepSeek-V32026.04 | 64.4 | 69.3 | 55.1 | |
| BaselineLarge Language Model=GPT-52026.04 | 62.1 | 67.3 | 52.3 | |
| ARuleConLarge Language Model=LLaMa-32026.04 | 61.2 | 66.2 | 52.6 | |
| BaselineLarge Language Model=DeepSeek-V32026.04 | 59 | 64.2 | 50 | |
| BaselineLarge Language Model=LLaMa-32026.04 | 56 | 61 | 47.5 |