SIEM Rule Conversion on Microsoft Sentinel to Google Chronicle
67.2CodeBLEUARuleCon
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ARuleConLarge Language Model=GPT-52026.04 | 67.2 | 75.8 | 62.1 | |
| ARuleConLarge Language Model=DeepSeek-V32026.04 | 64 | 73.1 | 59.7 | |
| BaselineLarge Language Model=GPT-52026.04 | 61.6 | 70.3 | 56.8 | |
| ARuleConLarge Language Model=LLaMa-32026.04 | 61 | 70.2 | 57.1 | |
| BaselineLarge Language Model=DeepSeek-V32026.04 | 58.7 | 67.7 | 54.5 | |
| BaselineLarge Language Model=LLaMa-32026.04 | 55.6 | 64.9 | 51.9 |