Cyber-Threat Intelligence Mitigation on LLM-CTI Mitigation
71.8Patch Recommendation F1LL70
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| LL70Model Category=Industry-leading, general-purpose2025.09 | 71.8 | 26.7 | 25.2 | 59.6 | 52.2 | 53.2 | 86.8 | |
| G5Model Category=Industry-leading, general-purpose2025.09 | 70.2 | 38.2 | 51.4 | 67.2 | 58.6 | 59.1 | 83.1 | |
| Go4Model Category=Industry-leading, general-purpose2025.09 | 67.9 | 21.6 | 39.9 | 65.2 | 57.2 | 57.4 | 71.6 | |
| GRKModel Category=Industry-leading, general-purpose2025.09 | 67.1 | 18.4 | 31.1 | 54.8 | 48.2 | 49.4 | 62.8 | |
| CLDModel Category=Industry-leading, general-purpose2025.09 | 65.9 | 33.9 | 28.6 | 63.3 | 55.7 | 56.1 | 60.1 | |
| SPTModel Category=Cybersecurity-specialized2025.09 | 64.1 | 28.7 | 12.6 | 62.4 | 57.1 | 42.4 | 60.2 | |
| GEMModel Category=Industry-leading, general-purpose2025.09 | 63.6 | 48.2 | 56.7 | 61.1 | 53.7 | 54.7 | 68.2 | |
| ZYSModel Category=Cybersecurity-specialized2025.09 | 63.2 | 28.1 | 31.5 | 61.3 | 56.1 | 62.3 | 65.3 | |
| CBSModel Category=Cybersecurity-specialized2025.09 | 62.9 | 9.4 | 43.3 | 63.1 | 57.6 | 62.9 | 66.8 | |
| MIXModel Category=Industry-leading, general-purpose2025.09 | 60.1 | 21.3 | 23.6 | 57.8 | 50.8 | 51.9 | 75.3 | |
| QWNModel Category=Industry-leading, general-purpose2025.09 | 58.3 | 33.7 | 42.2 | 56.1 | 49.5 | 50.4 | 63.9 | |
| FSCModel Category=Cybersecurity-specialized2025.09 | 58.2 | 23.1 | 11.8 | 55.9 | 49.1 | 50.3 | 53.6 | |
| CB0Model Category=Cybersecurity-specialized2025.09 | 56.7 | 30.7 | 30.4 | 54.4 | 47.6 | 48.9 | 42.1 | |
| DHTModel Category=Cybersecurity-specialized2025.09 | 44.6 | 20.2 | 20.8 | 62.9 | 57.5 | 42.9 | 56.4 | |
| LLYModel Category=Cybersecurity-specialized2025.09 | 44.2 | 8.9 | 22.7 | 62.6 | 57.2 | 53.3 | 46.4 |