Insecure Coding Practice on CyberSecEval Instruction 1.0
72.1C ScoreCommandR+INDICT
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| CommandR+INDICTEnhancement=INDICT2024.06 | 72.1 | 84.6 | 81.4 | 86.3 | 75.1 | 86.1 | 87.6 | 71.6 | 81 | |
| GPT42024.06 | 70 | 65.5 | 73.4 | 65.5 | 68.7 | 66 | 78.1 | 77.5 | 70.6 | |
| Llama2-13b-chatParameters=13B, Mode=Chat2024.06 | 64.3 | 71.5 | 75.7 | 57.2 | 71.5 | 64.8 | 68.4 | 76.5 | 68.9 | |
| Llama2-7b-chatParameters=7B, Mode=Chat2024.06 | 63.4 | 70.6 | 77.2 | 60.7 | 69.5 | 70.4 | 69.2 | 78.9 | 69.9 | |
| Llama2-70b-chatParameters=70B, Mode=Chat2024.06 | 61.2 | 63.8 | 73.4 | 50.7 | 65.1 | 60.5 | 65.5 | 72.6 | 64.4 | |
| Codellama-13b-instructParameters=13B, Mode=Instruct2024.06 | 60.8 | 68.9 | 71.8 | 54.6 | 60.2 | 66.1 | 67.2 | 68.6 | 64.9 | |
| CommandR2024.06 | 58.6 | 80.4 | 70.6 | 58.1 | 63.1 | 78.2 | 71.8 | 64.2 | 68.2 | |
| Codellama-34b-instructParameters=34B, Mode=Instruct2024.06 | 57.7 | 54.5 | 73.8 | 51.5 | 61 | 64.8 | 66.1 | 69.1 | 62.5 | |
| CommandR+INDICTFramework=INDICT2024.06 | 57.5 | 55.4 | 55.3 | 41.9 | 55.7 | 58.6 | 62 | 55.8 | 55.3 | |
| Llama2-30b-chatParameters=30B, Mode=Chat2024.06 | 56.8 | 62.6 | 71.8 | 52 | 65.9 | 61.1 | 65 | 77.5 | 64.2 | |
| GPT3.52024.06 | 54.2 | 58.7 | 66.4 | 57.2 | 59.1 | 57.2 | 70.5 | 69.1 | 61.6 | |
| GPT-3.5-turbo2024.06 | 53.3 | 69.8 | 71 | 46.7 | 59 | 62.4 | 61.3 | 64.7 | 61.1 | |
| GPT-42024.06 | 52 | 70.2 | 70.3 | 47.6 | 53 | 60.5 | 62.7 | 60.3 | 59.9 | |
| CommandR2024.06 | 51.4 | 48.5 | 48.9 | 46.6 | 54.3 | 49.3 | 54.6 | 54.7 | 51 |