Skill Extraction Defense on SkillGuard-5 Evaluation Framework skill-extraction 1.0 (test)
0Exact MatchSkillGuard-5
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SkillGuard-5Model=Deepseek-V3.2, SC=NO, ST=NO2026.04 | 0 | 10.58 | 70.44 | 61 | |
| SkillGuard-5Model=Deepseek-V3.2, SC=NO, ST=FS2026.04 | 0 | 72.42 | 91.32 | 72 | |
| SkillGuard-5Model=Deepseek-V3.2, SC=NO, ST=COT2026.04 | 0 | 65.48 | 89.84 | 73 | |
| SkillGuard-5Model=Deepseek-V3.2, SC=ED, ST=NO2026.04 | 0 | 9.73 | 67.82 | 31 | |
| SkillGuard-5Model=Deepseek-V3.2, SC=ED, ST=FS2026.04 | 0 | 76.86 | 92.89 | 78 | |
| SkillGuard-5Model=Deepseek-V3.2, SC=ED, ST=COT2026.04 | 0 | 18.81 | 72.33 | 29 | |
| SkillGuard-5Model=Deepseek-V3.2, SC=HY, ST=NO2026.04 | 0 | 9.63 | 70.07 | 26 | |
| SkillGuard-5Model=Deepseek-V3.2, SC=HY, ST=FS2026.04 | 0 | 45.73 | 83.08 | 48 | |
| SkillGuard-5Model=Deepseek-V3.2, SC=HY, ST=COT2026.04 | 0 | 15.06 | 72.35 | 42 | |
| SkillGuard-5Model=Deepseek-V3.2, SC=RP, ST=NO2026.04 | 0 | 17.08 | 69.95 | 40 | |
| SkillGuard-5Model=Deepseek-V3.2, SC=RP, ST=FS2026.04 | 0 | 43 | 77.61 | 40 | |
| SkillGuard-5Model=Deepseek-V3.2, SC=RP, ST=COT2026.04 | 0 | 17.58 | 73.57 | 48 | |
| SkillGuard-5Model=Kimi-k2.5, SC=NO, ST=NO2026.04 | 0 | 96.39 | 98.71 | 82 | |
| SkillGuard-5Model=Kimi-k2.5, SC=NO, ST=FS2026.04 | 0 | 98.75 | 99.88 | 82 | |
| SkillGuard-5Model=Kimi-k2.5, SC=NO, ST=COT2026.04 | 0 | 86.28 | 97.56 | 84 | |
| SkillGuard-5Model=Kimi-k2.5, SC=ED, ST=NO2026.04 | 0 | 89.09 | 97.49 | 79 | |
| SkillGuard-5Model=Kimi-k2.5, SC=ED, ST=FS2026.04 | 0 | 97.53 | 99.75 | 88 | |
| SkillGuard-5Model=Kimi-k2.5, SC=ED, ST=COT2026.04 | 0 | 74.98 | 93.53 | 84 | |
| SkillGuard-5Model=Kimi-k2.5, SC=HY, ST=NO2026.04 | 0 | 98.51 | 99.83 | 85 | |
| SkillGuard-5Model=Kimi-k2.5, SC=HY, ST=FS2026.04 | 0 | 90.2 | 97.9 | 82 | |
| SkillGuard-5Model=Kimi-k2.5, SC=HY, ST=COT2026.04 | 0 | 71.45 | 91.91 | 80 | |
| SkillGuard-5Model=Kimi-k2.5, SC=RP, ST=NO2026.04 | 0 | 79.75 | 94.68 | 71 | |
| SkillGuard-5Model=Kimi-k2.5, SC=RP, ST=FS2026.04 | 0 | 80.05 | 94.71 | 73 | |
| SkillGuard-5Model=Kimi-k2.5, SC=RP, ST=COT2026.04 | 0 | 84.48 | 96.85 | 85 | |
| SkillGuard-5Model=MiniMax-M2.7, SC=NO, ST=NO2026.04 | 0 | 82.42 | 94.6 | 87 | |
| SkillGuard-5Model=MiniMax-M2.7, SC=NO, ST=FS2026.04 | 0 | 89.13 | 97.41 | 86 | |
| SkillGuard-5Model=MiniMax-M2.7, SC=NO, ST=COT2026.04 | 0 | 80.02 | 95.1 | 80 | |
| SkillGuard-5Model=MiniMax-M2.7, SC=ED, ST=NO2026.04 | 0 | 61.04 | 89.55 | 61 | |
| SkillGuard-5Model=MiniMax-M2.7, SC=ED, ST=FS2026.04 | 0 | 71.07 | 91.64 | 73 | |
| SkillGuard-5Model=MiniMax-M2.7, SC=ED, ST=COT2026.04 | 0 | 51.57 | 88.05 | 54 | |
| SkillGuard-5Model=MiniMax-M2.7, SC=HY, ST=NO2026.04 | 0 | 56.21 | 87.1 | 0 | |
| SkillGuard-5Model=MiniMax-M2.7, SC=HY, ST=FS2026.04 | 0 | 71.13 | 92.22 | 33 | |
| SkillGuard-5Model=MiniMax-M2.7, SC=HY, ST=COT2026.04 | 0 | 62.95 | 90.45 | 71 | |
| SkillGuard-5Model=MiniMax-M2.7, SC=RP, ST=NO2026.04 | 0 | 62.46 | 89.98 | 55 | |
| SkillGuard-5Model=MiniMax-M2.7, SC=RP, ST=FS2026.04 | 0 | 70.55 | 91.94 | 62 | |
| SkillGuard-5Model=MiniMax-M2.7, SC=RP, ST=COT2026.04 | 0 | 65.67 | 90.56 | 77 | |
| SkillGuard-5Model=GPT-5, SC=NO, ST=NO2026.04 | 0 | 7.5 | 69.85 | 26 | |
| SkillGuard-5Model=GPT-5, SC=NO, ST=FS2026.04 | 0 | 12.29 | 72.89 | 29 | |
| SkillGuard-5Model=GPT-5, SC=NO, ST=COT2026.04 | 0 | 12.55 | 71.59 | 28 | |
| SkillGuard-5Model=GPT-5, SC=ED, ST=NO2026.04 | 0 | 8 | 63.16 | 12 | |
| SkillGuard-5Model=GPT-5, SC=ED, ST=FS2026.04 | 0 | 13.66 | 76.88 | 26 | |
| SkillGuard-5Model=GPT-5, SC=ED, ST=COT2026.04 | 0 | 11.99 | 72.19 | 35 | |
| SkillGuard-5Model=GPT-5, SC=HY, ST=NO2026.04 | 0 | 7.87 | 65.92 | 12 | |
| SkillGuard-5Model=GPT-5, SC=HY, ST=FS2026.04 | 0 | 11.09 | 70.44 | 21 | |
| SkillGuard-5Model=GPT-5, SC=HY, ST=COT2026.04 | 0 | 11.73 | 70.82 | 26 | |
| SkillGuard-5Model=GPT-5, SC=RP, ST=NO2026.04 | 0 | 7.42 | 62.61 | 9 | |
| SkillGuard-5Model=GPT-5, SC=RP, ST=FS2026.04 | 0 | 9.31 | 65.62 | 10 | |
| SkillGuard-5Model=GPT-5, SC=RP, ST=COT2026.04 | 0 | 11.06 | 70.42 | 27 | |
| SkillGuard-5Model=Claude-haiku-4.5, SC=NO, ST=NO2026.04 | 0 | 44.14 | 83.58 | 79 | |
| SkillGuard-5Model=Claude-haiku-4.5, SC=NO, ST=FS2026.04 | 0 | 78.63 | 94.14 | 86 | |
| SkillGuard-5Model=Claude-haiku-4.5, SC=NO, ST=COT2026.04 | 0 | 54.99 | 84.91 | 72 | |
| SkillGuard-5Model=Claude-haiku-4.5, SC=ED, ST=NO2026.04 | 0 | 10.27 | 58.11 | 16 | |
| SkillGuard-5Model=Claude-haiku-4.5, SC=ED, ST=FS2026.04 | 0 | 29.89 | 72.21 | 47 | |
| SkillGuard-5Model=Claude-haiku-4.5, SC=ED, ST=COT2026.04 | 0 | 14.11 | 66.83 | 36 | |
| SkillGuard-5Model=Claude-haiku-4.5, SC=HY, ST=NO2026.04 | 0 | 11.47 | 59.43 | 24 | |
| SkillGuard-5Model=Claude-haiku-4.5, SC=HY, ST=FS2026.04 | 0 | 28.33 | 71.74 | 50 | |
| SkillGuard-5Model=Claude-haiku-4.5, SC=HY, ST=COT2026.04 | 0 | 18.57 | 69.46 | 47 | |
| SkillGuard-5Model=Claude-haiku-4.5, SC=RP, ST=NO2026.04 | 0 | 8.17 | 64.41 | 15 | |
| SkillGuard-5Model=Claude-haiku-4.5, SC=RP, ST=FS2026.04 | 0 | 21.54 | 65.91 | 31 | |
| SkillGuard-5Model=Claude-haiku-4.5, SC=RP, ST=COT2026.04 | 0 | 17.17 | 64.86 | 25 | |
| SkillGuard-5Model=Average, SC=NO, ST=NO2026.04 | 0 | 48.21 | 83.44 | 67 | |
| SkillGuard-5Model=Average, SC=NO, ST=FS2026.04 | 0 | 70.25 | 91.13 | 71 | |
| SkillGuard-5Model=Average, SC=NO, ST=COT2026.04 | 0 | 59.86 | 87.8 | 67 | |
| SkillGuard-5Model=Average, SC=ED, ST=NO2026.04 | 0 | 35.63 | 75.23 | 40 | |
| SkillGuard-5Model=Average, SC=ED, ST=FS2026.04 | 0 | 57.8 | 86.68 | 63 | |
| SkillGuard-5Model=Average, SC=ED, ST=COT2026.04 | 0 | 34.29 | 78.58 | 48 | |
| SkillGuard-5Model=Average, SC=HY, ST=NO2026.04 | 0 | 36.74 | 76.47 | 30 | |
| SkillGuard-5Model=Average, SC=HY, ST=FS2026.04 | 0 | 49.3 | 83.08 | 47 | |
| SkillGuard-5Model=Average, SC=HY, ST=COT2026.04 | 0 | 35.95 | 79 | 53 | |
| SkillGuard-5Model=Average, SC=RP, ST=NO2026.04 | 0 | 34.98 | 76.33 | 38 | |
| SkillGuard-5Model=Average, SC=RP, ST=FS2026.04 | 0 | 44.89 | 79.16 | 43 | |
| SkillGuard-5Model=Average, SC=RP, ST=COT2026.04 | 0 | 39.19 | 79.25 | 52 |