Model Fingerprinting on System Prompt Variations
96Fastchat ScoreBase+S2.7-P+[D+Z]
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Base+S2.7-P+[D+Z]Task Combination=Base+S2.7-P+[D+Z]2025.05 | 96 | 84 | 90 | 88 | 72 | 86 | 90 | 82 | 86 | |
| Base+Chat TemplateTask Combination=Base+Chat Template2025.05 | 54 | 47 | 72 | 53 | 26 | 48 | 52 | 38 | 45 | |
| Base+Homologous ModelTask Combination=Base+Homologous Model2025.05 | 39 | 30 | 56 | 34 | 22 | 33 | 37 | 30 | 35 | |
| Base (64)Task Combination=Base (64)2025.05 | 22 | 22 | 48 | 32 | 18 | 20 | 24 | 20 | 30 | |
| Base (32)Task Combination=Base (32)2025.05 | 16 | 10 | 26 | 14 | 8 | 10 | 10 | 14 | 10 | |
| Base+Non-Homologous ModelTask Combination=Base+Non-Homologous Model2025.05 | 0 | 0 | 0 | 0 | 2 | 0 | 2 | 2 | 0 |