Model Fingerprinting Detection on Mistral-7B black-box setting v0.3
98.4True Positive Rate (TPR)LLMPrint
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| LLMPrintModification Type=Quantization, Access=Black-box2025.09 | 98.4 | 1.2 | |
| LLMPrintModification Type=Post-training, Access=Black-box2025.09 | 89.3 | 0 | |
| LLMmapModification Type=Post-training, Access=Black-box2025.09 | 74.8 | 3.9 | |
| TRAPModification Type=Quantization, Access=Black-box2025.09 | 70.3 | 63.3 | |
| TRAPModification Type=Post-training, Access=Black-box2025.09 | 65 | 56.9 | |
| LLMmapModification Type=Quantization, Access=Black-box2025.09 | 57.8 | 26.5 | |
| IPGuardModification Type=Post-training, Access=Black-box2025.09 | 0 | 0 | |
| IPGuardModification Type=Quantization, Access=Black-box2025.09 | 0 | 0 | |
| LLMPrint-CAModification Type=Post-training, Access=Black-box2025.09 | 0 | 0.6 | |
| LLMPrint-CAModification Type=Quantization, Access=Black-box2025.09 | 0 | 0 |