Training data detection on S1
47TPR@1%FPRToken Probability Deviation
Evaluation results
| Method | Links | |
|---|---|---|
| Token Probability DeviationBackbone=Qwen2.5-32B-Instruct, Method category=Output-token-based2025.10 | 47 | |
| Token Probability DeviationBackbone=Qwen2.5-14B-Instruct, Method category=Output-token-based2025.10 | 37.5 | |
| Generated PerplexityBackbone=Qwen2.5-14B-Instruct, Method category=Output-token-based2025.10 | 35 | |
| Generated MIN-K%Backbone=Qwen2.5-14B-Instruct, Method category=Output-token-based2025.10 | 35 | |
| Token Probability DeviationBackbone=Qwen2.5-7B-Instruct, Method category=Output-token-based2025.10 | 34.5 | |
| Generated PerplexityBackbone=Qwen2.5-7B-Instruct, Method category=Output-token-based2025.10 | 23.5 | |
| Generated MIN-K%Backbone=Qwen2.5-7B-Instruct, Method category=Output-token-based2025.10 | 23.5 | |
| Generated PerplexityBackbone=Qwen2.5-32B-Instruct, Method category=Output-token-based2025.10 | 16 | |
| Generated MIN-K%Backbone=Qwen2.5-32B-Instruct, Method category=Output-token-based2025.10 | 16 | |
| Entropy-TempBackbone=Qwen2.5-32B-Instruct, Method category=Output-token-based2025.10 | 13 | |
| Entropy-TempBackbone=Qwen2.5-14B-Instruct, Method category=Output-token-based2025.10 | 12.5 | |
| Entropy-TempBackbone=Qwen2.5-7B-Instruct, Method category=Output-token-based2025.10 | 6 | |
| PerplexityBackbone=Qwen2.5-7B-Instruct, Method category=Input-token-based2025.10 | 4 | |
| MIN-K%Backbone=Qwen2.5-7B-Instruct, Method category=Input-token-based2025.10 | 4 | |
| MIN-K%++Backbone=Qwen2.5-7B-Instruct, Method category=Input-token-based2025.10 | 4 | |
| NeighborBackbone=Qwen2.5-14B-Instruct, Method category=Input-token-based2025.10 | 3 | |
| Entropy-NoiseBackbone=Qwen2.5-7B-Instruct, Method category=Output-token-based2025.10 | 3 | |
| ZlibBackbone=Qwen2.5-7B-Instruct, Method category=Input-token-based2025.10 | 2.5 | |
| NeighborBackbone=Qwen2.5-7B-Instruct, Method category=Input-token-based2025.10 | 2.5 | |
| NeighborBackbone=Qwen2.5-32B-Instruct, Method category=Input-token-based2025.10 | 2.5 | |
| MIN-K%++Backbone=Qwen2.5-32B-Instruct, Method category=Input-token-based2025.10 | 2.5 | |
| Infilling ScoreBackbone=Qwen2.5-32B-Instruct, Method category=Input-token-based2025.10 | 2.5 | |
| Entropy-NoiseBackbone=Qwen2.5-32B-Instruct, Method category=Output-token-based2025.10 | 2.5 | |
| LowercaseBackbone=Qwen2.5-7B-Instruct, Method category=Input-token-based2025.10 | 2 | |
| Infilling ScoreBackbone=Qwen2.5-14B-Instruct, Method category=Input-token-based2025.10 | 2 | |
| PerplexityBackbone=Qwen2.5-14B-Instruct, Method category=Input-token-based2025.10 | 1.5 | |
| PerplexityBackbone=Qwen2.5-32B-Instruct, Method category=Input-token-based2025.10 | 1.5 | |
| LowercaseBackbone=Qwen2.5-14B-Instruct, Method category=Input-token-based2025.10 | 1.5 | |
| ZlibBackbone=Qwen2.5-14B-Instruct, Method category=Input-token-based2025.10 | 1.5 | |
| MIN-K%Backbone=Qwen2.5-32B-Instruct, Method category=Input-token-based2025.10 | 1.5 | |
| Self-CritiqueBackbone=Qwen2.5-7B-Instruct, Method category=Output-token-based2025.10 | 1.5 | |
| MIN-K%Backbone=Qwen2.5-14B-Instruct, Method category=Input-token-based2025.10 | 1 | |
| Infilling ScoreBackbone=Qwen2.5-7B-Instruct, Method category=Input-token-based2025.10 | 1 | |
| Entropy-NoiseBackbone=Qwen2.5-14B-Instruct, Method category=Output-token-based2025.10 | 1 | |
| ZlibBackbone=Qwen2.5-32B-Instruct, Method category=Input-token-based2025.10 | 0.5 | |
| Self-CritiqueBackbone=Qwen2.5-14B-Instruct, Method category=Output-token-based2025.10 | 0.5 | |
| Self-CritiqueBackbone=Qwen2.5-32B-Instruct, Method category=Output-token-based2025.10 | 0.5 | |
| LowercaseBackbone=Qwen2.5-32B-Instruct, Method category=Input-token-based2025.10 | 0 | |
| MIN-K%++Backbone=Qwen2.5-14B-Instruct, Method category=Input-token-based2025.10 | 0 |