Training data detection on S 1.1
11TPR@1%FPRToken Probability Deviation
Evaluation results
| Method | Links | |
|---|---|---|
| Token Probability DeviationBackbone=Qwen2.5-32B-Instruct, Method category=Output-token-based2025.10 | 11 | |
| Token Probability DeviationBackbone=Qwen2.5-7B-Instruct, Method category=Output-token-based2025.10 | 9.5 | |
| Token Probability DeviationBackbone=Qwen2.5-14B-Instruct, Method category=Output-token-based2025.10 | 9 | |
| Generated PerplexityBackbone=Qwen2.5-32B-Instruct, Method category=Output-token-based2025.10 | 8 | |
| Generated MIN-K%Backbone=Qwen2.5-32B-Instruct, Method category=Output-token-based2025.10 | 8 | |
| Generated PerplexityBackbone=Qwen2.5-7B-Instruct, Method category=Output-token-based2025.10 | 7 | |
| Generated MIN-K%Backbone=Qwen2.5-7B-Instruct, Method category=Output-token-based2025.10 | 7 | |
| Infilling ScoreBackbone=Qwen2.5-14B-Instruct, Method category=Input-token-based2025.10 | 4.5 | |
| Generated PerplexityBackbone=Qwen2.5-14B-Instruct, Method category=Output-token-based2025.10 | 4.5 | |
| Generated MIN-K%Backbone=Qwen2.5-14B-Instruct, Method category=Output-token-based2025.10 | 4.5 | |
| Entropy-NoiseBackbone=Qwen2.5-32B-Instruct, Method category=Output-token-based2025.10 | 4 | |
| MIN-K%++Backbone=Qwen2.5-7B-Instruct, Method category=Input-token-based2025.10 | 2.5 | |
| Entropy-NoiseBackbone=Qwen2.5-7B-Instruct, Method category=Output-token-based2025.10 | 2.5 | |
| Entropy-NoiseBackbone=Qwen2.5-14B-Instruct, Method category=Output-token-based2025.10 | 2 | |
| Infilling ScoreBackbone=Qwen2.5-7B-Instruct, Method category=Input-token-based2025.10 | 1.5 | |
| LowercaseBackbone=Qwen2.5-7B-Instruct, Method category=Input-token-based2025.10 | 1 | |
| MIN-K%Backbone=Qwen2.5-14B-Instruct, Method category=Input-token-based2025.10 | 1 | |
| MIN-K%++Backbone=Qwen2.5-14B-Instruct, Method category=Input-token-based2025.10 | 1 | |
| PerplexityBackbone=Qwen2.5-7B-Instruct, Method category=Input-token-based2025.10 | 0.5 | |
| PerplexityBackbone=Qwen2.5-14B-Instruct, Method category=Input-token-based2025.10 | 0.5 | |
| NeighborBackbone=Qwen2.5-7B-Instruct, Method category=Input-token-based2025.10 | 0.5 | |
| NeighborBackbone=Qwen2.5-14B-Instruct, Method category=Input-token-based2025.10 | 0.5 | |
| NeighborBackbone=Qwen2.5-32B-Instruct, Method category=Input-token-based2025.10 | 0.5 | |
| MIN-K%Backbone=Qwen2.5-7B-Instruct, Method category=Input-token-based2025.10 | 0.5 | |
| Entropy-TempBackbone=Qwen2.5-14B-Instruct, Method category=Output-token-based2025.10 | 0.5 | |
| Entropy-TempBackbone=Qwen2.5-32B-Instruct, Method category=Output-token-based2025.10 | 0.5 | |
| Self-CritiqueBackbone=Qwen2.5-7B-Instruct, Method category=Output-token-based2025.10 | 0.5 | |
| PerplexityBackbone=Qwen2.5-32B-Instruct, Method category=Input-token-based2025.10 | 0 | |
| LowercaseBackbone=Qwen2.5-14B-Instruct, Method category=Input-token-based2025.10 | 0 | |
| LowercaseBackbone=Qwen2.5-32B-Instruct, Method category=Input-token-based2025.10 | 0 | |
| ZlibBackbone=Qwen2.5-7B-Instruct, Method category=Input-token-based2025.10 | 0 | |
| ZlibBackbone=Qwen2.5-14B-Instruct, Method category=Input-token-based2025.10 | 0 | |
| ZlibBackbone=Qwen2.5-32B-Instruct, Method category=Input-token-based2025.10 | 0 | |
| MIN-K%Backbone=Qwen2.5-32B-Instruct, Method category=Input-token-based2025.10 | 0 | |
| MIN-K%++Backbone=Qwen2.5-32B-Instruct, Method category=Input-token-based2025.10 | 0 | |
| Infilling ScoreBackbone=Qwen2.5-32B-Instruct, Method category=Input-token-based2025.10 | 0 | |
| Entropy-TempBackbone=Qwen2.5-7B-Instruct, Method category=Output-token-based2025.10 | 0 | |
| Self-CritiqueBackbone=Qwen2.5-14B-Instruct, Method category=Output-token-based2025.10 | 0 | |
| Self-CritiqueBackbone=Qwen2.5-32B-Instruct, Method category=Output-token-based2025.10 | 0 |