Pre-training Data Detection on ArXivTection (test)
99.1PowerJECS
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| JECSModel=NeoX-20B, Detection Score=Min-K%++, alpha (significance level)=0.3, K=162026.05 | 99.1 | — | — | |
| JECSModel=LLaMA-7B, Detection Score=Min-K%++, alpha (significance level)=0.3, K=162026.05 | 98.6 | — | — | |
| JECSModel=NeoX-20B, Detection Score=Min-K%++, alpha (significance level)=0.2, K=162026.05 | 98.3 | — | — | |
| JECSModel=NeoX-20B, Detection Score=Min-K%, alpha (significance level)=0.3, K=162026.05 | 98.3 | — | — | |
| JECSModel=NeoX-20B, Detection Score=Perplexity, alpha (significance level)=0.3, K=162026.05 | 97.3 | — | — | |
| JECSModel=NeoX-20B, Detection Score=M-Entropy, alpha (significance level)=0.3, K=162026.05 | 97.3 | — | — | |
| JECSModel=LLaMA-7B, Detection Score=Min-K%, alpha (significance level)=0.3, K=162026.05 | 97.3 | — | — | |
| JMCSModel=NeoX-20B, Detection Score=Min-K%++, alpha (significance level)=0.3, K=162026.05 | 97.2 | — | — | |
| JECSModel=LLaMA-7B, Detection Score=Min-K%++, alpha (significance level)=0.2, K=162026.05 | 95.2 | — | — | |
| JECSModel=NeoX-20B, Detection Score=Min-K%, alpha (significance level)=0.2, K=162026.05 | 95.1 | — | — | |
| JMCSModel=NeoX-20B, Detection Score=Min-K%++, alpha (significance level)=0.2, K=162026.05 | 94.4 | — | — | |
| JECSModel=NeoX-20B, Detection Score=Min-K%++, alpha (significance level)=0.1, K=162026.05 | 93.9 | — | — | |
| JECSModel=NeoX-20B, Detection Score=Perplexity, alpha (significance level)=0.2, K=162026.05 | 93.4 | — | — | |
| JECSModel=LLaMA-7B, Detection Score=Perplexity, alpha (significance level)=0.3, K=162026.05 | 93.4 | — | — | |
| JMCSModel=NeoX-20B, Detection Score=Min-K%, alpha (significance level)=0.3, K=162026.05 | 92.6 | — | — | |
| JECSModel=NeoX-20B, Detection Score=M-Entropy, alpha (significance level)=0.2, K=162026.05 | 92.4 | — | — | |
| JMCSModel=LLaMA-7B, Detection Score=Min-K%++, alpha (significance level)=0.3, K=162026.05 | 91.8 | — | — | |
| JECSModel=LLaMA-7B, Detection Score=M-Entropy, alpha (significance level)=0.3, K=162026.05 | 91.8 | — | — | |
| JECSModel=LLaMA-7B, Detection Score=Min-K%, alpha (significance level)=0.2, K=162026.05 | 91.7 | — | — | |
| JMCSModel=NeoX-20B, Detection Score=Perplexity, alpha (significance level)=0.3, K=162026.05 | 90.9 | — | — | |
| JMCSModel=NeoX-20B, Detection Score=M-Entropy, alpha (significance level)=0.3, K=162026.05 | 88.6 | — | — | |
| JECSModel=Pythia-6.9B, Detection Score=Perplexity, alpha (significance level)=0.3, K=162026.05 | 87.8 | — | — | |
| JECSModel=Pythia-6.9B, Detection Score=Min-K%++, alpha (significance level)=0.3, K=162026.05 | 87.6 | — | — | |
| JMCSModel=NeoX-20B, Detection Score=Min-K%++, alpha (significance level)=0.1, K=162026.05 | 87.2 | — | — | |
| JMCSModel=NeoX-20B, Detection Score=Min-K%, alpha (significance level)=0.2, K=162026.05 | 87.1 | — | — | |
| JECSModel=Pythia-6.9B, Detection Score=Min-K%, alpha (significance level)=0.3, K=162026.05 | 87.1 | — | — | |
| JECSModel=NeoX-20B, Detection Score=Min-K%, alpha (significance level)=0.1, K=162026.05 | 85.4 | — | — | |
| JECSModel=LLaMA-7B, Detection Score=Perplexity, alpha (significance level)=0.2, K=162026.05 | 84.8 | — | — | |
| JMCSModel=LLaMA-7B, Detection Score=Min-K%++, alpha (significance level)=0.2, K=162026.05 | 84.4 | — | — | |
| JECSModel=LLaMA-7B, Detection Score=Min-K%++, alpha (significance level)=0.1, K=162026.05 | 84.1 | — | — | |
| JMCSModel=NeoX-20B, Detection Score=Perplexity, alpha (significance level)=0.2, K=162026.05 | 82.9 | — | — | |
| JECSModel=Pythia-6.9B, Detection Score=M-Entropy, alpha (significance level)=0.3, K=162026.05 | 82.6 | — | — | |
| JECSModel=NeoX-20B, Detection Score=Perplexity, alpha (significance level)=0.1, K=162026.05 | 81.7 | — | — | |
| JECSModel=LLaMA-7B, Detection Score=M-Entropy, alpha (significance level)=0.2, K=162026.05 | 81.3 | — | — | |
| JMCSModel=LLaMA-7B, Detection Score=Min-K%, alpha (significance level)=0.3, K=162026.05 | 79.3 | — | — | |
| JMCSModel=NeoX-20B, Detection Score=M-Entropy, alpha (significance level)=0.2, K=162026.05 | 78.3 | — | — | |
| JECSModel=NeoX-20B, Detection Score=M-Entropy, alpha (significance level)=0.1, K=162026.05 | 77.6 | — | — | |
| JMCSModel=LLaMA-7B, Detection Score=Perplexity, alpha (significance level)=0.3, K=162026.05 | 75.5 | — | — | |
| JMCSModel=LLaMA-7B, Detection Score=M-Entropy, alpha (significance level)=0.3, K=162026.05 | 71.6 | — | — | |
| JMCSModel=LLaMA-7B, Detection Score=Min-K%++, alpha (significance level)=0.1, K=162026.05 | 71.5 | — | — | |
| JECSModel=LLaMA-7B, Detection Score=Min-K%, alpha (significance level)=0.1, K=162026.05 | 71.5 | — | — | |
| JECSModel=Pythia-6.9B, Detection Score=Min-K%++, alpha (significance level)=0.2, K=162026.05 | 71.3 | — | — | |
| JECSModel=Pythia-6.9B, Detection Score=Perplexity, alpha (significance level)=0.2, K=162026.05 | 68.7 | — | — | |
| JMCSModel=LLaMA-7B, Detection Score=Min-K%, alpha (significance level)=0.2, K=162026.05 | 68 | — | — | |
| JMCSModel=Pythia-6.9B, Detection Score=Min-K%++, alpha (significance level)=0.3, K=162026.05 | 62.7 | — | — | |
| JECSModel=Pythia-6.9B, Detection Score=Min-K%, alpha (significance level)=0.2, K=162026.05 | 61.6 | — | — | |
| JECSModel=LLaMA-7B, Detection Score=Perplexity, alpha (significance level)=0.1, K=162026.05 | 61.4 | — | — | |
| JMCSModel=LLaMA-7B, Detection Score=Perplexity, alpha (significance level)=0.2, K=162026.05 | 57.9 | — | — | |
| JMCSModel=NeoX-20B, Detection Score=Min-K%, alpha (significance level)=0.1, K=162026.05 | 57.6 | — | — | |
| JMCSModel=LLaMA-7B, Detection Score=M-Entropy, alpha (significance level)=0.2, K=162026.05 | 52.3 | — | — | |
| JECSModel=LLaMA-7B, Detection Score=M-Entropy, alpha (significance level)=0.1, K=162026.05 | 51.6 | — | — | |
| JECSModel=Pythia-6.9B, Detection Score=M-Entropy, alpha (significance level)=0.2, K=162026.05 | 49.4 | — | — | |
| JMCSModel=Pythia-6.9B, Detection Score=Min-K%++, alpha (significance level)=0.2, K=162026.05 | 46.5 | — | — | |
| JMCSModel=Pythia-6.9B, Detection Score=Perplexity, alpha (significance level)=0.3, K=162026.05 | 46.4 | — | — | |
| JMCSModel=Pythia-6.9B, Detection Score=Min-K%, alpha (significance level)=0.3, K=162026.05 | 46 | — | — | |
| JECSModel=Pythia-6.9B, Detection Score=Min-K%++, alpha (significance level)=0.1, K=162026.05 | 44.7 | — | — | |
| JMCSModel=NeoX-20B, Detection Score=Perplexity, alpha (significance level)=0.1, K=162026.05 | 40.3 | — | — | |
| JMCSModel=Pythia-6.9B, Detection Score=M-Entropy, alpha (significance level)=0.3, K=162026.05 | 37 | — | — | |
| JMCSModel=NeoX-20B, Detection Score=M-Entropy, alpha (significance level)=0.1, K=162026.05 | 23.5 | — | — | |
| JMCSModel=Pythia-6.9B, Detection Score=Perplexity, alpha (significance level)=0.2, K=162026.05 | 14.9 | — | — | |
| JMCSModel=Pythia-6.9B, Detection Score=Min-K%, alpha (significance level)=0.2, K=162026.05 | 13.9 | — | — | |
| JECSModel=Pythia-6.9B, Detection Score=Perplexity, alpha (significance level)=0.1, K=162026.05 | 13 | — | — | |
| JECSModel=Pythia-6.9B, Detection Score=Min-K%, alpha (significance level)=0.1, K=162026.05 | 12.6 | — | — | |
| JMCSModel=Pythia-6.9B, Detection Score=M-Entropy, alpha (significance level)=0.2, K=162026.05 | 9.5 | — | — | |
| JMCSModel=Pythia-6.9B, Detection Score=Min-K%++, alpha (significance level)=0.1, K=162026.05 | 9.4 | — | — | |
| JMCSModel=LLaMA-7B, Detection Score=Min-K%, alpha (significance level)=0.1, K=162026.05 | 5.5 | — | — | |
| JMCSModel=LLaMA-7B, Detection Score=Perplexity, alpha (significance level)=0.1, K=162026.05 | 4 | — | — | |
| JECSModel=Pythia-6.9B, Detection Score=M-Entropy, alpha (significance level)=0.1, K=162026.05 | 3.7 | — | — | |
| JMCSModel=LLaMA-7B, Detection Score=M-Entropy, alpha (significance level)=0.1, K=162026.05 | 2.6 | — | — | |
| JMCSModel=Pythia-6.9B, Detection Score=Perplexity, alpha (significance level)=0.1, K=162026.05 | 0.7 | — | — | |
| JMCSModel=Pythia-6.9B, Detection Score=Min-K%, alpha (significance level)=0.1, K=162026.05 | 0.6 | — | — | |
| JMCSModel=Pythia-6.9B, Detection Score=M-Entropy, alpha (significance level)=0.1, K=162026.05 | 0.4 | — | — | |
| FSDTarget Model=Neo-2.7B2026.03 | — | 0.91 | 65 | |
| FSDTarget Model=GPT-J-6b2026.03 | — | 0.96 | 79 | |
| FSDTarget Model=OPT-6.7b2026.03 | — | 0.89 | 63 | |
| FSDTarget Model=Pythia-6.9b2026.03 | — | 0.95 | 66 | |
| FSDTarget Model=LLaMA-7B2026.03 | — | 0.94 | 81 | |
| GDSTarget Model=Neo-2.7B2026.03 | — | 0.94 | 73 | |
| GDSTarget Model=GPT-J-6b2026.03 | — | 0.97 | 86 | |
| GDSTarget Model=OPT-6.7b2026.03 | — | 0.94 | 75 | |
| GDSTarget Model=Pythia-6.9b2026.03 | — | 0.95 | 83 | |
| GDSTarget Model=LLaMA-7B2026.03 | — | 0.97 | 85 | |
| Min-kTarget Model=Neo-2.7B2026.03 | — | 0.65 | 17 | |
| Min-kTarget Model=GPT-J-6b2026.03 | — | 0.68 | 19 | |
| Min-kTarget Model=OPT-6.7b2026.03 | — | 0.63 | 15 | |
| Min-kTarget Model=Pythia-6.9b2026.03 | — | 0.67 | 19 | |
| Min-kTarget Model=LLaMA-7B2026.03 | — | 0.72 | 18 | |
| Min-k++Target Model=Neo-2.7B2026.03 | — | 0.67 | 15 | |
| Min-k++Target Model=GPT-J-6b2026.03 | — | 0.69 | 19 | |
| Min-k++Target Model=OPT-6.7b2026.03 | — | 0.65 | 10 | |
| Min-k++Target Model=Pythia-6.9b2026.03 | — | 0.7 | 17 | |
| Min-k++Target Model=LLaMA-7B2026.03 | — | 0.83 | 22 | |
| PPLTarget Model=Neo-2.7B2026.03 | — | 0.62 | 13 | |
| PPLTarget Model=GPT-J-6b2026.03 | — | 0.64 | 13 | |
| PPLTarget Model=OPT-6.7b2026.03 | — | 0.6 | 12 | |
| PPLTarget Model=Pythia-6.9b2026.03 | — | 0.63 | 13 | |
| PPLTarget Model=LLaMA-7B2026.03 | — | 0.7 | 14 | |
| ZLibTarget Model=Neo-2.7B2026.03 | — | 0.58 | 10 | |
| ZLibTarget Model=GPT-J-6b2026.03 | — | 0.6 | 11 | |
| ZLibTarget Model=OPT-6.7b2026.03 | — | 0.58 | 9 |