Machine-Generated Text Detection on Reuters (test)
99.87TPR@FPR=1%DNA-GPT-M
Evaluation results
| Method | Links | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| DNA-GPT-MTraining Source LLM=GPT4All, Test Source LLM=ChatGLM2026.02 | 99.87 | 99.94 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DNA-GPT-MTraining Source LLM=GPT4All, Test Source LLM=ChatGPT-turbo2026.02 | 99.24 | 99.89 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DNA-GPT-MTraining Source LLM=GPT4All, Test Source LLM=ChatGPT2026.02 | 98.4 | 99.88 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DNA-GPT-MTraining Source LLM=GPT4All, Test Source LLM=GPT4All2026.02 | 97.51 | 99.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DNA-GPT-MTraining Source LLM=GPT4All, Test Source LLM=Average2026.02 | 94.23 | 99.57 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DNA-GPT-MTraining Source LLM=GPT4All, Test Source LLM=Claude2026.02 | 89.07 | 99.53 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DNA-GPTTraining Source LLM=GPT4All, Test Source LLM=GPT4All2026.02 | 85.2 | 99.51 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DNA-GPT-MTraining Source LLM=GPT4All, Test Source LLM=Dolly2026.02 | 81.29 | 98.39 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Log-Rank-MTraining Source LLM=GPT4All, Test Source LLM=GPT4All2026.02 | 73.82 | 95.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Log-Rank-MTraining Source LLM=GPT4All, Test Source LLM=Average2026.02 | 71.39 | 93.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Likelihood-MTraining Source LLM=GPT4All, Test Source LLM=Average2026.02 | 67.63 | 93.05 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| FastGPT-MTraining Source LLM=GPT4All, Test Source LLM=GPT4All2026.02 | 61.69 | 96.46 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Likelihood-MTraining Source LLM=GPT4All, Test Source LLM=GPT4All2026.02 | 61.42 | 93.74 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DetectGPT-MTraining Source LLM=GPT4All, Test Source LLM=GPT4All2026.02 | 40.89 | 87.58 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| FastGPT-MTraining Source LLM=GPT4All, Test Source LLM=Average2026.02 | 30.56 | 83.09 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Log-RankTraining Source LLM=GPT4All, Test Source LLM=GPT4All2026.02 | 29.91 | 78.39 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DetectGPT-MTraining Source LLM=GPT4All, Test Source LLM=Average2026.02 | 25.24 | 77.65 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| LikelihoodTraining Source LLM=GPT4All, Test Source LLM=GPT4All2026.02 | 19.47 | 75.19 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Entropy-MTraining Source LLM=GPT4All, Test Source LLM=GPT4All2026.02 | 17.42 | 70.31 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| EntropyTraining Source LLM=GPT4All, Test Source LLM=GPT4All2026.02 | 6.18 | 72.48 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| FastGPTTraining Source LLM=GPT4All, Test Source LLM=GPT4All2026.02 | 3.56 | 76.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DetectGPTTraining Source LLM=GPT4All, Test Source LLM=GPT4All2026.02 | 0 | 75.62 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DetectGPTTraining Generator=ChatGLM2026.02 | — | — | 0 | 0 | 0 | 0 | 0.44 | 0.04 | 0.08 | 75.62 | 57.18 | 77.25 | 61.97 | 58.01 | 20.42 | 58.41 | |
| DetectGPT-MTraining Generator=ChatGLM2026.02 | — | — | 40.53 | 14.18 | 45.73 | 38.98 | 2.18 | 5.47 | 24.51 | 87.17 | 77.46 | 86.14 | 89.36 | 57.83 | 64.4 | 77.06 | |
| DNA-GPTTraining Generator=ChatGLM2026.02 | — | — | 27.96 | 66.84 | 16 | 85.51 | 20.49 | 80.4 | 49.53 | 97.1 | 98.94 | 95.56 | 99.29 | 96.95 | 99.22 | 97.85 | |
| DNA-GPT-MTraining Generator=ChatGLM2026.02 | — | — | 82.89 | 94.93 | 56.31 | 98.98 | 57.78 | 96.53 | 81.24 | 99.33 | 99.72 | 97.15 | 99.82 | 98.68 | 99.77 | 99.08 | |
| EntropyTraining Generator=ChatGLM2026.02 | — | — | 4.89 | 0.36 | 10.49 | 0.44 | 0.58 | 1.38 | 3.02 | 62.76 | 40.53 | 56.16 | 49.39 | 33.61 | 30.23 | 45.45 | |
| Entropy-MTraining Generator=ChatGLM2026.02 | — | — | 6.13 | 17.2 | 13.11 | 9.73 | 18.76 | 33.87 | 16.47 | 54.3 | 79.38 | 55.89 | 69.08 | 83.03 | 89.77 | 71.91 | |
| FastGPTTraining Generator=ChatGLM2026.02 | — | — | 0.31 | 2.04 | 0.04 | 3.16 | 1.42 | 23.51 | 5.08 | 23.5 | 60.44 | 17.55 | 66.79 | 58.69 | 88.71 | 52.61 | |
| FastGPT-MTraining Generator=ChatGLM2026.02 | — | — | 56.04 | 17.07 | 61.51 | 26.67 | 0.89 | 1.29 | 27.24 | 96.27 | 89.98 | 96.07 | 92.13 | 66.74 | 56.05 | 82.87 | |
| LikelihoodTraining Generator=ChatGLM2026.02 | — | — | 19.78 | 81.07 | 12.49 | 94.44 | 19.42 | 90.36 | 52.93 | 75.19 | 97.55 | 58.77 | 99.62 | 86.46 | 98.42 | 86 | |
| Likelihood-MTraining Generator=ChatGLM2026.02 | — | — | 41.42 | 86.84 | 31.47 | 98.58 | 20.84 | 91.56 | 61.79 | 87.15 | 98.44 | 77.92 | 99.95 | 87.99 | 98.69 | 91.69 | |
| Log-RankTraining Generator=ChatGLM2026.02 | — | — | 29.96 | 86.22 | 15.2 | 97.33 | 24.58 | 93.2 | 57.75 | 78.39 | 97.77 | 58.22 | 99.61 | 85.68 | 98.67 | 86.39 | |
| Log-Rank-MTraining Generator=ChatGLM2026.02 | — | — | 62.4 | 90.49 | 33.82 | 98.22 | 30.44 | 94.13 | 68.25 | 93.39 | 98.68 | 76.11 | 99.75 | 89.7 | 98.99 | 92.77 |