Machine Generated Text Detection on Essay GPT4All (test)
93.58TPR @ FPR=1%DNA-GPT-M
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| DNA-GPT-MTraining Source=ChatGLM2026.02 | 93.58 | 99.37 | — | — | — | — | — | — | — | |
| Likelihood-MTraining data source=Dolly2026.02 | 89.02 | 98.63 | — | — | — | — | — | — | — | |
| DNA-GPT-MTraining data source=Dolly2026.02 | 88.7 | 98.23 | — | — | — | — | — | — | — | |
| Log-Rank-MTraining data source=Dolly2026.02 | 87.7 | 98.55 | — | — | — | — | — | — | — | |
| Log-Rank-MTraining Source=ChatGLM2026.02 | 81.32 | 98.14 | — | — | — | — | — | — | — | |
| Likelihood-MTraining Source=ChatGLM2026.02 | 78.82 | 98.03 | — | — | — | — | — | — | — | |
| Log-RankTraining Source=ChatGLM2026.02 | 62.69 | 96.55 | — | — | — | — | — | — | — | |
| Log-RankTraining data source=Dolly2026.02 | 62.69 | 96.55 | — | — | — | — | — | — | — | |
| DNA-GPTTraining data source=Dolly2026.02 | 58.95 | 94.5 | — | — | — | — | — | — | — | |
| DNA-GPTTraining Source=ChatGLM2026.02 | 57.54 | 96.97 | — | — | — | — | — | — | — | |
| LikelihoodTraining Source=ChatGLM2026.02 | 46.29 | 96.16 | — | — | — | — | — | — | — | |
| LikelihoodTraining data source=Dolly2026.02 | 46.29 | 96.16 | — | — | — | — | — | — | — | |
| DetectGPT-MTraining data source=Dolly2026.02 | 32.89 | 93.62 | — | — | — | — | — | — | — | |
| FastGPT-MTraining data source=Dolly2026.02 | 27.24 | 88.35 | — | — | — | — | — | — | — | |
| FastGPT-MTraining Source=ChatGLM2026.02 | 23.87 | 87.19 | — | — | — | — | — | — | — | |
| DetectGPT-MTraining Source=ChatGLM2026.02 | 18.36 | 80.39 | — | — | — | — | — | — | — | |
| Entropy-MTraining Source=ChatGLM2026.02 | 12.76 | 82.99 | — | — | — | — | — | — | — | |
| Entropy-MTraining data source=Dolly2026.02 | 11.94 | 83.09 | — | — | — | — | — | — | — | |
| EntropyTraining Source=ChatGLM2026.02 | 2.73 | 74.19 | — | — | — | — | — | — | — | |
| EntropyTraining data source=Dolly2026.02 | 2.73 | 74.19 | — | — | — | — | — | — | — | |
| FastGPTTraining Source=ChatGLM2026.02 | 1.59 | 64.63 | — | — | — | — | — | — | — | |
| FastGPTTraining data source=Dolly2026.02 | 0.82 | 35.37 | — | — | — | — | — | — | — | |
| DetectGPTTraining Source=ChatGLM2026.02 | 0 | 50.81 | — | — | — | — | — | — | — | |
| DetectGPTTraining data source=Dolly2026.02 | 0 | 50.81 | — | — | — | — | — | — | — | |
| DetectGPTapplied_calibration=None2026.02 | — | — | 50.81 | 46.4 | 57.48 | 50.41 | 41.54 | 17.9 | 44.09 | |
| DetectGPT-Mapplied_calibration=Markov-informed score calibration2026.02 | — | — | 95.37 | 96.2 | 85.39 | 95.97 | 80.29 | 98.49 | 91.95 | |
| DNA-GPTapplied_calibration=None2026.02 | — | — | 98.08 | 96.56 | 92.78 | 98 | 89.92 | 96.22 | 95.26 | |
| DNA-GPT-Mapplied_calibration=Markov-informed score calibration2026.02 | — | — | 99.68 | 98.88 | 97.04 | 99.26 | 94.73 | 98.85 | 98.07 | |
| Entropyapplied_calibration=None2026.02 | — | — | 74.19 | 89.49 | 73.26 | 84.11 | 86.58 | 95.94 | 83.93 | |
| Entropy-Mapplied_calibration=Markov-informed score calibration2026.02 | — | — | 83.52 | 93.28 | 81.11 | 91.44 | 87.96 | 96.75 | 89.01 | |
| FastGPTapplied_calibration=None2026.02 | — | — | 64.63 | 67.68 | 47.17 | 71.08 | 75.31 | 88.62 | 69.08 | |
| FastGPT-Mapplied_calibration=Markov-informed score calibration2026.02 | — | — | 87.22 | 91.56 | 82.61 | 95.36 | 59.29 | 63.48 | 79.92 | |
| Likelihoodapplied_calibration=None2026.02 | — | — | 96.16 | 98.79 | 90.9 | 99.29 | 92.76 | 99.13 | 96.17 | |
| Likelihood-Mapplied_calibration=Markov-informed score calibration2026.02 | — | — | 98.58 | 99.47 | 94.59 | 99.54 | 94.82 | 99.72 | 97.79 | |
| Log-Rankapplied_calibration=None2026.02 | — | — | 96.55 | 98.95 | 90.08 | 99.36 | 92.01 | 99.24 | 96.03 | |
| Log-Rank-Mapplied_calibration=Markov-informed score calibration2026.02 | — | — | 98.57 | 99.41 | 93.82 | 99.55 | 92.91 | 99.64 | 97.32 |