Machine-Generated Text Detection on Reuters GPT4All
93.24TPR @ FPR=1%DNA-GPT-M
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DNA-GPT-MTraining Generator=Dolly, Calibration=Markov-informed2026.02 | 93.24 | 99.66 | |
| DNA-GPT-MTraining Data=ChatGPT, Variant=Markov-informed score calibration2026.02 | 86.8 | 99.42 | |
| DNA-GPTTraining Generator=Dolly, Calibration=None2026.02 | 78.71 | 99.19 | |
| Log-Rank-MTraining Generator=Dolly, Calibration=Markov-informed2026.02 | 66.76 | 94.18 | |
| Likelihood-MTraining Source=ChatGPT-turbo2026.02 | 66.62 | 94.79 | |
| Log-Rank-MTraining Data=ChatGPT, Variant=Markov-informed score calibration2026.02 | 63.91 | 93.41 | |
| FastGPT-MTraining Generator=Dolly, Calibration=Markov-informed2026.02 | 61.69 | 96.47 | |
| Log-Rank-MTraining Source=ChatGPT-turbo2026.02 | 60.18 | 92.21 | |
| Likelihood-MTraining Generator=Dolly, Calibration=Markov-informed2026.02 | 59.96 | 93.42 | |
| Likelihood-MTraining Data=ChatGPT, Variant=Markov-informed score calibration2026.02 | 59.73 | 93.97 | |
| FastGPT-MTraining Data=ChatGPT, Variant=Markov-informed score calibration2026.02 | 56.04 | 96.25 | |
| DetectGPT-MTraining Generator=Dolly, Calibration=Markov-informed2026.02 | 42.93 | 80.34 | |
| Log-RankTraining Data=ChatGPT2026.02 | 29.96 | 78.39 | |
| Log-RankTraining Source=ChatGPT-turbo2026.02 | 29.96 | 78.39 | |
| DNA-GPTTraining Data=ChatGPT2026.02 | 29.82 | 97.34 | |
| DetectGPT-MTraining Data=ChatGPT, Variant=Markov-informed score calibration2026.02 | 22.76 | 84.6 | |
| LikelihoodTraining Source=ChatGPT-turbo2026.02 | 19.82 | 75.2 | |
| LikelihoodTraining Data=ChatGPT2026.02 | 19.78 | 75.19 | |
| LikelihoodTraining Generator=Dolly, Calibration=None2026.02 | 19.78 | 75.19 | |
| Entropy-MTraining Data=ChatGPT, Variant=Markov-informed score calibration2026.02 | 7.07 | 55.3 | |
| Log-RankTraining Generator=Dolly, Calibration=None2026.02 | 6.62 | 32.84 | |
| DetectGPT-MTraining Source=ChatGPT-turbo2026.02 | 6.22 | 79.17 | |
| EntropyTraining Generator=Dolly, Calibration=None2026.02 | 6.18 | 72.48 | |
| DNA-GPT-MTraining Source=ChatGPT-turbo2026.02 | 5.82 | 79.05 | |
| Entropy-MTraining Source=ChatGPT-turbo2026.02 | 5.11 | 54.11 | |
| FastGPTTraining Generator=Dolly, Calibration=None2026.02 | 3.56 | 76.5 | |
| Entropy-MTraining Generator=Dolly, Calibration=Markov-informed2026.02 | 2.4 | 49.8 | |
| DNA-GPTTraining Source=ChatGPT-turbo2026.02 | 2.09 | 45.62 | |
| FastGPTTraining Data=ChatGPT2026.02 | 0.31 | 23.5 | |
| FastGPTTraining Source=ChatGPT-turbo2026.02 | 0.31 | 23.5 | |
| EntropyTraining Data=ChatGPT2026.02 | 0.09 | 27.52 | |
| EntropyTraining Source=ChatGPT-turbo2026.02 | 0.09 | 27.52 | |
| DetectGPTTraining Data=ChatGPT2026.02 | 0 | 75.62 | |
| DetectGPTTraining Generator=Dolly, Calibration=None2026.02 | 0 | 75.62 | |
| DetectGPTTraining Source=ChatGPT-turbo2026.02 | 0 | 24.38 | |
| FastGPT-MTraining Source=ChatGPT-turbo2026.02 | 0 | 12.73 |