Machine-Generated Text Detection on Reuters ChatGPT split
98.09TPR@FPR=1%DNA-GPT-M
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| DNA-GPT-MTraining Generator=Dolly, Calibration=Markov-informed2026.02 | 98.09 | 99.84 | |
| DNA-GPT-MTraining Data=ChatGPT, Variant=Markov-informed score calibration2026.02 | 96.76 | 99.78 | |
| DNA-GPTTraining Generator=Dolly, Calibration=None2026.02 | 91.47 | 99.74 | |
| Log-Rank-MTraining Data=ChatGPT, Variant=Markov-informed score calibration2026.02 | 90.62 | 98.69 | |
| Log-Rank-MTraining Generator=Dolly, Calibration=Markov-informed2026.02 | 90.49 | 98.71 | |
| Likelihood-MTraining Data=ChatGPT, Variant=Markov-informed score calibration2026.02 | 88.98 | 98.68 | |
| Likelihood-MTraining Generator=Dolly, Calibration=Markov-informed2026.02 | 88.58 | 98.45 | |
| Log-RankTraining Data=ChatGPT2026.02 | 86.22 | 97.77 | |
| LikelihoodTraining Data=ChatGPT2026.02 | 81.07 | 97.55 | |
| LikelihoodTraining Generator=Dolly, Calibration=None2026.02 | 81.07 | 97.55 | |
| DNA-GPTTraining Data=ChatGPT2026.02 | 69.78 | 99.17 | |
| DetectGPT-MTraining Data=ChatGPT, Variant=Markov-informed score calibration2026.02 | 47.91 | 92.37 | |
| DetectGPT-MTraining Generator=Dolly, Calibration=Markov-informed2026.02 | 37.2 | 73.22 | |
| FastGPT-MTraining Generator=Dolly, Calibration=Markov-informed2026.02 | 21.78 | 90.23 | |
| Entropy-MTraining Data=ChatGPT, Variant=Markov-informed score calibration2026.02 | 17.47 | 80.07 | |
| Log-RankTraining Generator=Dolly, Calibration=None2026.02 | 17.24 | 21.28 | |
| FastGPT-MTraining Data=ChatGPT, Variant=Markov-informed score calibration2026.02 | 17.07 | 89.97 | |
| Entropy-MTraining Generator=Dolly, Calibration=Markov-informed2026.02 | 7.29 | 56.16 | |
| EntropyTraining Data=ChatGPT2026.02 | 2.49 | 64.65 | |
| FastGPTTraining Data=ChatGPT2026.02 | 2.04 | 60.44 | |
| EntropyTraining Generator=Dolly, Calibration=None2026.02 | 0.04 | 35.35 | |
| FastGPTTraining Generator=Dolly, Calibration=None2026.02 | 0.04 | 39.56 | |
| DetectGPTTraining Data=ChatGPT2026.02 | 0 | 57.18 | |
| DetectGPTTraining Generator=Dolly, Calibration=None2026.02 | 0 | 57.18 |