Machine-Generated Text Detection on Reuters ChatGPT-turbo (test)
98.31TPR@FPR=1%DNA-GPT-M
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| DNA-GPT-MTraining Generator=Dolly, Calibration=Markov-informed2026.02 | 98.31 | 0.9986 | |
| DNA-GPTTraining Generator=Dolly, Calibration=None2026.02 | 94.8 | 0.998 | |
| Log-Rank-MTraining Generator=Dolly, Calibration=Markov-informed2026.02 | 94.31 | 0.9902 | |
| Likelihood-MTraining Generator=Dolly, Calibration=Markov-informed2026.02 | 92.93 | 0.9878 | |
| LikelihoodTraining Generator=Dolly, Calibration=None2026.02 | 90.27 | 0.9842 | |
| DetectGPT-MTraining Generator=Dolly, Calibration=Markov-informed2026.02 | 31.56 | 0.663 | |
| Log-RankTraining Generator=Dolly, Calibration=None2026.02 | 18.58 | 0.2077 | |
| Entropy-MTraining Generator=Dolly, Calibration=Markov-informed2026.02 | 16.13 | 0.5833 | |
| FastGPT-MTraining Generator=Dolly, Calibration=Markov-informed2026.02 | 1.51 | 0.5634 | |
| EntropyTraining Generator=Dolly, Calibration=None2026.02 | 0.22 | 0.1755 | |
| DetectGPTTraining Generator=Dolly, Calibration=None2026.02 | 0.04 | 0.2042 | |
| FastGPTTraining Generator=Dolly, Calibration=None2026.02 | 0.04 | 0.1129 |