Machine-Generated Text Detection on DetectRL Training Text: ChatGPT
50.66TPR@FPR-1% (Llama-2-70b)Log-Rank-M
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Log-Rank-MTraining Text=ChatGPT, Variant=Markov/MRF Calibrated2026.02 | 50.66 | 12.73 | 41.41 | 34.93 | 90.23 | 75.4 | 84.44 | 83.35 | — | |
| Likelihood-MTraining Text=ChatGPT, Variant=Markov/MRF Calibrated2026.02 | 45.61 | 12.14 | 33.18 | 30.31 | 78.15 | 67.06 | 73.4 | 72.87 | — | |
| Log-RankTraining Text=ChatGPT2026.02 | 42.05 | 12.44 | 22.84 | 25.78 | 79.67 | 65.85 | 70.66 | 72.06 | — | |
| DNA-GPT-MTraining Text=ChatGPT, Variant=Markov/MRF Calibrated2026.02 | 41.16 | 12.53 | 33.57 | 29.09 | 75.37 | 66.19 | 71.77 | 71.11 | — | |
| LikelihoodTraining Text=ChatGPT2026.02 | 38.37 | 10.21 | 25.66 | 24.75 | 78.58 | 66.61 | 71.42 | 72.2 | — | |
| DNA-GPTTraining Text=ChatGPT2026.02 | 31.03 | 11.05 | 26.4 | 22.83 | 72.53 | 66.07 | 68.35 | 68.98 | — | |
| FastGPT-MTraining Text=ChatGPT, Variant=Markov/MRF Calibrated2026.02 | 27.71 | 13.42 | 17.68 | 19.6 | 71.6 | 61.26 | 66.05 | 66.3 | — | |
| DetectGPT-MTraining Text=ChatGPT, Variant=Markov/MRF Calibrated2026.02 | 25.29 | 7.66 | 14.17 | 15.71 | 73.5 | 62.93 | 61.3 | 65.91 | — | |
| FastGPTTraining Text=ChatGPT2026.02 | 11.35 | 3.78 | 5.02 | 6.72 | 67.72 | 58.5 | 56.68 | 60.97 | — | |
| DetectGPTTraining Text=ChatGPT2026.02 | 3.29 | 5.36 | 2.79 | 3.82 | 49.21 | 49.64 | 50.72 | 49.85 | — | |
| Entropy-MTraining Text=ChatGPT, Variant=Markov/MRF Calibrated2026.02 | 2.13 | 0.27 | 9.27 | 3.89 | 68.61 | 66.83 | 67.93 | 67.79 | — | |
| EntropyTraining Text=ChatGPT2026.02 | 2.03 | 0.25 | 6.95 | 3.07 | 66.21 | 63.09 | 60.73 | 63.34 | — | |
| BinocularsMarkov-informed calibration=false, Training data=GPT4All2026.02 | — | — | — | — | — | — | — | — | 66.55 | |
| Binoculars-MMarkov-informed calibration=true, Training data=GPT4All2026.02 | — | — | — | — | — | — | — | — | 67.43 | |
| FourierGPTMarkov-informed calibration=false, Training data=GPT4All2026.02 | — | — | — | — | — | — | — | — | 50.57 | |
| FourierGPT-MMarkov-informed calibration=true, Training data=GPT4All2026.02 | — | — | — | — | — | — | — | — | 52.64 | |
| LastdeMarkov-informed calibration=false, Training data=GPT4All2026.02 | — | — | — | — | — | — | — | — | 51.93 | |
| Lastde-MMarkov-informed calibration=true, Training data=GPT4All2026.02 | — | — | — | — | — | — | — | — | 52.55 |