Machine-Generated Text Detection on Reuters ChatGPT-turbo 1.0 (test)
0.5609TPR@FPR=1%FastGPT
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| FastGPTCalibration=Markov-informed score calibration, Training Source=Claude2026.02 | 0.5609 | 0.9446 | |
| Log-RankCalibration=Markov-informed score calibration, Training Source=Claude2026.02 | 0.376 | 0.7635 | |
| LikelihoodCalibration=Markov-informed score calibration, Training Source=Claude2026.02 | 0.3213 | 0.6945 | |
| DetectGPTCalibration=Markov-informed score calibration, Training Source=Claude2026.02 | 0.288 | 0.8129 | |
| Log-RankCalibration=None, Training Source=Claude2026.02 | 0.152 | 0.5822 | |
| EntropyCalibration=Markov-informed score calibration, Training Source=Claude2026.02 | 0.1324 | 0.5592 | |
| LikelihoodCalibration=None, Training Source=Claude2026.02 | 0.1253 | 0.5877 | |
| DNA-GPTCalibration=Markov-informed score calibration, Training Source=Claude2026.02 | 0.0422 | 0.6813 | |
| DNA-GPTCalibration=None, Training Source=Claude2026.02 | 0.0218 | 0.5485 | |
| EntropyCalibration=None, Training Source=Claude2026.02 | 0.0204 | 0.3808 | |
| FastGPTCalibration=None, Training Source=Claude2026.02 | 0.0004 | 0.1755 | |
| DetectGPTCalibration=None, Training Source=Claude2026.02 | 0 | 0.7725 |