Machine Generated Text Detection on Essay Claude (test)
0.4471TPR @ FPR=1%DNA-GPT-M
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| DNA-GPT-MTraining data source=Dolly2026.02 | 0.4471 | 0.9463 | |
| DNA-GPT-MTraining Source=ChatGLM2026.02 | 0.4436 | 0.9624 | |
| Likelihood-MTraining data source=Dolly2026.02 | 0.3436 | 0.9449 | |
| Log-Rank-MTraining data source=Dolly2026.02 | 0.3169 | 0.9281 | |
| Likelihood-MTraining Source=ChatGLM2026.02 | 0.3164 | 0.9347 | |
| DNA-GPTTraining Source=ChatGLM2026.02 | 0.3124 | 0.9284 | |
| DNA-GPTTraining data source=Dolly2026.02 | 0.2924 | 0.8935 | |
| Log-Rank-MTraining Source=ChatGLM2026.02 | 0.2524 | 0.9139 | |
| Log-RankTraining Source=ChatGLM2026.02 | 0.192 | 0.9201 | |
| Log-RankTraining data source=Dolly2026.02 | 0.1916 | 0.9201 | |
| Entropy-MTraining data source=Dolly2026.02 | 0.1849 | 0.8842 | |
| Entropy-MTraining Source=ChatGLM2026.02 | 0.184 | 0.8845 | |
| LikelihoodTraining Source=ChatGLM2026.02 | 0.1231 | 0.9276 | |
| LikelihoodTraining data source=Dolly2026.02 | 0.1231 | 0.9276 | |
| DetectGPT-MTraining data source=Dolly2026.02 | 0.0604 | 0.8142 | |
| DetectGPT-MTraining Source=ChatGLM2026.02 | 0.0489 | 0.6263 | |
| EntropyTraining Source=ChatGLM2026.02 | 0.0391 | 0.8658 | |
| EntropyTraining data source=Dolly2026.02 | 0.0391 | 0.8658 | |
| FastGPTTraining Source=ChatGLM2026.02 | 0.0347 | 0.7531 | |
| FastGPT-MTraining data source=Dolly2026.02 | 0.0098 | 0.5965 | |
| DetectGPTTraining Source=ChatGLM2026.02 | 0.0089 | 0.4154 | |
| DetectGPTTraining data source=Dolly2026.02 | 0.0089 | 0.4154 | |
| FastGPT-MTraining Source=ChatGLM2026.02 | 0.0067 | 0.5928 | |
| FastGPTTraining data source=Dolly2026.02 | 0 | 0.2469 |