Machine Generated Text Detection on Essay Dolly (test)
72.6TPR@FPR=1%DNA-GPT-M
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| DNA-GPT-MTraining data source=Dolly2026.02 | 72.6 | 98.01 | |
| DNA-GPT-MTraining Source=ChatGLM2026.02 | 66.54 | 97.68 | |
| Likelihood-MTraining data source=Dolly2026.02 | 57.14 | 94.44 | |
| Log-Rank-MTraining data source=Dolly2026.02 | 51.65 | 93.78 | |
| DNA-GPTTraining data source=Dolly2026.02 | 48.64 | 95.91 | |
| Log-Rank-MTraining Source=ChatGLM2026.02 | 47.35 | 92.86 | |
| Likelihood-MTraining Source=ChatGLM2026.02 | 46.73 | 93.1 | |
| FastGPT-MTraining data source=Dolly2026.02 | 39.43 | 91.55 | |
| DNA-GPTTraining Source=ChatGLM2026.02 | 39.19 | 94.11 | |
| FastGPT-MTraining Source=ChatGLM2026.02 | 32.89 | 82.58 | |
| Log-RankTraining Source=ChatGLM2026.02 | 25.11 | 90.08 | |
| Log-RankTraining data source=Dolly2026.02 | 25.11 | 90.08 | |
| DetectGPT-MTraining data source=Dolly2026.02 | 24.44 | 90.01 | |
| LikelihoodTraining Source=ChatGLM2026.02 | 20.67 | 90.9 | |
| DetectGPT-MTraining Source=ChatGLM2026.02 | 20.67 | 80.67 | |
| LikelihoodTraining data source=Dolly2026.02 | 20.67 | 90.9 | |
| Entropy-MTraining Source=ChatGLM2026.02 | 13.99 | 81.03 | |
| Entropy-MTraining data source=Dolly2026.02 | 13.22 | 81.05 | |
| EntropyTraining Source=ChatGLM2026.02 | 2.29 | 73.26 | |
| EntropyTraining data source=Dolly2026.02 | 2.29 | 73.26 | |
| FastGPTTraining data source=Dolly2026.02 | 0.38 | 52.83 | |
| FastGPTTraining Source=ChatGLM2026.02 | 0.29 | 47.17 | |
| DetectGPTTraining Source=ChatGLM2026.02 | 0 | 57.48 | |
| DetectGPTTraining data source=Dolly2026.02 | 0 | 57.48 |