Machine-Generated Text Detection on RealDet
91.06TP @ 20% ThresholdBinoculars
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| BinocularsAlgorithm=MCP2025.05 | 91.06 | 86.3 | 90.36 | 90.36 | 89.26 | 92.13 | 87.5 | 92.44 | 86.28 | 92.28 | 84.34 | 91.29 | |
| BinocularsAlgorithm=vanilla2025.05 | 90.96 | 86.2 | 90.36 | 90.19 | 89.16 | 91.83 | 84.98 | 90.9 | 78.98 | 87.77 | 70.16 | 82.22 | |
| Fast-DetectGPTAlgorithm=MCP2025.05 | 87.1 | 84.07 | 84.24 | 86.68 | 80.86 | 86.93 | 76.86 | 85.9 | 73.2 | 83.97 | 69.32 | 81.59 | |
| Fast-DetectGPTAlgorithm=vanilla2025.05 | 86.02 | 83.52 | 81.86 | 85.34 | 77.46 | 84.91 | 72 | 82.76 | 63.74 | 77.38 | 51.22 | 67.52 | |
| Log-RankAlgorithm=MCP2025.05 | 85.12 | 82.95 | 81.88 | 85.27 | 78.36 | 85.63 | 72.22 | 82.93 | 65.84 | 78.9 | 58.28 | 73.36 | |
| Log-RankAlgorithm=vanilla2025.05 | 84.74 | 82.8 | 81.3 | 84.99 | 77.96 | 85.22 | 70.48 | 81.73 | 61.5 | 75.69 | 45.74 | 62.55 | |
| LikelihoodAlgorithm=MCP2025.05 | 84.1 | 82.23 | 80.64 | 84.53 | 76.66 | 84.5 | 70.06 | 81.43 | 62.24 | 76.21 | 52.6 | 68.67 | |
| LikelihoodAlgorithm=vanilla2025.05 | 83.6 | 82.11 | 79.7 | 84.03 | 76.08 | 84.03 | 67.38 | 79.56 | 58.98 | 73.73 | 36.92 | 53.73 | |
| OpenAI-DAlgorithm=MCP2025.05 | 79.4 | 79.54 | 67.74 | 76.4 | 59.14 | 72.28 | 53.98 | 69.18 | 49.7 | 65.94 | 45.5 | 62.34 | |
| DetectGPTAlgorithm=MCP2025.05 | 73.18 | 75.92 | 57.82 | 69.18 | 39.88 | 55.17 | 21.94 | 35.44 | 13.98 | 24.33 | 6.78 | 12.64 | |
| DetectGPTAlgorithm=vanilla2025.05 | 71.1 | 74.42 | 55.14 | 66.78 | 38.2 | 53.35 | 19.88 | 32.62 | 10.42 | 18.7 | 5.96 | 11.19 | |
| OpenAI-DAlgorithm=vanilla2025.05 | 71.06 | 74.39 | 62.94 | 72.8 | 57.98 | 71.16 | 51.5 | 67.11 | 47.32 | 63.81 | 43.62 | 60.53 | |
| EntropyAlgorithm=MCP2025.05 | 70.6 | 74.01 | 48.16 | 60.79 | 31.92 | 46.55 | 17.68 | 29.48 | 9.38 | 16.97 | 5.66 | 10.65 | |
| EntropyAlgorithm=vanilla2025.05 | 68.28 | 72.51 | 46.44 | 59.37 | 30.24 | 44.72 | 14.26 | 24.53 | 6.58 | 12.23 | 3.18 | 6.13 |