AI-generated text detection on RAID GPT-4 classic (test)
30.79TPR @ 0.1% ErrorCalibrated DMAP
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Calibrated DMAPtokens=2002026.05 | 30.79 | 51.55 | 0.9414 | |
| DALDtokens=2002026.05 | 20.62 | 41.89 | 0.9372 | |
| Calibrated Log-Surprisaltokens=2002026.05 | 13.4 | 32.93 | 0.9023 | |
| Baseline Fast-DetectGPTtokens=2002026.05 | 4.9 | 16.04 | 0.7859 | |
| Token Fast-Detecttokens=2002026.05 | 2.66 | 15.78 | 0.7867 | |
| DMAPtokens=2002026.05 | 1.91 | 13.29 | 0.8238 | |
| Token NPRtokens=2002026.05 | 1.74 | 15.02 | 0.7696 | |
| Baseline log-ranktokens=2002026.05 | 1.41 | 10.65 | 0.6151 | |
| Baseline log-surprisaltokens=2002026.05 | 1.18 | 10.91 | 0.6342 | |
| Baseline Binocularstokens=2002026.05 | 1.13 | 5.57 | 0.6319 | |
| Calibrated Token Fast-Detecttokens=2002026.05 | 0.82 | 21.56 | 0.829 | |
| Calibrated Log-Ranktokens=2002026.05 | 0.2 | 20.24 | 0.8145 | |
| Calibrated Token NPRtokens=2002026.05 | 0.18 | 13.76 | 0.7905 | |
| Baseline NPRtokens=2002026.05 | 0.16 | 1.91 | 0.5767 |