AI-generated text detection on PubMed Generated by ChatGPT (test)
0.9082AUROCDPIC
Evaluation Results
| Method | Links | |
|---|---|---|
| DPICAuxiliary Model=ChatGPT2023.05 | 0.9082 | |
| Fast-DetectGPTStrategy=Zero-shot2023.05 | 0.9021 | |
| DPICAuxiliary Model=Vicuna-7b2023.05 | 0.899 | |
| LikelihoodStrategy=Zero-shot2023.05 | 0.8776 | |
| LogRankStrategy=Zero-shot2023.05 | 0.868 | |
| DNA-GPTAuxiliary Model=Neo-2.72023.05 | 0.7598 | |
| LRRStrategy=Zero-shot2023.05 | 0.7421 | |
| RADARStrategy=Supervised2023.05 | 0.7372 | |
| RoBERTa-largeBackbone=RoBERTa-large2023.05 | 0.6731 | |
| DNA-GPTAuxiliary Model=ChatGPT2023.05 | 0.6722 | |
| RoBERTa-baseBackbone=RoBERTa-base2023.05 | 0.6188 | |
| DNA-GPTAuxiliary Model=Vicuna-7b2023.05 | 0.5639 | |
| NPRStrategy=Zero-shot2023.05 | 0.5483 | |
| DetectGPTStrategy=Zero-shot2023.05 | 0.3804 | |
| EntropyStrategy=Zero-shot2023.05 | 0.2766 |