AI-generated text detection on PubMed Generated by GPT-4 (test)
0.9438AUROCDPIC
Evaluation Results
| Method | Links | |
|---|---|---|
| DPICAuxiliary Model=ChatGPT2023.05 | 0.9438 | |
| DPICAuxiliary Model=Vicuna-7b2023.05 | 0.9394 | |
| Fast-DetectGPTStrategy=Zero-shot2023.05 | 0.8498 | |
| LikelihoodStrategy=Zero-shot2023.05 | 0.81 | |
| RADARStrategy=Supervised2023.05 | 0.8029 | |
| LogRankStrategy=Zero-shot2023.05 | 0.7997 | |
| DNA-GPTAuxiliary Model=Neo-2.72023.05 | 0.7163 | |
| LRRStrategy=Zero-shot2023.05 | 0.681 | |
| RoBERTa-largeBackbone=RoBERTa-large2023.05 | 0.6067 | |
| DNA-GPTAuxiliary Model=ChatGPT2023.05 | 0.5745 | |
| DNA-GPTAuxiliary Model=Vicuna-7b2023.05 | 0.5366 | |
| RoBERTa-baseBackbone=RoBERTa-base2023.05 | 0.5309 | |
| NPRStrategy=Zero-shot2023.05 | 0.4976 | |
| DetectGPTStrategy=Zero-shot2023.05 | 0.3675 | |
| EntropyStrategy=Zero-shot2023.05 | 0.3296 |