List your company

AI-generated text detection on PubMed Generated by ChatGPT (test)

0.9082AUROCDPIC
0.2513360.4218680.59240.762932May 21, 2023

Evaluation results

MethodLinks
DPICAuxiliary Model=ChatGPT2023.050.9082
Fast-DetectGPTStrategy=Zero-shot2023.050.9021
DPICAuxiliary Model=Vicuna-7b2023.050.899
LikelihoodStrategy=Zero-shot2023.050.8776
LogRankStrategy=Zero-shot2023.050.868
DNA-GPTAuxiliary Model=Neo-2.72023.050.7598
LRRStrategy=Zero-shot2023.050.7421
RADARStrategy=Supervised2023.050.7372
RoBERTa-largeBackbone=RoBERTa-large2023.050.6731
DNA-GPTAuxiliary Model=ChatGPT2023.050.6722
RoBERTa-baseBackbone=RoBERTa-base2023.050.6188
DNA-GPTAuxiliary Model=Vicuna-7b2023.050.5639
NPRStrategy=Zero-shot2023.050.5483
DetectGPTStrategy=Zero-shot2023.050.3804
EntropyStrategy=Zero-shot2023.050.2766