List your company
ResearchFormerly WizWand

AI-generated text detection on XSum Generated by ChatGPT (test)

1AUROCDPIC
0.2728320.4616160.65040.839184May 21, 2023
Updated 8mo ago

Evaluation results

MethodLinks
DPICAuxiliary Model=ChatGPT2023.051
DPIC(ChatGPT)Interference=Original2023.051
DPIC(ChatGPT)Interference=DIPPER2023.051
DPIC(Vicuna-7b)Interference=DIPPER2023.050.998
DPICAuxiliary Model=Vicuna-7b2023.050.9976
DPIC(Vicuna-7b)Interference=Original2023.050.9976
RADARStrategy=Supervised2023.050.9972
RADARInterference=Original2023.050.9972
DPIC(ChatGPT)Interference=Back-translate2023.050.9972
RADARInterference=DIPPER2023.050.9964
Fast-DetectGPTStrategy=Zero-shot2023.050.9907
Fast-DetectGPTInterference=Original2023.050.9907
DPIC(Vicuna-7b)Interference=Back-translate2023.050.9889
RADARInterference=Back-translate2023.050.9801
Fast-DetectGPTInterference=Back-translate2023.050.9711
LogRankStrategy=Zero-shot2023.050.9584
LogRankInterference=Original2023.050.9584
LikelihoodStrategy=Zero-shot2023.050.9577
LikelihoodInterference=Original2023.050.9577
Fast-DetectGPTInterference=DIPPER2023.050.9536
LikelihoodInterference=Back-translate2023.050.9306
LogRankInterference=Back-translate2023.050.926
LRRStrategy=Zero-shot2023.050.9164
LRRInterference=Original2023.050.9164
RoBERTa-baseBackbone=RoBERTa-base2023.050.915
ROBERTa-baseInterference=Original2023.050.915
DNA-GPTAuxiliary Model=Neo-2.72023.050.904
DNA-GPT(Neo-2.7)Interference=Original2023.050.904
DNA-GPT(Neo-2.7)Interference=Back-translate2023.050.8624
LRRInterference=Back-translate2023.050.8621
LogRankInterference=DIPPER2023.050.8596
RoBERTa-largeBackbone=RoBERTa-large2023.050.8507
ROBERTa-largeInterference=Original2023.050.8507
LRRInterference=DIPPER2023.050.8448
LikelihoodInterference=DIPPER2023.050.8438
DNA-GPTAuxiliary Model=ChatGPT2023.050.8396
DNA-GPT(ChatGPT)Interference=Original2023.050.8396
ROBERTa-baseInterference=Back-translate2023.050.8379
ROBERTa-baseInterference=DIPPER2023.050.8148
NPRInterference=Back-translate2023.050.805
DNA-GPT(ChatGPT)Interference=Back-translate2023.050.7975
DNA-GPT(ChatGPT)Interference=DIPPER2023.050.791
ROBERTa-largeInterference=DIPPER2023.050.7884
NPRStrategy=Zero-shot2023.050.7845
NPRInterference=Original2023.050.7845
DNA-GPT(Neo-2.7)Interference=DIPPER2023.050.7733
DNA-GPTAuxiliary Model=Vicuna-7b2023.050.6992
DNA-GPT(Vicuna-7b)Interference=Original2023.050.6992
ROBERTa-largeInterference=Back-translate2023.050.6853
DNA-GPT(Vicuna-7b)Interference=DIPPER2023.050.6528
DNA-GPT(Vicuna-7b)Interference=Back-translate2023.050.6175
NPRInterference=DIPPER2023.050.5648
DetectGPTInterference=Back-translate2023.050.5417
DetectGPTStrategy=Zero-shot2023.050.4594
DetectGPTInterference=Original2023.050.4594
EntropyInterference=DIPPER2023.050.4514
EntropyStrategy=Zero-shot2023.050.3305
EntropyInterference=Original2023.050.3305
DetectGPTInterference=DIPPER2023.050.3074
EntropyInterference=Back-translate2023.050.3008