List your company
ResearchFormerly WizWand

AI-generated text detection on XSum Generated by GPT-4 (test)

0.9996AUROCDPIC
0.1496080.3702790.590950.811621May 21, 2023
Updated 8mo ago

Evaluation results

MethodLinks
DPICAuxiliary Model=ChatGPT2023.050.9996
DPIC(ChatGPT)Interference=Original2023.050.9996
DPIC(ChatGPT)Interference=DIPPER2023.050.9991
DPICAuxiliary Model=Vicuna-7b2023.050.9986
DPIC(Vicuna-7b)Interference=Original2023.050.9986
DPIC(Vicuna-7b)Interference=DIPPER2023.050.9969
RADARStrategy=Supervised2023.050.9931
RADARInterference=Original2023.050.9931
DPIC(ChatGPT)Interference=Back-translate2023.050.9931
RADARInterference=DIPPER2023.050.9924
DPIC(Vicuna-7b)Interference=Back-translate2023.050.9903
RADARInterference=Back-translate2023.050.9608
Fast-DetectGPTInterference=Back-translate2023.050.9137
Fast-DetectGPTStrategy=Zero-shot2023.050.9064
Fast-DetectGPTInterference=Original2023.050.9064
LikelihoodInterference=Back-translate2023.050.8449
LogRankInterference=Back-translate2023.050.8436
Fast-DetectGPTInterference=DIPPER2023.050.8057
LRRInterference=Back-translate2023.050.8003
LikelihoodStrategy=Zero-shot2023.050.7982
LikelihoodInterference=Original2023.050.7982
LogRankStrategy=Zero-shot2023.050.798
LogRankInterference=Original2023.050.798
DNA-GPT(Neo-2.7)Interference=Back-translate2023.050.7776
ROBERTa-baseInterference=Back-translate2023.050.7536
LRRStrategy=Zero-shot2023.050.7453
LRRInterference=Original2023.050.7453
DNA-GPTAuxiliary Model=Neo-2.72023.050.7267
DNA-GPT(Neo-2.7)Interference=Original2023.050.7267
RoBERTa-largeBackbone=RoBERTa-large2023.050.6879
ROBERTa-largeInterference=Original2023.050.6879
ROBERTa-largeInterference=DIPPER2023.050.6833
NPRInterference=Back-translate2023.050.682
RoBERTa-baseBackbone=RoBERTa-base2023.050.6778
ROBERTa-baseInterference=Original2023.050.6778
ROBERTa-largeInterference=Back-translate2023.050.666
LRRInterference=DIPPER2023.050.6607
ROBERTa-baseInterference=DIPPER2023.050.6469
LogRankInterference=DIPPER2023.050.6432
LikelihoodInterference=DIPPER2023.050.6296
DNA-GPTAuxiliary Model=ChatGPT2023.050.6146
DNA-GPT(ChatGPT)Interference=Original2023.050.6146
DNA-GPT(ChatGPT)Interference=Back-translate2023.050.607
DNA-GPT(Vicuna-7b)Interference=Back-translate2023.050.5827
DNA-GPT(Neo-2.7)Interference=DIPPER2023.050.5595
DNA-GPTAuxiliary Model=Vicuna-7b2023.050.5594
DNA-GPT(Vicuna-7b)Interference=Original2023.050.5594
EntropyInterference=DIPPER2023.050.5552
DNA-GPT(Vicuna-7b)Interference=DIPPER2023.050.5523
DNA-GPT(ChatGPT)Interference=DIPPER2023.050.5454
NPRStrategy=Zero-shot2023.050.5211
NPRInterference=Original2023.050.5211
DetectGPTInterference=Back-translate2023.050.453
EntropyStrategy=Zero-shot2023.050.4364
EntropyInterference=Original2023.050.4364
EntropyInterference=Back-translate2023.050.3705
DetectGPTStrategy=Zero-shot2023.050.3408
DetectGPTInterference=Original2023.050.3408
NPRInterference=DIPPER2023.050.3006
DetectGPTInterference=DIPPER2023.050.1823