List your company
ResearchFormerly WizWand

AI-generated text detection on XSum Generated by Claude3 (test)

100AUROCDPIC
30.143248.279166.41584.5509May 21, 2023
Updated 8mo ago

Evaluation results

MethodLinks
DPICAuxiliary Model=ChatGPT2023.05100
DPIC(ChatGPT)Interference=Original2023.05100
DPIC(ChatGPT)Interference=DIPPER2023.0599.96
DPIC(Vicuna-7b)Interference=DIPPER2023.0599.96
DPICAuxiliary Model=Vicuna-7b2023.0599.92
DPIC(Vicuna-7b)Interference=Original2023.0599.92
DPIC(ChatGPT)Interference=Back-translate2023.0599.79
DPIC(Vicuna-7b)Interference=Back-translate2023.0599.66
RADARStrategy=Supervised2023.0599.52
RADARInterference=Original2023.0599.52
Fast-DetectGPTStrategy=Zero-shot2023.0599.42
Fast-DetectGPTInterference=Original2023.0599.42
RADARInterference=DIPPER2023.0599.4
Fast-DetectGPTInterference=Back-translate2023.0598.6
LogRankStrategy=Zero-shot2023.0597.83
LogRankInterference=Original2023.0597.83
LikelihoodStrategy=Zero-shot2023.0597.6
LikelihoodInterference=Original2023.0597.6
Fast-DetectGPTInterference=DIPPER2023.0597.2
RADARInterference=Back-translate2023.0597.01
LRRStrategy=Zero-shot2023.0596.09
LRRInterference=Original2023.0596.09
LogRankInterference=Back-translate2023.0594.88
LikelihoodInterference=Back-translate2023.0594.46
LogRankInterference=DIPPER2023.0592.56
LRRInterference=Back-translate2023.0592.43
LRRInterference=DIPPER2023.0592.4
NPRStrategy=Zero-shot2023.0592.32
NPRInterference=Original2023.0592.32
LikelihoodInterference=DIPPER2023.0590.8
DNA-GPTAuxiliary Model=Neo-2.72023.0590.71
DNA-GPT(Neo-2.7)Interference=Original2023.0590.71
NPRInterference=Back-translate2023.0590.42
RoBERTa-largeBackbone=RoBERTa-large2023.0590.27
ROBERTa-largeInterference=Original2023.0590.27
RoBERTa-baseBackbone=RoBERTa-base2023.0589.44
ROBERTa-baseInterference=Original2023.0589.44
DNA-GPTAuxiliary Model=ChatGPT2023.0585.6
DNA-GPT(ChatGPT)Interference=Original2023.0585.6
DNA-GPT(Neo-2.7)Interference=Back-translate2023.0583.99
ROBERTa-largeInterference=DIPPER2023.0581.53
ROBERTa-baseInterference=DIPPER2023.0581.2
ROBERTa-baseInterference=Back-translate2023.0580.52
DNA-GPT(ChatGPT)Interference=DIPPER2023.0579.96
DNA-GPT(Neo-2.7)Interference=DIPPER2023.0578.76
NPRInterference=DIPPER2023.0578.6
DNA-GPT(ChatGPT)Interference=Back-translate2023.0578.14
ROBERTa-largeInterference=Back-translate2023.0575.83
DNA-GPTAuxiliary Model=Vicuna-7b2023.0572.41
DNA-GPT(Vicuna-7b)Interference=Original2023.0572.41
DNA-GPT(Vicuna-7b)Interference=DIPPER2023.0564.03
DNA-GPT(Vicuna-7b)Interference=Back-translate2023.0563.21
DetectGPTInterference=Back-translate2023.0552.73
EntropyInterference=DIPPER2023.0549.78
DetectGPTStrategy=Zero-shot2023.0543.23
DetectGPTInterference=Original2023.0543.23
EntropyStrategy=Zero-shot2023.0541.09
EntropyInterference=Original2023.0541.09
EntropyInterference=Back-translate2023.0536.39
DetectGPTInterference=DIPPER2023.0532.83