Out-of-distribution AI-generated text detection on Mistral-Medium OOD unseen domains 3 (test)
99Accuracy (Legal)READER
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| READERBackbone=Qwen2.5-1.5B-Instruct2026.05 | 99 | 85.3 | 96.7 | 93.7 | |
| BISCOPE*Evaluation Protocol=target-adapted setting, Surrogate LLM=Falcon-7B2026.05 | 97 | 86 | 79.7 | 87.6 | |
| IMBD*Evaluation Protocol=target-adapted setting, Surrogate LLM=Falcon-7B2026.05 | 79.3 | 55.3 | 64.3 | 66.3 | |
| ROBERTALARGESurrogate LLM=Falcon-7B, Evaluation Protocol=per-domain configuration2026.05 | 73 | 63.7 | 53.7 | 63.4 | |
| LRRSurrogate LLM=Falcon-7B, Evaluation Protocol=per-domain configuration2026.05 | 68.3 | 56.7 | 56.7 | 60.6 | |
| RADAREvaluation Protocol=per-domain configuration2026.05 | 67 | 60.3 | 58.3 | 61.9 | |
| ENTROPYSurrogate LLM=Falcon-7B, Evaluation Protocol=per-domain configuration2026.05 | 66.3 | 63.7 | 76.3 | 68.8 | |
| LOGRANKSurrogate LLM=Falcon-7B, Evaluation Protocol=per-domain configuration2026.05 | 64.3 | 63.7 | 67.7 | 65.2 | |
| LIKELIHOODSurrogate LLM=Falcon-7B, Evaluation Protocol=per-domain configuration2026.05 | 63.3 | 64.3 | 72 | 66.6 | |
| DNAGPTSurrogate LLM=Falcon-7B, Evaluation Protocol=per-domain configuration2026.05 | 63.3 | 67.7 | 71 | 67.3 | |
| ROBERTABASESurrogate LLM=Falcon-7B, Evaluation Protocol=per-domain configuration2026.05 | 62.7 | 59.7 | 59.7 | 60.7 | |
| ADADETECTGPT*Evaluation Protocol=target-adapted setting, Surrogate LLM=Falcon-7B2026.05 | 62 | 54 | 64.3 | 60.1 | |
| NPRSurrogate LLM=Falcon-7B, Evaluation Protocol=per-domain configuration2026.05 | 61.7 | 61.3 | 60.7 | 61.2 | |
| FAST-DETECTGPTSurrogate LLM=Falcon-7B, Evaluation Protocol=per-domain configuration2026.05 | 59 | 62.3 | 60.3 | 60.6 | |
| BINOCULARSEvaluation Protocol=per-domain configuration2026.05 | 58.7 | 61.3 | 60 | 60 | |
| DETECTGPTSurrogate LLM=Falcon-7B, Evaluation Protocol=per-domain configuration2026.05 | 55.7 | 60.3 | 61.7 | 59.2 |