# AI-generated text detection on Writing Generated by Claude3 (test)

Source: [AI-generated text detection on Writing Generated by Claude3 (test)](<https://www.sota2.com/research/sota/ai-generated-text-detection-on-writing-generated-by-claude3-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:25:56.100Z

Evaluation of AI-generated text detection models using the test split of the Writing Generated by Claude3 dataset, measured by AUROC.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | AI-generated text detection |
| Dataset (including any stated split) | Writing Generated by Claude3 (test) |
| Metric | AUROC |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 15 of 15 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [AUROC](<https://www.sota2.com/research/sota/ai-generated-text-detection-on-writing-generated-by-claude3-test.md?metric=AUROC>): Higher is better; unit: PERCENT.

## Recorded results

| Method | AUROC | Result date | Report paper |
| --- | --- | --- | --- |
| DPIC | 99.5 | Not recorded | 68fa73991e209131cea5d805 |
| DPIC | 99.43 | Not recorded | 68fa73991e209131cea5d805 |
| Fast-DetectGPT | 97.83 | Not recorded | 68fa73991e209131cea5d805 |
| Likelihood | 97.44 | Not recorded | 68fa73991e209131cea5d805 |
| LogRank | 97.32 | Not recorded | 68fa73991e209131cea5d805 |
| NPR | 96.96 | Not recorded | 68fa73991e209131cea5d805 |
| DNA-GPT | 96.55 | Not recorded | 68fa73991e209131cea5d805 |
| LRR | 95.98 | Not recorded | 68fa73991e209131cea5d805 |
| RADAR | 94.38 | Not recorded | 68fa73991e209131cea5d805 |
| DNA-GPT | 87.67 | Not recorded | 68fa73991e209131cea5d805 |
| RoBERTa-base | 80.36 | Not recorded | 68fa73991e209131cea5d805 |
| DNA-GPT | 73.05 | Not recorded | 68fa73991e209131cea5d805 |
| RoBERTa-large | 71.28 | Not recorded | 68fa73991e209131cea5d805 |
| DetectGPT | 68 | Not recorded | 68fa73991e209131cea5d805 |
| Entropy | 8.36 | Not recorded | 68fa73991e209131cea5d805 |

### DPIC

AUROC: 99.5. Result ID: 6993042f3a6c31484913130e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73991e209131cea5d805.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73991e209131cea5d805.md>)

Recorded evaluation configuration: {"Auxiliary Model":"ChatGPT"}. This record does not assert independent reproduction.

### DPIC

AUROC: 99.43. Result ID: 6993042f3a6c31484913130f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73991e209131cea5d805.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73991e209131cea5d805.md>)

Recorded evaluation configuration: {"Auxiliary Model":"Vicuna-7b"}. This record does not assert independent reproduction.

### Fast-DetectGPT

AUROC: 97.83. Result ID: 6993042f3a6c31484913130d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73991e209131cea5d805.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76341e209131cea6bcf2.md>)

Recorded evaluation configuration: {"Strategy":"Zero-shot"}. This record does not assert independent reproduction.

### Likelihood

AUROC: 97.44. Result ID: 6993042f3a6c314849131304.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73991e209131cea5d805.md>)

Recorded evaluation configuration: {"Strategy":"Zero-shot"}. This record does not assert independent reproduction.

### LogRank

AUROC: 97.32. Result ID: 6993042f3a6c314849131306.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73991e209131cea5d805.md>)

Recorded evaluation configuration: {"Strategy":"Zero-shot"}. This record does not assert independent reproduction.

### NPR

AUROC: 96.96. Result ID: 6993042f3a6c31484913130b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73991e209131cea5d805.md>)

Recorded evaluation configuration: {"Strategy":"Zero-shot"}. This record does not assert independent reproduction.

### DNA-GPT

AUROC: 96.55. Result ID: 6993042f3a6c314849131308.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73991e209131cea5d805.md>)

Recorded evaluation configuration: {"Auxiliary Model":"Neo-2.7"}. This record does not assert independent reproduction.

### LRR

AUROC: 95.98. Result ID: 6993042f3a6c314849131307.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73991e209131cea5d805.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6fbc1e209131cea4720c.md>)

Recorded evaluation configuration: {"Strategy":"Zero-shot"}. This record does not assert independent reproduction.

### RADAR

AUROC: 94.38. Result ID: 6993042f3a6c314849131303.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73991e209131cea5d805.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70f81e209131cea4e73e.md>)

Recorded evaluation configuration: {"Strategy":"Supervised"}. This record does not assert independent reproduction.

### DNA-GPT

AUROC: 87.67. Result ID: 6993042f3a6c314849131309.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73991e209131cea5d805.md>)

Recorded evaluation configuration: {"Auxiliary Model":"ChatGPT"}. This record does not assert independent reproduction.

### RoBERTa-base

AUROC: 80.36. Result ID: 6993042f3a6c314849131301.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73991e209131cea5d805.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66131e209131cea0e18b.md>)

[Implementation](<https://github.com/pytorch/fairseq>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-base"}. This record does not assert independent reproduction.

### DNA-GPT

AUROC: 73.05. Result ID: 6993042f3a6c31484913130a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73991e209131cea5d805.md>)

Recorded evaluation configuration: {"Auxiliary Model":"Vicuna-7b"}. This record does not assert independent reproduction.

### RoBERTa-large

AUROC: 71.28. Result ID: 6993042f3a6c314849131302.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73991e209131cea5d805.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66131e209131cea0e18b.md>)

[Implementation](<https://github.com/pytorch/fairseq>)

Recorded evaluation configuration: {"Backbone":"RoBERTa-large"}. This record does not assert independent reproduction.

### DetectGPT

AUROC: 68. Result ID: 6993042f3a6c31484913130c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73991e209131cea5d805.md>)

Recorded evaluation configuration: {"Strategy":"Zero-shot"}. This record does not assert independent reproduction.

### Entropy

AUROC: 8.36. Result ID: 6993042f3a6c314849131305.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73991e209131cea5d805.md>)

Recorded evaluation configuration: {"Strategy":"Zero-shot"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
