# AIGT detection on HC3 Pruthi attack Overall (in-domain)

Source: [AIGT detection on HC3 Pruthi attack Overall (in-domain)](<https://www.sota2.com/research/sota/aigt-detection-on-hc3-pruthi-attack-overall-in-domain>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:54:24.922Z

Evaluation of AI Generated Text (AIGT) detection performance using the overall results from the HC3 dataset subset generated via the Pruthi attack, measured using OA, AUA, ASR, and ANQ metrics.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | AIGT detection |
| Dataset (including any stated split) | HC3 Pruthi attack Overall (in-domain) |
| Metric | Overall Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Overall Accuracy](<https://www.sota2.com/research/sota/aigt-detection-on-hc3-pruthi-attack-overall-in-domain.md?metric=Overall%20Accuracy>): Higher is better; unit: PERCENT.

- [AUA Score](<https://www.sota2.com/research/sota/aigt-detection-on-hc3-pruthi-attack-overall-in-domain.md?metric=AUA%20Score>): Higher is better; unit: PERCENT.

- [Attack Success Rate](<https://www.sota2.com/research/sota/aigt-detection-on-hc3-pruthi-attack-overall-in-domain.md?metric=Attack%20Success%20Rate>): Lower is better; unit: PERCENT.

- [ANQ Score](<https://www.sota2.com/research/sota/aigt-detection-on-hc3-pruthi-attack-overall-in-domain.md?metric=ANQ%20Score>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Overall Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| RoBERTa | 100 | Not recorded | 68fa73e41e209131cea5eb76 |
| DeBERTa | 100 | Not recorded | 68fa73e41e209131cea5eb76 |
| Flooding | 100 | Not recorded | 68fa73e41e209131cea5eb76 |
| RanMASK | 100 | Not recorded | 68fa73e41e209131cea5eb76 |
| RMLM | 100 | Not recorded | 68fa73e41e209131cea5eb76 |
| SCRN | 100 | Not recorded | 68fa73e41e209131cea5eb76 |
| SeqXGPT | 99.75 | Not recorded | 68fa73e41e209131cea5eb76 |
| BERT | 99.75 | Not recorded | 68fa73e41e209131cea5eb76 |
| RDrop | 99.75 | Not recorded | 68fa73e41e209131cea5eb76 |
| ChatGPT-Detector | 99 | Not recorded | 68fa73e41e209131cea5eb76 |
| Log-Likelihood | 98 | Not recorded | 68fa73e41e209131cea5eb76 |
| Log-Rank | 97.75 | Not recorded | 68fa73e41e209131cea5eb76 |
| GLTR | 97 | Not recorded | 68fa73e41e209131cea5eb76 |
| Entropy | 90.5 | Not recorded | 68fa73e41e209131cea5eb76 |

### RoBERTa

Overall Accuracy: 100. Result ID: 699311603a6c314849137766.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73e41e209131cea5eb76.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66131e209131cea0e18b.md>)

[Implementation](<https://github.com/pytorch/fairseq>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### DeBERTa

Overall Accuracy: 100. Result ID: 699311603a6c314849137767.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73e41e209131cea5eb76.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6aef1e209131cea2b2a6.md>)

[Implementation](<https://github.com/microsoft/DeBERTa111>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Flooding

Overall Accuracy: 100. Result ID: 699311603a6c314849137769.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73e41e209131cea5eb76.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69af1e209131cea2361d.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### RanMASK

Overall Accuracy: 100. Result ID: 699311603a6c31484913776b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73e41e209131cea5eb76.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a751e209131cea2844a.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### RMLM

Overall Accuracy: 100. Result ID: 699311603a6c31484913776c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73e41e209131cea5eb76.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### SCRN

Overall Accuracy: 100. Result ID: 699311603a6c31484913776d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73e41e209131cea5eb76.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa73e41e209131cea5eb76.md>)

[Implementation](<https://github.com/CarlanLark/Robust-AIGC-Detector>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### SeqXGPT

Overall Accuracy: 99.75. Result ID: 699311603a6c314849137764.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73e41e209131cea5eb76.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa71751e209131cea51585.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### BERT

Overall Accuracy: 99.75. Result ID: 699311603a6c314849137765.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73e41e209131cea5eb76.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65c31e209131cea0c4ed.md>)

[Implementation](<https://github.com/google-research/bert>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### RDrop

Overall Accuracy: 99.75. Result ID: 699311603a6c31484913776a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73e41e209131cea5eb76.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b2c1e209131cea2c8c6.md>)

[Implementation](<https://github.com/dropreg/R-Drop>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### ChatGPT-Detector

Overall Accuracy: 99. Result ID: 699311603a6c314849137768.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73e41e209131cea5eb76.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e641e209131cea3fab2.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Log-Likelihood

Overall Accuracy: 98. Result ID: 699311603a6c314849137760.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73e41e209131cea5eb76.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa66ae1e209131cea11b7a.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Log-Rank

Overall Accuracy: 97.75. Result ID: 699311603a6c314849137761.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73e41e209131cea5eb76.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa701a1e209131cea49064.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### GLTR

Overall Accuracy: 97. Result ID: 699311603a6c314849137763.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73e41e209131cea5eb76.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65e11e209131cea0d18b.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Entropy

Overall Accuracy: 90.5. Result ID: 699311603a6c314849137762.

[Reporting paper](<https://www.sota2.com/research/paper/68fa73e41e209131cea5eb76.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65e11e209131cea0d18b.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
