Machine-generated text detection on Ghostbusters Student Essays
100F1 ScoreGigaCheck (Mistral-7B)
Evaluation Results
| Method | Links | |
|---|---|---|
| GigaCheck (Mistral-7B)Evaluation Setting=In-Domain2024.10 | 100 | |
| GhostbusterEvaluation Setting=In-Domain2024.10 | 99.5 | |
| GhostbusterEvaluation Setting=Out-of-Domain2024.10 | 97.7 | |
| RoBERTaEvaluation Setting=In-Domain2024.10 | 97.4 | |
| GigaCheck (Mistral-7B)Evaluation Setting=Out-of-Domain2024.10 | 97.4 | |
| Perplexity onlyEvaluation Setting=Out-of-Domain2024.10 | 93.4 | |
| Perplexity onlyEvaluation Setting=In-Domain2024.10 | 92.1 | |
| RoBERTaEvaluation Setting=Out-of-Domain2024.10 | 71.4 | |
| DetectGPTEvaluation Setting=In-Domain2024.10 | 67.3 | |
| DetectGPTEvaluation Setting=Out-of-Domain2024.10 | 67.3 |