Machine-generated text detection on Ghostbusters Creative Writing
100F1 ScoreGigaCheck (Mistral-7B)
Evaluation results
| Method | Links | |
|---|---|---|
| GigaCheck (Mistral-7B)Evaluation Setting=In-Domain2024.10 | 100 | |
| GigaCheck (Mistral-7B)Evaluation Setting=Out-of-Domain2024.10 | 100 | |
| GhostbusterEvaluation Setting=In-Domain2024.10 | 98.4 | |
| RoBERTaEvaluation Setting=In-Domain2024.10 | 97.6 | |
| RoBERTaEvaluation Setting=Out-of-Domain2024.10 | 95.7 | |
| GhostbusterEvaluation Setting=Out-of-Domain2024.10 | 95.3 | |
| Perplexity onlyEvaluation Setting=In-Domain2024.10 | 84.1 | |
| Perplexity onlyEvaluation Setting=Out-of-Domain2024.10 | 49 | |
| DetectGPTEvaluation Setting=In-Domain2024.10 | 48.2 | |
| DetectGPTEvaluation Setting=Out-of-Domain2024.10 | 48.2 |