Machine-generated text detection on Ghostbusters News
100F1 ScoreGigaCheck (Mistral-7B)
Evaluation results
| Method | Links | |
|---|---|---|
| GigaCheck (Mistral-7B)Evaluation Setting=In-Domain2024.10 | 100 | |
| GigaCheck (Mistral-7B)Evaluation Setting=Out-of-Domain2024.10 | 100 | |
| GhostbusterEvaluation Setting=In-Domain2024.10 | 99.5 | |
| RoBERTaEvaluation Setting=In-Domain2024.10 | 99.4 | |
| GhostbusterEvaluation Setting=Out-of-Domain2024.10 | 97.9 | |
| RoBERTaEvaluation Setting=Out-of-Domain2024.10 | 88.3 | |
| Perplexity onlyEvaluation Setting=In-Domain2024.10 | 82.2 | |
| Perplexity onlyEvaluation Setting=Out-of-Domain2024.10 | 71.9 | |
| DetectGPTEvaluation Setting=In-Domain2024.10 | 56.6 | |
| DetectGPTEvaluation Setting=Out-of-Domain2024.10 | 56.6 |