Text Naturalness Evaluation on DeepSeek-R1 Experiment 2
0.99BERT ScoreTemplate-based
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Template-basedMetric=detectability AUC, Graph size range=n in {3, ..., 10}2026.04 | 0.99 | 0.98 | 0.98 | 0.99 | 0.84 | |
| LLM-dependentMetric=detectability AUC, Graph size range=n in {3, ..., 10}2026.04 | 0.63 | 0.65 | 0.64 | 0.68 | 0.6 | |
| LLM+IDMetric=detectability AUC, Graph size range=n in {3, ..., 10}2026.04 | 0.61 | 0.63 | 0.62 | 0.66 | 0.59 | |
| LLM+CAMetric=detectability AUC, Graph size range=n in {3, ..., 10}2026.04 | 0.6 | 0.62 | 0.61 | 0.65 | 0.58 | |
| iTAGMetric=detectability AUC, Graph size range=n in {3, ..., 10}2026.04 | 0.56 | 0.58 | 0.57 | 0.61 | 0.55 |