Machine-Generated Text Detection on arXiv Abstracts standard (test)
77Mage Macro F1Llama 3.1
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Llama 3.1Generator=Llama 3.1, DPO Iteration=0, Linguistic Features Alignment=false2025.05 | 77 | 38 | 50 | 79 | 96 | 100 | |
| Gemma 2Generator=Gemma 2, DPO Iteration=0, Linguistic Features Alignment=false2025.05 | 76 | 38 | 54 | 58 | 99 | 100 | |
| dpo-1-lingGenerator=Gemma 2, DPO Iteration=1, Linguistic Features Alignment=true2025.05 | 75 | 40 | 54 | 39 | 96 | 99 | |
| dpo-1Generator=Gemma 2, DPO Iteration=1, Linguistic Features Alignment=false2025.05 | 70 | 37 | 53 | 45 | 93 | 99 | |
| dpo-2-lingGenerator=Gemma 2, DPO Iteration=2, Linguistic Features Alignment=true2025.05 | 70 | 38 | 52 | 47 | 87 | 96 | |
| dpo-1Generator=Llama 3.1, DPO Iteration=1, Linguistic Features Alignment=false2025.05 | 65 | 37 | 46 | 61 | 95 | 99 | |
| dpo-2Generator=Gemma 2, DPO Iteration=2, Linguistic Features Alignment=false2025.05 | 63 | 37 | 52 | 40 | 83 | 92 | |
| dpo-2Generator=Llama 3.1, DPO Iteration=2, Linguistic Features Alignment=false2025.05 | 53 | 41 | 43 | 43 | 94 | 98 | |
| dpo-1-lingGenerator=Llama 3.1, DPO Iteration=1, Linguistic Features Alignment=true2025.05 | 49 | 40 | 45 | 41 | 92 | 97 | |
| dpo-2-lingGenerator=Llama 3.1, DPO Iteration=2, Linguistic Features Alignment=true2025.05 | 48 | 41 | 44 | 39 | 92 | 96 |