Machine-Generated Text Detection on XSUM balanced (test)
76Mage Macro F1Llama 3.1
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Llama 3.1Generator=Llama 3.1, DPO Iteration=0, Linguistic Features Alignment=false2025.05 | 76 | 94 | 72 | 99 | 94 | 100 | |
| Gemma 2Generator=Gemma 2, DPO Iteration=0, Linguistic Features Alignment=false2025.05 | 71 | 70 | 68 | 37 | 97 | 100 | |
| dpo-1-lingGenerator=Gemma 2, DPO Iteration=1, Linguistic Features Alignment=true2025.05 | 67 | 61 | 66 | 35 | 91 | 99 | |
| dpo-1Generator=Gemma 2, DPO Iteration=1, Linguistic Features Alignment=false2025.05 | 65 | 60 | 64 | 34 | 70 | 99 | |
| dpo-2-lingGenerator=Gemma 2, DPO Iteration=2, Linguistic Features Alignment=true2025.05 | 65 | 56 | 64 | 35 | 83 | 99 | |
| dpo-2Generator=Gemma 2, DPO Iteration=2, Linguistic Features Alignment=false2025.05 | 64 | 58 | 63 | 34 | 96 | 99 | |
| dpo-1-lingGenerator=Llama 3.1, DPO Iteration=1, Linguistic Features Alignment=true2025.05 | 47 | 58 | 54 | 38 | 80 | 75 | |
| dpo-2Generator=Llama 3.1, DPO Iteration=2, Linguistic Features Alignment=false2025.05 | 44 | 87 | 55 | 33 | 64 | 50 | |
| dpo-2-lingGenerator=Llama 3.1, DPO Iteration=2, Linguistic Features Alignment=true2025.05 | 42 | 62 | 52 | 33 | 77 | 68 | |
| dpo-1Generator=Llama 3.1, DPO Iteration=1, Linguistic Features Alignment=false2025.05 | 40 | 79 | 53 | 33 | 69 | 52 |