Paraphrase Classification on MRPC
88Utility AccuracyMIXGUARD
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| MIXGUARDTarget LLM=Qwen3-1.7B2026.06 | 88 | 6.9 | 3.8 | 22.4 | 13.5 | 23.2 | 14.7 | 9.8 | 5.1 | |
| Non-splitTarget LLM=Qwen3-1.7B2026.06 | 86.3 | 77.2 | 78.9 | 58.3 | 49.6 | 59.5 | 49.3 | 27.7 | 24.3 | |
| Non-splitTarget LLM=Llama 3.2-1B2026.06 | 86 | 75.9 | 77.8 | 60 | 50.9 | 60.3 | 51.1 | 34.2 | 27.6 | |
| DP-SGDTarget LLM=Llama 3.2-1B2026.06 | 86 | 78.7 | 79.8 | 60.5 | 52.2 | 60.3 | 51.9 | 33.3 | 25.2 | |
| DP-forwardTarget LLM=Llama 3.2-1B2026.06 | 85.3 | 62.7 | 64.6 | 51.9 | 38.3 | 51.6 | 37.4 | 30.8 | 23.5 | |
| MIXGUARDTarget LLM=Llama 3.2-1B2026.06 | 83.6 | 6.9 | 3.6 | 14.7 | 7.6 | 11.3 | 5.2 | 10.2 | 5.8 | |
| DP-SGDTarget LLM=Qwen3-1.7B2026.06 | 83.1 | 76.1 | 78.1 | 58.7 | 49.2 | 59.8 | 49.3 | 27.9 | 23.8 | |
| Naive MixTarget LLM=Llama 3.2-1B2026.06 | 83.1 | 34.5 | 32.6 | 35.8 | 28.9 | 50.4 | 41.6 | 20.2 | 15.6 | |
| DP-forwardTarget LLM=Qwen3-1.7B2026.06 | 79.4 | 59.5 | 61.2 | 52.8 | 43.6 | 54.3 | 41.9 | 30.4 | 23.2 | |
| Naive MixTarget LLM=Qwen3-1.7B2026.06 | 74.8 | 50.7 | 48.7 | 54.9 | 47 | 48.1 | 39.9 | 25.5 | 20.3 | |
| SnDTarget LLM=Qwen3-1.7B2026.06 | 68.4 | 78.3 | 79.7 | 45.3 | 42.4 | 46.7 | 43 | 29.9 | 25 | |
| SnDTarget LLM=Llama 3.2-1B2026.06 | 68.4 | 73.2 | 74.2 | 61.3 | 54.5 | 61.2 | 54.2 | 32.8 | 27.4 |