Textual Entailment Classification on RTE
87Utility AccuracyNon-split
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Non-splitTarget LLM=Qwen3-1.7B2026.06 | 87 | 75.8 | 74.8 | 50.9 | 45.5 | 50.4 | 44.3 | 22.6 | 20.5 | |
| MIXGUARDTarget LLM=Qwen3-1.7B2026.06 | 86.6 | 5.9 | 3.5 | 18.5 | 12.1 | 19 | 12.7 | 10.5 | 6.4 | |
| Non-splitTarget LLM=Llama 3.2-1B2026.06 | 78.3 | 70.9 | 70.7 | 49.1 | 43 | 49.6 | 43.3 | 28.3 | 24.4 | |
| MIXGUARDTarget LLM=Llama 3.2-1B2026.06 | 78.3 | 6.1 | 4.4 | 15 | 8.9 | 11.2 | 6.4 | 11.1 | 5.9 | |
| DP-SGDTarget LLM=Llama 3.2-1B2026.06 | 77.9 | 71.5 | 71.1 | 49.5 | 43.5 | 52.3 | 43.4 | 27.9 | 23.9 | |
| DP-forwardTarget LLM=Llama 3.2-1B2026.06 | 74 | 60.1 | 60.4 | 44.5 | 33.9 | 44.6 | 34.9 | 29.1 | 25.4 | |
| Naive MixTarget LLM=Llama 3.2-1B2026.06 | 72.6 | 42.8 | 42.8 | 45.7 | 40.1 | 39 | 34.4 | 22.9 | 18.9 | |
| Naive MixTarget LLM=Qwen3-1.7B2026.06 | 71.5 | 45.7 | 46.4 | 52.7 | 47.4 | 39.2 | 35.8 | 20.6 | 17.8 | |
| DP-SGDTarget LLM=Qwen3-1.7B2026.06 | 61 | 75 | 75.3 | 50.5 | 44.7 | 50.2 | 43.9 | 23.3 | 21 | |
| DP-forwardTarget LLM=Qwen3-1.7B2026.06 | 58.5 | 54.2 | 54.4 | 38 | 32.3 | 35.7 | 29.6 | 21.5 | 18.8 | |
| SnDTarget LLM=Qwen3-1.7B2026.06 | 52.9 | 75.5 | 76.2 | 38.9 | 36.2 | 38.5 | 36 | 27.8 | 24.2 | |
| SnDTarget LLM=Llama 3.2-1B2026.06 | 47.1 | 69.4 | 71.9 | 49.6 | 44.6 | 49.6 | 44.6 | 24.9 | 21 |