Entailment on Sara Entailment
86AccuracyQwen3-30B-A3B-Instruct
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Qwen3-30B-A3B-InstructEvaluation Protocol=Zero Shot2026.04 | 86 | 43 | 51 | |
| GPT-4oEvaluation Protocol=Zero Shot2026.04 | 83 | 81 | 62 | |
| LegalDrill-0.6BEvaluation Protocol=Distillation, Teacher Model=GPT-4o2026.04 | 75 | 42 | 41 | |
| LegalDrill-1.7BEvaluation Protocol=Distillation, Teacher Model=GPT-4o2026.04 | 75 | 46 | 43 | |
| LegalDrill-0.6BEvaluation Protocol=Distillation, Teacher Model=Qwen3-30B-A3B-Instruct2026.04 | 74 | 45 | 44 | |
| LegalDrill-1.7BEvaluation Protocol=Distillation, Teacher Model=Qwen3-30B-A3B-Instruct2026.04 | 73 | 39 | 42 | |
| Qwen3-1.7BEvaluation Protocol=Zero Shot2026.04 | 66 | 38 | 37 | |
| Qwen3-0.6BEvaluation Protocol=Zero Shot2026.04 | 59 | 27 | 18 | |
| Law-LLM-13BEvaluation Protocol=Zero Shot2026.04 | 51 | 38 | 18 | |
| DeepSeek ESFT-16BEvaluation Protocol=Zero Shot2026.04 | 46 | 44 | 27 | |
| DiscLaw-13BEvaluation Protocol=Zero Shot2026.04 | 10 | 7 | 5 |