Question Answering on Contracts QA
97AccuracyLegalDrill-1.7B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| LegalDrill-1.7BEvaluation Protocol=Distillation, Teacher Model=GPT-4o2026.04 | 97 | 94 | 94 | |
| Qwen3-30B-A3B-InstructEvaluation Protocol=Zero Shot2026.04 | 96 | 95 | 93 | |
| LegalDrill-0.6BEvaluation Protocol=Distillation, Teacher Model=GPT-4o2026.04 | 95 | 84 | 91 | |
| LegalDrill-1.7BEvaluation Protocol=Distillation, Teacher Model=Qwen3-30B-A3B-Instruct2026.04 | 93 | 92 | 83 | |
| GPT-4oEvaluation Protocol=Zero Shot2026.04 | 92 | 92 | 92 | |
| LegalDrill-0.6BEvaluation Protocol=Distillation, Teacher Model=Qwen3-30B-A3B-Instruct2026.04 | 91 | 88 | 85 | |
| DeepSeek ESFT-16BEvaluation Protocol=Zero Shot2026.04 | 88 | 87 | 79 | |
| Law-LLM-13BEvaluation Protocol=Zero Shot2026.04 | 88 | 56 | 77 | |
| Qwen3-1.7BEvaluation Protocol=Zero Shot2026.04 | 87 | 85 | 81 | |
| Qwen3-0.6BEvaluation Protocol=Zero Shot2026.04 | 83 | 83 | 75 | |
| DiscLaw-13BEvaluation Protocol=Zero Shot2026.04 | 42 | 33 | 38 |