TG task on Legalbench
61Warranty Duration (CUAD)Logitext
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Logitextsamples_per_task=1002026.02 | 61 | 0.83 | 60 | 59 | 33 | |
| Fewshotsamples_per_task=1002026.02 | 50 | 0.76 | 50 | 58 | 72 | |
| Neurosymbolicsamples_per_task=1002026.02 | 19 | 0.35 | 34 | 2 | 57 |