Entailment tree generation on EntailmentBank 50 samples (test)
100FVGPT-3 w/ CoT
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| GPT-3 w/ CoTBackbone=text-davinci-003, Number of Parameters=175B, Prompting Strategy=Chain-of-Thought (CoT)2023.05 | 100 | 23.2 | 72 | 4 | |
| ChatGPTVersion=Dec 15 Version, Number of Parameters=175B2023.05 | 100 | 38.3 | 52 | 14 | |
| FAMEBackbone=T5-large, Number of Parameters=770M2023.05 | 100 | 66 | 82 | 46 | |
| EntailerBackbone=T5-large, Number of Parameters=770M2023.05 | 72.8 | 48 | 82 | 24 |