List your company

Tabular Reasoning on INFOTABS (dev)

84.83AccuracyRethinking with retrieval
81.886882.650983.41584.1791Dec 31, 2022

Evaluation results

MethodLinks
Rethinking with retrievalModel=GPT-3 (text-davinci-002), Temperature=0.7, Num samples=102022.1284.83
Self-consistencyModel=GPT-3 (text-davinci-002), Temperature=0.7, Num samples=102022.1284
Chain-of-thought promptingModel=GPT-3 (text-davinci-002), Temperature=02022.1283.33
Few-shot promptingModel=GPT-3 (text-davinci-002), Temperature=02022.1283.08
Zero-shot promptingModel=GPT-3 (text-davinci-002), Temperature=02022.1282