List your company
ResearchFormerly WizWand

Analogy Generation on SAT

0.91AccuracyChatGPT
0.04680.27090.4950.7191May 10, 2023
Updated 8mo ago

Evaluation results

MethodLinks
ChatGPTaugmentation=ANALOGYKB2023.050.91
InstructGPTversion=003, augmentation=ANALOGYKB2023.050.85
ChatGPTaugmentation=ANALOGYKB, subset=same2023.050.81
ChatGPTaugmentation=Human2023.050.8
ChatGPT2023.050.78
InstructGPTversion=003, augmentation=ANALOGYKB, subset=same2023.050.77
InstructGPTversion=003, augmentation=Human2023.050.74
AnalogyT52023.050.64
InstructGPTversion=0032023.050.6
AnalogyT5variant=same2023.050.37
vanilla T52023.050.08