List your company
ResearchFormerly WizWand

Analogy Generation on UNIT 4

92AccuracyChatGPT
1434.2554.574.75May 10, 2023
Updated 8mo ago

Evaluation results

MethodLinks
ChatGPTaugmentation=ANALOGYKB2023.0592
ChatGPT + ANALOGYKBStrategy=ANALOGYKB retrieved examples2023.0592
ChatGPTaugmentation=Human2023.0581
ChatGPT + HumanStrategy=Human-written examples2023.0581
AnalogyT52023.0580
InstructGPTversion=003, augmentation=ANALOGYKB2023.0580
ChatGPTaugmentation=ANALOGYKB, subset=same2023.0580
AnalogyT5Backbone=T5-Large, Training=Trained on ANALOGYKB2023.0580
InstructGPT003 + ANALOGYKBStrategy=ANALOGYKB retrieved examples2023.0580
ChatGPT + ANALOGYKBsameStrategy=ANALOGYKB (same relations) retrieved examples2023.0580
InstructGPTversion=003, augmentation=ANALOGYKB, subset=same2023.0577
InstructGPT003 + ANALOGYKBsameStrategy=ANALOGYKB (same relations) retrieved examples2023.0577
InstructGPTversion=003, augmentation=Human2023.0576
ChatGPT2023.0576
InstructGPT003 + HumanStrategy=Human-written examples2023.0576
ChatGPTStrategy=0-shot2023.0576
InstructGPTversion=0032023.0570
InstructGPT003Strategy=0-shot2023.0570
AnalogyT5variant=same2023.0563
AnalogyT5sameBackbone=T5-Large, Training=Trained on ANALOGYKB (same relations)2023.0563
vanilla T52023.0517
vanilla T5Backbone=T5-Large, Strategy=Vanilla2023.0517