Analogy Generation on UNIT 4
92AccuracyChatGPT
Evaluation Results
| Method | Links | |
|---|---|---|
| ChatGPTaugmentation=ANALOGYKB2023.05 | 92 | |
| ChatGPT + ANALOGYKBStrategy=ANALOGYKB retrieved examples2023.05 | 92 | |
| ChatGPTaugmentation=Human2023.05 | 81 | |
| ChatGPT + HumanStrategy=Human-written examples2023.05 | 81 | |
| AnalogyT52023.05 | 80 | |
| InstructGPTversion=003, augmentation=ANALOGYKB2023.05 | 80 | |
| ChatGPTaugmentation=ANALOGYKB, subset=same2023.05 | 80 | |
| AnalogyT5Backbone=T5-Large, Training=Trained on ANALOGYKB2023.05 | 80 | |
| InstructGPT003 + ANALOGYKBStrategy=ANALOGYKB retrieved examples2023.05 | 80 | |
| ChatGPT + ANALOGYKBsameStrategy=ANALOGYKB (same relations) retrieved examples2023.05 | 80 | |
| InstructGPTversion=003, augmentation=ANALOGYKB, subset=same2023.05 | 77 | |
| InstructGPT003 + ANALOGYKBsameStrategy=ANALOGYKB (same relations) retrieved examples2023.05 | 77 | |
| InstructGPTversion=003, augmentation=Human2023.05 | 76 | |
| ChatGPT2023.05 | 76 | |
| InstructGPT003 + HumanStrategy=Human-written examples2023.05 | 76 | |
| ChatGPTStrategy=0-shot2023.05 | 76 | |
| InstructGPTversion=0032023.05 | 70 | |
| InstructGPT003Strategy=0-shot2023.05 | 70 | |
| AnalogyT5variant=same2023.05 | 63 | |
| AnalogyT5sameBackbone=T5-Large, Training=Trained on ANALOGYKB (same relations)2023.05 | 63 | |
| vanilla T52023.05 | 17 | |
| vanilla T5Backbone=T5-Large, Strategy=Vanilla2023.05 | 17 |