Analogy Generation on SAT
0.91AccuracyChatGPT
Evaluation Results
| Method | Links | |
|---|---|---|
| ChatGPTaugmentation=ANALOGYKB2023.05 | 0.91 | |
| InstructGPTversion=003, augmentation=ANALOGYKB2023.05 | 0.85 | |
| ChatGPTaugmentation=ANALOGYKB, subset=same2023.05 | 0.81 | |
| ChatGPTaugmentation=Human2023.05 | 0.8 | |
| ChatGPT2023.05 | 0.78 | |
| InstructGPTversion=003, augmentation=ANALOGYKB, subset=same2023.05 | 0.77 | |
| InstructGPTversion=003, augmentation=Human2023.05 | 0.74 | |
| AnalogyT52023.05 | 0.64 | |
| InstructGPTversion=0032023.05 | 0.6 | |
| AnalogyT5variant=same2023.05 | 0.37 | |
| vanilla T52023.05 | 0.08 |