Reasoning on Sonnet Writing
0.92AccuracyRoT
Evaluation Results
| Method | Links | |
|---|---|---|
| RoTBackbone=GPT-4, Shots=2-shot2024.10 | 0.92 | |
| RoTBackbone=GPT-4, Shots=1-shot2024.10 | 0.892 | |
| Meta-promptingBackbone=GPT-4, Shots=2-shot2024.10 | 0.798 | |
| BOTBackbone=GPT-4, Shots=2-shot2024.10 | 0.798 | |
| BOTBackbone=GPT-4, Shots=1-shot2024.10 | 0.791 | |
| Meta-promptingBackbone=GPT-4, Shots=1-shot2024.10 | 0.787 | |
| RoTBackbone=GPT-3.5-turbo, Shots=2-shot2024.10 | 0.758 | |
| RoTBackbone=GPT-3.5-turbo, Shots=1-shot2024.10 | 0.755 | |
| BOTBackbone=GPT-3.5-turbo, Shots=2-shot2024.10 | 0.73 | |
| Meta-promptingBackbone=GPT-3.5-turbo, Shots=2-shot2024.10 | 0.714 | |
| BOTBackbone=GPT-3.5-turbo, Shots=1-shot2024.10 | 0.711 | |
| COTBackbone=GPT-4, Shots=2-shot2024.10 | 0.702 | |
| TOTBackbone=GPT-4, Shots=2-shot2024.10 | 0.698 | |
| Meta-promptingBackbone=GPT-3.5-turbo, Shots=1-shot2024.10 | 0.695 | |
| TOTBackbone=GPT-4, Shots=1-shot2024.10 | 0.687 | |
| GOTBackbone=GPT-4, Shots=1-shot2024.10 | 0.683 | |
| COTBackbone=GPT-4, Shots=1-shot2024.10 | 0.663 | |
| TOTBackbone=GPT-3.5-turbo, Shots=2-shot2024.10 | 0.653 | |
| GOTBackbone=GPT-3.5-turbo, Shots=2-shot2024.10 | 0.637 | |
| TOTBackbone=GPT-3.5-turbo, Shots=1-shot2024.10 | 0.635 | |
| GOTBackbone=GPT-4, Shots=2-shot2024.10 | 0.625 | |
| GOTBackbone=GPT-3.5-turbo, Shots=1-shot2024.10 | 0.622 | |
| COTBackbone=GPT-3.5-turbo, Shots=2-shot2024.10 | 0.613 | |
| COTBackbone=GPT-3.5-turbo, Shots=1-shot2024.10 | 0.586 |