Reasoning on Word Sorting
100AccuracyRoT
Evaluation Results
| Method | Links | |
|---|---|---|
| RoTBackbone=GPT-4, Shots=2-shot2024.10 | 100 | |
| BOTBackbone=GPT-4, Shots=2-shot2024.10 | 99.6 | |
| RoTBackbone=GPT-4, Shots=1-shot2024.10 | 99.6 | |
| BOTBackbone=GPT-4, Shots=1-shot2024.10 | 99.2 | |
| Meta-promptingBackbone=GPT-4, Shots=2-shot2024.10 | 98.4 | |
| Meta-promptingBackbone=GPT-4, Shots=1-shot2024.10 | 97.6 | |
| GOTBackbone=GPT-4, Shots=2-shot2024.10 | 96.8 | |
| TOTBackbone=GPT-4, Shots=2-shot2024.10 | 96 | |
| RoTBackbone=GPT-3.5-turbo, Shots=2-shot2024.10 | 95.6 | |
| GOTBackbone=GPT-4, Shots=1-shot2024.10 | 95.6 | |
| RoTBackbone=GPT-3.5-turbo, Shots=1-shot2024.10 | 95.2 | |
| TOTBackbone=GPT-4, Shots=1-shot2024.10 | 95.2 | |
| BOTBackbone=GPT-3.5-turbo, Shots=2-shot2024.10 | 94.4 | |
| BOTBackbone=GPT-3.5-turbo, Shots=1-shot2024.10 | 93.2 | |
| Meta-promptingBackbone=GPT-3.5-turbo, Shots=2-shot2024.10 | 91.5 | |
| TOTBackbone=GPT-3.5-turbo, Shots=2-shot2024.10 | 90.3 | |
| Meta-promptingBackbone=GPT-3.5-turbo, Shots=1-shot2024.10 | 90 | |
| GOTBackbone=GPT-3.5-turbo, Shots=2-shot2024.10 | 89.5 | |
| TOTBackbone=GPT-3.5-turbo, Shots=1-shot2024.10 | 89.2 | |
| GOTBackbone=GPT-3.5-turbo, Shots=1-shot2024.10 | 88.8 | |
| COTBackbone=GPT-4, Shots=2-shot2024.10 | 82.7 | |
| COTBackbone=GPT-4, Shots=1-shot2024.10 | 80.7 | |
| COTBackbone=GPT-3.5-turbo, Shots=2-shot2024.10 | 74.6 | |
| COTBackbone=GPT-3.5-turbo, Shots=1-shot2024.10 | 71.9 |