Last-letter-concatenation on Last-letter-concatenation 1 word (in-distribution)
100AccuracyCoT
Evaluation Results
| Method | Links | |
|---|---|---|
| CoTModel=text-davinci-003, #-shots=42023.08 | 100 | |
| LtMModel=text-davinci-003, #-shots=42023.08 | 100 | |
| SKiCModel=text-davinci-003, #-shots=22023.08 | 100 | |
| 4-shotsModel=ChatGPT, #-shots=42023.08 | 100 | |
| CoTModel=ChatGPT, #-shots=42023.08 | 100 | |
| LtMModel=ChatGPT, #-shots=42023.08 | 100 | |
| SKiCModel=ChatGPT, #-shots=22023.08 | 100 | |
| 4-shotsModel=text-davinci-003, #-shots=42023.08 | 99 | |
| zero-shotModel=ChatGPT, #-shots=02023.08 | 99 | |
| SKiCModel=LLAMA-65B, #-shots=22023.08 | 81 | |
| CoTModel=LLAMA-65B, #-shots=42023.08 | 76 | |
| LtMModel=LLAMA-65B, #-shots=42023.08 | 76 | |
| 4-shotsModel=LLAMA-65B, #-shots=42023.08 | 72 | |
| zero-shotModel=LLAMA-65B, #-shots=02023.08 | 0 | |
| zero-shotModel=text-davinci-003, #-shots=02023.08 | 0 |