Last-letter-concatenation on Last-letter-concatenation 6 words (out-of-distribution)
100AccuracySKiC
Evaluation Results
| Method | Links | |
|---|---|---|
| SKiCModel=text-davinci-003, #-shots=22023.08 | 100 | |
| SKiCModel=ChatGPT, #-shots=22023.08 | 100 | |
| CoTModel=ChatGPT, #-shots=42023.08 | 95 | |
| LtMModel=ChatGPT, #-shots=42023.08 | 95 | |
| 4-shotsModel=ChatGPT, #-shots=42023.08 | 92 | |
| LtMModel=text-davinci-003, #-shots=42023.08 | 90 | |
| zero-shotModel=ChatGPT, #-shots=02023.08 | 88 | |
| CoTModel=text-davinci-003, #-shots=42023.08 | 75 | |
| 4-shotsModel=text-davinci-003, #-shots=42023.08 | 68 | |
| SKiCModel=LLAMA-65B, #-shots=22023.08 | 59 | |
| LtMModel=LLAMA-65B, #-shots=42023.08 | 50 | |
| CoTModel=LLAMA-65B, #-shots=42023.08 | 42 | |
| 4-shotsModel=LLAMA-65B, #-shots=42023.08 | 26 | |
| zero-shotModel=LLAMA-65B, #-shots=02023.08 | 0 | |
| zero-shotModel=text-davinci-003, #-shots=02023.08 | 0 |