Last-letter-concatenation on Last-letter-concatenation 2 words (in-distribution)
100AccuracySKiC
Evaluation Results
| Method | Links | |
|---|---|---|
| SKiCModel=text-davinci-003, #-shots=22023.08 | 100 | |
| 4-shotsModel=ChatGPT, #-shots=42023.08 | 100 | |
| CoTModel=ChatGPT, #-shots=42023.08 | 100 | |
| LtMModel=ChatGPT, #-shots=42023.08 | 100 | |
| SKiCModel=ChatGPT, #-shots=22023.08 | 100 | |
| CoTModel=text-davinci-003, #-shots=42023.08 | 99 | |
| LtMModel=text-davinci-003, #-shots=42023.08 | 99 | |
| zero-shotModel=ChatGPT, #-shots=02023.08 | 98 | |
| SKiCModel=LLAMA-65B, #-shots=22023.08 | 97 | |
| 4-shotsModel=text-davinci-003, #-shots=42023.08 | 97 | |
| LtMModel=LLAMA-65B, #-shots=42023.08 | 72 | |
| CoTModel=LLAMA-65B, #-shots=42023.08 | 70 | |
| 4-shotsModel=LLAMA-65B, #-shots=42023.08 | 66 | |
| zero-shotModel=LLAMA-65B, #-shots=02023.08 | 0 | |
| zero-shotModel=text-davinci-003, #-shots=02023.08 | 0 |