Action Generation on COKE
0.342METEORCOLM
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| COLM2023.05 | 0.342 | 0.378 | 0.378 | 0.027 | 0.892 | |
| GPT-3.5 Turboshots=5-shot2023.05 | 0.291 | 0.284 | 0.302 | 0.02 | 0.886 | |
| GPT-3.5 Turboshots=2-shot2023.05 | 0.253 | 0.255 | 0.271 | 0.018 | 0.882 | |
| GPT-4shots=2-shot2023.05 | 0.248 | 0.243 | 0.223 | 0.014 | 0.879 | |
| GPT-4shots=5-shot2023.05 | 0.247 | 0.257 | 0.257 | 0.017 | 0.882 | |
| LLaMa-7Bshots=5-shot2023.05 | 0.217 | 0.178 | 0.149 | 0.009 | 0.842 | |
| Mistral-7Bshots=5-shot2023.05 | 0.21 | 0.182 | 0.13 | 0.008 | 0.844 | |
| GPT-4shots=0-shot2023.05 | 0.209 | 0.193 | 0.168 | 0.011 | 0.866 | |
| LLaMa-7Bshots=2-shot2023.05 | 0.207 | 0.172 | 0.13 | 0.008 | 0.851 | |
| GPT-3.5 Turboshots=0-shot2023.05 | 0.206 | 0.186 | 0.153 | 0.01 | 0.872 | |
| Mistral-7Bshots=2-shot2023.05 | 0.202 | 0.171 | 0.122 | 0.008 | 0.841 | |
| Mistral-7Bshots=0-shot2023.05 | 0.168 | 0.133 | 0.121 | 0.007 | 0.832 | |
| LLaMa-7Bshots=0-shot2023.05 | 0.134 | 0.104 | 0.121 | 0.008 | 0.821 |