Thought Generation on COKE
0.305METEORCOLM
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| COLM2023.05 | 0.305 | 0.344 | 0.371 | 0.037 | 0.902 | |
| GPT-3.5 Turboshots=5-shot2023.05 | 0.274 | 0.215 | 0.313 | 0.029 | 0.896 | |
| GPT-3.5 Turboshots=2-shot2023.05 | 0.266 | 0.205 | 0.259 | 0.024 | 0.89 | |
| GPT-4shots=5-shot2023.05 | 0.25 | 0.203 | 0.326 | 0.031 | 0.896 | |
| GPT-4shots=2-shot2023.05 | 0.244 | 0.198 | 0.321 | 0.03 | 0.894 | |
| LLaMa-7Bshots=5-shot2023.05 | 0.207 | 0.141 | 0.112 | 0.009 | 0.855 | |
| LLaMa-7Bshots=2-shot2023.05 | 0.2 | 0.132 | 0.115 | 0.01 | 0.847 | |
| Mistral-7Bshots=5-shot2023.05 | 0.19 | 0.144 | 0.16 | 0.015 | 0.854 | |
| Mistral-7Bshots=2-shot2023.05 | 0.184 | 0.203 | 0.164 | 0.015 | 0.84 | |
| GPT-3.5 Turboshots=0-shot2023.05 | 0.166 | 0.132 | 0.195 | 0.017 | 0.874 | |
| LLaMa-7Bshots=0-shot2023.05 | 0.144 | 0.094 | 0.121 | 0.011 | 0.835 | |
| Mistral-7Bshots=0-shot2023.05 | 0.142 | 0.152 | 0.117 | 0.01 | 0.833 | |
| GPT-4shots=0-shot2023.05 | 0.131 | 0.109 | 0.196 | 0.018 | 0.871 |