Instruction Induction (test)
0.852AntonymsZOPO
Evaluation Results
| Method | Links | ||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ZOPOzero-shot=true, query budget=165, prompt representation=Vicuna-13B, black-box LLM=ChatGPT2024.03 | 0.852 | 0.327 | 0.417 | 0.947 | 0.235 | 1 | 0.613 | 1 | 0.863 | 0.523 | 0.32 | 0.565 | 1 | 0.257 | 0.076 | 1 | 0.433 | 0.9 | 0.6 | 0.593 | |
| INSTINCTzero-shot=true, query budget=165, prompt representation=Vicuna-13B, black-box LLM=ChatGPT2024.03 | 0.847 | 0.25 | 0.292 | 0.587 | 0.213 | 1 | 0.553 | 1 | 0.817 | 0.34 | 0.7 | 0.667 | 1 | 0.1 | 0.14 | 1 | 0.307 | 0.857 | 0.513 | 0.633 | |
| EvoPromptzero-shot=true, query budget=165, prompt representation=Vicuna-13B, black-box LLM=ChatGPT2024.03 | 0.84 | 0.31 | 0.33 | 0.84 | 0.111 | 0.273 | 0.516 | 1 | 0.86 | 0.55 | 0.1 | 0.15 | 0.597 | 0.247 | 0.02 | 1 | 0.403 | 0.83 | 0.48 | 0.513 | |
| ZOPOGPTzero-shot=true, query budget=165, prompt representation=Vicuna-13B, black-box LLM=ChatGPT2024.03 | 0.84 | 0.27 | 0.292 | 0.8 | 0.028 | 1 | 0.619 | 1 | 0.777 | 0.403 | 0.687 | 0.71 | 0.61 | 0.967 | 0.373 | 1 | 0.447 | 0.923 | 0.603 | 0.583 | |
| InstructZerozero-shot=true, query budget=165, prompt representation=Vicuna-13B, black-box LLM=ChatGPT2024.03 | 0.827 | 0.257 | 0.375 | 0.813 | 0.086 | 0.693 | 0.531 | 0.59 | 0.777 | 0.36 | 0.613 | 0.507 | 1 | 0.433 | 0 | 1 | 0.277 | 0.717 | 0.31 | 0.55 | |
| APEzero-shot=true, query budget=165, prompt representation=Vicuna-13B, black-box LLM=ChatGPT2024.03 | 0.637 | 0.25 | 0.292 | 0.573 | 0.069 | 0.673 | 0.574 | 1 | 0.753 | 0.363 | 0.633 | 0.457 | 0.157 | 0.747 | 0 | 0.673 | 0.36 | 0.347 | 0.33 | 0.44 |