Knowledge Elicitation on PARAREL (test)
71.36Success RatePGDC
Evaluation Results
| Method | Links | |
|---|---|---|
| PGDCModel=LLaMA2 (7B)2024.02 | 71.36 | |
| Few-shotsModel=Vicuna (7B), Prompt Variant=paraphrased2024.02 | 69.69 | |
| PGDCModel=Vicuna (7B)2024.02 | 69.63 | |
| Few-shotsModel=LLaMA2 (7B), Prompt Variant=paraphrased2024.02 | 66.95 | |
| Few-shotsModel=Vicuna (7B), Prompt Variant=standard2024.02 | 59.56 | |
| Few-shotsModel=LLaMA2 (7B), Prompt Variant=standard2024.02 | 58.23 | |
| PGDCModel=GPT-J (6B)2024.02 | 55.95 | |
| Zero-shotModel=Vicuna (7B), Prompt Variant=paraphrased2024.02 | 54.97 | |
| Zero-shotModel=LLaMA2 (7B), Prompt Variant=paraphrased2024.02 | 54.78 | |
| Few-shotsModel=GPT-J (6B), Prompt Variant=paraphrased2024.02 | 54.06 | |
| PGDCModel=GPT-2 (774M)2024.02 | 47.68 | |
| Few-shotsModel=GPT-J (6B), Prompt Variant=standard2024.02 | 44.84 | |
| DiscriminatorModel=LLaMA2 (7B), Prompt Variant=paraphrased2024.02 | 44.16 | |
| Zero-shotModel=GPT-J (6B), Prompt Variant=paraphrased2024.02 | 40.78 | |
| Zero-shotModel=LLaMA2 (7B), Prompt Variant=standard2024.02 | 34.43 | |
| Zero-shotModel=Vicuna (7B), Prompt Variant=standard2024.02 | 34.19 | |
| Zero-shotModel=GPT-J (6B), Prompt Variant=standard2024.02 | 23.23 | |
| DiscriminatorModel=Vicuna (7B), Prompt Variant=paraphrased2024.02 | 23.06 | |
| Few-shotsModel=GPT-2 (774M), Prompt Variant=paraphrased2024.02 | 20.46 | |
| Zero-shotModel=GPT-2 (774M), Prompt Variant=paraphrased2024.02 | 18.18 | |
| DiscriminatorModel=LLaMA2 (7B), Prompt Variant=standard2024.02 | 17.96 | |
| Few-shotsModel=GPT-2 (774M), Prompt Variant=standard2024.02 | 12.61 | |
| Zero-shotModel=GPT-2 (774M), Prompt Variant=standard2024.02 | 9.27 | |
| DiscriminatorModel=GPT-2 (774M), Prompt Variant=paraphrased2024.02 | 9.01 | |
| DiscriminatorModel=Vicuna (7B), Prompt Variant=standard2024.02 | 8.4 | |
| DiscriminatorModel=GPT-J (6B), Prompt Variant=paraphrased2024.02 | 7.25 | |
| DiscriminatorModel=GPT-2 (774M), Prompt Variant=standard2024.02 | 3.13 | |
| DiscriminatorModel=GPT-J (6B), Prompt Variant=standard2024.02 | 2.4 |