Knowledge Elicitation on CFACT
3,646Success RateDiscriminator
Evaluation Results
| Method | Links | |
|---|---|---|
| DiscriminatorModel=LLaMA2 (7B), Prompt Variant=paraphrased2024.02 | 3,646 | |
| DiscriminatorModel=Vicuna (7B), Prompt Variant=paraphrased2024.02 | 1,428 | |
| DiscriminatorModel=LLaMA2 (7B), Prompt Variant=standard2024.02 | 1,388 | |
| DiscriminatorModel=GPT-2 (774M), Prompt Variant=paraphrased2024.02 | 932 | |
| Few-shotsModel=LLaMA2 (7B), Prompt Variant=paraphrased2024.02 | 931 | |
| Few-shotsModel=Vicuna (7B), Prompt Variant=paraphrased2024.02 | 691 | |
| DiscriminatorModel=GPT-J (6B), Prompt Variant=paraphrased2024.02 | 674 | |
| Few-shotsModel=GPT-J (6B), Prompt Variant=paraphrased2024.02 | 612 | |
| DiscriminatorModel=Vicuna (7B), Prompt Variant=standard2024.02 | 495 | |
| PGDCModel=GPT-J (6B)2024.02 | 482 | |
| Few-shotsModel=LLaMA2 (7B), Prompt Variant=standard2024.02 | 456 | |
| Few-shotsModel=GPT-2 (774M), Prompt Variant=paraphrased2024.02 | 392 | |
| Zero-shotModel=GPT-J (6B), Prompt Variant=paraphrased2024.02 | 375 | |
| PGDCModel=Vicuna (7B)2024.02 | 350 | |
| PGDCModel=LLaMA2 (7B)2024.02 | 341 | |
| Zero-shotModel=Vicuna (7B), Prompt Variant=paraphrased2024.02 | 336 | |
| Zero-shotModel=LLaMA2 (7B), Prompt Variant=paraphrased2024.02 | 330 | |
| DiscriminatorModel=GPT-2 (774M), Prompt Variant=standard2024.02 | 328 | |
| Few-shotsModel=GPT-J (6B), Prompt Variant=standard2024.02 | 318 | |
| Few-shotsModel=Vicuna (7B), Prompt Variant=standard2024.02 | 308 | |
| Zero-shotModel=GPT-2 (774M), Prompt Variant=paraphrased2024.02 | 300 | |
| PGDCModel=GPT-2 (774M)2024.02 | 281 | |
| DiscriminatorModel=GPT-J (6B), Prompt Variant=standard2024.02 | 230 | |
| Few-shotsModel=GPT-2 (774M), Prompt Variant=standard2024.02 | 177 | |
| Zero-shotModel=Vicuna (7B), Prompt Variant=standard2024.02 | 140 | |
| Zero-shotModel=GPT-J (6B), Prompt Variant=standard2024.02 | 139 | |
| Zero-shotModel=LLaMA2 (7B), Prompt Variant=standard2024.02 | 132 | |
| Zero-shotModel=GPT-2 (774M), Prompt Variant=standard2024.02 | 110 |