Short-form open-domain QA on RQA
72PIA Racc ScoreKeyword
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| KeywordLLM=Mistral-7B2024.05 | 72 | — | — | 15 | 72 | 15 | |
| KeywordLLM=Llama2-7B2024.05 | 64 | — | — | 12 | 64 | — | |
| Decoding_cLLM=Llama2-7B2024.05 | 59 | — | — | 5 | 60 | 3 | |
| Decoding_cLLM=Mistral-7B2024.05 | 57 | — | — | 5 | 56 | 11 | |
| VanillaLLM=Mistral-7B2024.05 | 5 | — | — | 66 | 16 | 80 | |
| VanillaLLM=Llama2-7B2024.05 | 1 | — | — | 97 | 9 | 76 | |
| KeywordLLM=GPT-3.5, Attack=PIA, k=10, k'=12024.05 | — | 52.6 | 5 | — | — | — | |
| KeywordLLM=GPT-3.5, Attack=Poison, k=10, k'=12024.05 | — | 51.6 | 4.6 | — | — | — | |
| VanillaLLM=GPT-3.5, Attack=PIA, k=10, k'=12024.05 | — | 10.2 | 82.2 | — | — | — | |
| VanillaLLM=GPT-3.5, Attack=Poison, k=10, k'=12024.05 | — | 51.6 | 31.6 | — | — | — |