Question Answering on NQ (ACC, ASR)
99.65ASRMedian
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MedianPoison Method=Badnets2026.02 | 99.65 | — | 75.45 | |
| TrimmedPoison Method=Badnets2026.02 | 99.6 | — | 75.25 | |
| MedianPoison Method=Addsent2026.02 | 99.6 | — | 75.4 | |
| NonePoison Method=Addsent2026.02 | 99.55 | — | 74.55 | |
| KrumPoison Method=Addsent2026.02 | 99.5 | — | 75.3 | |
| TrimmedPoison Method=Addsent2026.02 | 99.5 | — | 75.45 | |
| NonePoison Method=Badnets2026.02 | 99.45 | — | 74.55 | |
| FreqFedPoison Method=Addsent2026.02 | 99.45 | — | 75.1 | |
| FoundationFLPoison Method=CBA2026.02 | 99.45 | — | 74.6 | |
| FreqFedPoison Method=Badnets2026.02 | 99.4 | — | 75.8 | |
| CUBEPoison Method=Addsent2026.02 | 99.4 | — | 75.05 | |
| FreqFedPoison Method=CBA2026.02 | 99.4 | — | 75.05 | |
| NonePoison Method=StyleBkd2026.02 | 99.3 | — | 75.7 | |
| NonePoison Method=CBA2026.02 | 99.2 | — | 73.85 | |
| MedianPoison Method=CBA2026.02 | 99.2 | — | 75.55 | |
| TrimmedPoison Method=CBA2026.02 | 99.2 | — | 75.6 | |
| FoundationFLPoison Method=Badnets2026.02 | 99.15 | — | 73.45 | |
| CUBEPoison Method=CBA2026.02 | 99.15 | — | 75.2 | |
| KrumPoison Method=Badnets2026.02 | 99.1 | — | 75.3 | |
| KrumPoison Method=CBA2026.02 | 99.1 | — | 74.2 | |
| FoundationFLPoison Method=Addsent2026.02 | 99 | — | 74.7 | |
| ONIONPoison Method=Addsent2026.02 | 98.9 | — | 35.35 | |
| CUBEPoison Method=Badnets2026.02 | 98.85 | — | 75.3 | |
| CUBEPoison Method=StyleBkd2026.02 | 97.5 | — | 75.1 | |
| ONIONPoison Method=Badnets2026.02 | 96.16 | — | 36.95 | |
| ONIONPoison Method=CBA2026.02 | 92.65 | — | 29.25 | |
| CARG#adv. docs=3, k=10, Generator=Llama, Retriever=E52026.02 | 55 | 20 | — | |
| CARG#adv. docs=2, k=5, Generator=Llama, Retriever=E52026.02 | 52 | 25 | — | |
| D&A#adv. docs=3, k=10, Generator=Llama, Retriever=E52026.02 | 51 | 25 | — | |
| D&A#adv. docs=2, k=5, Generator=Llama, Retriever=E52026.02 | 47 | 26 | — | |
| CARG#adv. docs=2, k=10, Generator=Llama, Retriever=E52026.02 | 47 | 27 | — | |
| SDAG#adv. docs=3, k=10, Generator=Llama, Retriever=E52026.02 | 43 | 20 | — | |
| D&A#adv. docs=2, k=10, Generator=Llama, Retriever=E52026.02 | 42 | 32 | — | |
| CARG#adv. docs=1, k=5, Generator=Llama, Retriever=E52026.02 | 41 | 33 | — | |
| SDAG#adv. docs=2, k=5, Generator=Llama, Retriever=E52026.02 | 39 | 23 | — | |
| D&A#adv. docs=1, k=5, Generator=Llama, Retriever=E52026.02 | 38 | 34 | — | |
| SDAG-D&A#adv. docs=3, k=10, Generator=Llama, Retriever=E52026.02 | 37 | 23 | — | |
| CARG#adv. docs=1, k=10, Generator=Llama, Retriever=E52026.02 | 36 | 35 | — | |
| SDAG-D&A#adv. docs=2, k=5, Generator=Llama, Retriever=E52026.02 | 34 | 28 | — | |
| RAGD#adv. docs=1, k=5, Generator=Llama, Retriever=E52026.02 | 33 | 28 | — | |
| D&A#adv. docs=1, k=10, Generator=Llama, Retriever=E52026.02 | 32 | 35 | — | |
| SDAG#adv. docs=2, k=10, Generator=Llama, Retriever=E52026.02 | 24 | 28 | — | |
| SDAG-D&A#adv. docs=2, k=10, Generator=Llama, Retriever=E52026.02 | 23 | 29 | — | |
| GraCeFulPoison Method=CBA2026.02 | 20.3 | — | 74.25 | |
| FreqFedPoison Method=StyleBkd2026.02 | 20.25 | — | 76.15 | |
| RAGD#adv. docs=3, k=10, Generator=Llama, Retriever=E52026.02 | 20 | 38 | — | |
| RAGD#adv. docs=2, k=5, Generator=Llama, Retriever=E52026.02 | 19 | 35 | — | |
| RAGD#adv. docs=2, k=10, Generator=Llama, Retriever=E52026.02 | 19 | 35 | — | |
| KrumPoison Method=StyleBkd2026.02 | 18.87 | — | 75.45 | |
| RAGD#adv. docs=1, k=10, Generator=Llama, Retriever=E52026.02 | 18 | 35 | — | |
| ONIONPoison Method=StyleBkd2026.02 | 17.15 | — | 37.15 | |
| SDAG#adv. docs=1, k=5, Generator=Llama, Retriever=E52026.02 | 17 | 37 | — | |
| SDAG-RAGD#adv. docs=1, k=5, Generator=Llama, Retriever=E52026.02 | 17 | 31 | — | |
| SDAG-D&A#adv. docs=1, k=5, Generator=Llama, Retriever=E52026.02 | 16 | 37 | — | |
| SDAG-RAGD#adv. docs=2, k=5, Generator=Llama, Retriever=E52026.02 | 16 | 31 | — | |
| SDAG-RAGD#adv. docs=3, k=10, Generator=Llama, Retriever=E52026.02 | 14 | 34 | — | |
| SDAG-RAGD#adv. docs=2, k=10, Generator=Llama, Retriever=E52026.02 | 12 | 31 | — | |
| GraCeFulPoison Method=StyleBkd2026.02 | 10.35 | — | 75.55 | |
| SDAG#adv. docs=1, k=10, Generator=Llama, Retriever=E52026.02 | 10 | 37 | — | |
| SDAG-D&A#adv. docs=1, k=10, Generator=Llama, Retriever=E52026.02 | 10 | 36 | — | |
| MedianPoison Method=StyleBkd2026.02 | 9.09 | — | 71 | |
| TrimmedPoison Method=StyleBkd2026.02 | 8.25 | — | 75.85 | |
| FoundationFLPoison Method=StyleBkd2026.02 | 7.7 | — | 74.75 | |
| SDAG-RAGD#adv. docs=1, k=10, Generator=Llama, Retriever=E52026.02 | 6 | 31 | — | |
| GraCeFulPoison Method=Addsent2026.02 | 5.3 | — | 75.3 | |
| GraCeFulPoison Method=Badnets2026.02 | 1.05 | — | 74.2 | |
| ProtegoFedPoison Method=Badnets2026.02 | 0 | — | 75.05 | |
| ProtegoFedPoison Method=Addsent2026.02 | 0 | — | 74.25 | |
| ProtegoFedPoison Method=CBA2026.02 | 0 | — | 73.5 | |
| ProtegoFedPoison Method=StyleBkd2026.02 | 0 | — | 75.5 |