GenAI Search Optimization Attack Effectiveness on Amazon ESCI
100Sr@10IOA
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| IOARetriever=BM25, Evaluation Protocol=FC2026.05 | 100 | 65 | 41 | |
| IOARetriever=Dense, Evaluation Protocol=FC2026.05 | 100 | 73.5 | 46 | |
| ReviewRetriever=BM25, Evaluation Protocol=FC2026.05 | 100 | 63 | 51.5 | |
| ReviewRetriever=Dense, Evaluation Protocol=FC2026.05 | 100 | 68 | 58.5 | |
| ReasonRetriever=BM25, Evaluation Protocol=FC2026.05 | 100 | 60 | 44.5 | |
| ReasonRetriever=Dense, Evaluation Protocol=FC2026.05 | 100 | 65 | 54.5 | |
| TAPRetriever=BM25, Evaluation Protocol=FC2026.05 | 100 | 59.5 | 57 | |
| TAPRetriever=Dense, Evaluation Protocol=FC2026.05 | 100 | 60.5 | 56.5 | |
| SRPRetriever=BM25, Evaluation Protocol=FC2026.05 | 100 | 4 | 2 | |
| SRPRetriever=Dense, Evaluation Protocol=FC2026.05 | 100 | 8 | 2.5 | |
| RAFRetriever=BM25, Evaluation Protocol=FC2026.05 | 100 | 3.5 | 1.5 | |
| RAFRetriever=Dense, Evaluation Protocol=FC2026.05 | 100 | 6.5 | 2 | |
| STSRetriever=BM25, Evaluation Protocol=FC2026.05 | 100 | 5 | 2 | |
| STSRetriever=Dense, Evaluation Protocol=FC2026.05 | 100 | 5 | 0.5 | |
| ReasonRetriever=Dense, Evaluation Protocol=E2E2026.05 | 98.5 | 72.5 | 59 | |
| ReviewRetriever=Dense, Evaluation Protocol=E2E2026.05 | 95 | 61.5 | 47 | |
| ReasonRetriever=BM25, Evaluation Protocol=E2E2026.05 | 91 | 62.5 | 48 | |
| ReviewRetriever=BM25, Evaluation Protocol=E2E2026.05 | 89.5 | 61 | 46.5 | |
| TAPRetriever=BM25, Evaluation Protocol=E2E2026.05 | 89.5 | 40.5 | 39.5 | |
| TAPRetriever=Dense, Evaluation Protocol=E2E2026.05 | 87 | 45.5 | 41 | |
| SRPRetriever=Dense, Evaluation Protocol=E2E2026.05 | 79.5 | 6.5 | 1 | |
| RAFRetriever=BM25, Evaluation Protocol=E2E2026.05 | 78 | 4 | 2.5 | |
| STSRetriever=Dense, Evaluation Protocol=E2E2026.05 | 76 | 3.5 | 1 | |
| RAFRetriever=Dense, Evaluation Protocol=E2E2026.05 | 75.5 | 4 | 1.5 | |
| SRPRetriever=BM25, Evaluation Protocol=E2E2026.05 | 74 | 3 | 1 | |
| IOARetriever=Dense, Evaluation Protocol=E2E2026.05 | 68 | 25.5 | 17.5 | |
| STSRetriever=BM25, Evaluation Protocol=E2E2026.05 | 66.5 | 1 | 0.5 | |
| IOARetriever=BM25, Evaluation Protocol=E2E2026.05 | 50.5 | 15.5 | 12 |