# Ranking Attack on MS-MARCO Passage (Mixture)

Source: [Ranking Attack on MS-MARCO Passage (Mixture)](<https://www.sota2.com/research/sota/ranking-attack-on-ms-marco-passage-mixture>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-07-07T08:49:51.775Z

Evaluation of ranking performance under attack scenarios on the mixture subset of the MS-MARCO Passage dataset, measured using SRR@100, SRR@1000, and NRS@1000.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Ranking Attack |
| Dataset (including any stated split) | MS-MARCO Passage (Mixture) |
| Metric | SRR@100 |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 15 of 15 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [SRR@100](<https://www.sota2.com/research/sota/ranking-attack-on-ms-marco-passage-mixture.md?metric=SRR%40100>): Higher is better; unit: PERCENT.

- [SRR@1000](<https://www.sota2.com/research/sota/ranking-attack-on-ms-marco-passage-mixture.md?metric=SRR%401000>): Higher is better; unit: PERCENT.

- [NRS@1000](<https://www.sota2.com/research/sota/ranking-attack-on-ms-marco-passage-mixture.md?metric=NRS%401000>): Higher is better; unit: PERCENT.

## Recorded results

| Method | SRR@100 | Result date | Report paper |
| --- | --- | --- | --- |
| SentAttacknoit | 34.5 | Not recorded | 6a4c881485dba69fef8b27f5 |
| SentAttack | 33.9 | Not recorded | 6a4c881485dba69fef8b27f5 |
| SentAttack | 33.9 | Not recorded | 6a4c881485dba69fef8b27f5 |
| SentAttackSyn | 30.4 | Not recorded | 6a4c881485dba69fef8b27f5 |
| MCARA | 23.7 | Not recorded | 6a4c881485dba69fef8b27f5 |
| MCARA | 23.7 | Not recorded | 6a4c881485dba69fef8b27f5 |
| TS | 17.8 | Not recorded | 6a4c881485dba69fef8b27f5 |
| TS | 17.8 | Not recorded | 6a4c881485dba69fef8b27f5 |
| PRADA | 14.7 | Not recorded | 6a4c881485dba69fef8b27f5 |
| PRADA | 14.7 | Not recorded | 6a4c881485dba69fef8b27f5 |
| PAT | 10.4 | Not recorded | 6a4c881485dba69fef8b27f5 |
| PAT | 10.4 | Not recorded | 6a4c881485dba69fef8b27f5 |
| SentAttackConcat | 9.7 | Not recorded | 6a4c881485dba69fef8b27f5 |
| TF-IDF | 6.1 | Not recorded | 6a4c881485dba69fef8b27f5 |
| TF-IDF | 6.1 | Not recorded | 6a4c881485dba69fef8b27f5 |

### SentAttacknoit

SRR@100: 34.5. Result ID: 6a4cbd9660b88bb339c8e15f.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

Recorded evaluation configuration: {"Iterative Retrieval":"false"}. This record does not assert independent reproduction.

### SentAttack

SRR@100: 33.9. Result ID: 6a4cbd9660b88bb339c8e128.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

Recorded evaluation configuration: {"variant":"full method"}. This record does not assert independent reproduction.

### SentAttack

SRR@100: 33.9. Result ID: 6a4cbd9660b88bb339c8e160.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

Recorded evaluation configuration: {"Iterative Retrieval":"true"}. This record does not assert independent reproduction.

### SentAttackSyn

SRR@100: 30.4. Result ID: 6a4cbd9660b88bb339c8e127.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

Recorded evaluation configuration: {"variant":"gradient-guided synonym substitution only"}. This record does not assert independent reproduction.

### MCARA

SRR@100: 23.7. Result ID: 6a4cbd9660b88bb339c8e125.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70591e209131cea4a769.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### MCARA

SRR@100: 23.7. Result ID: 6a4cbd9660b88bb339c8e15e.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70591e209131cea4a769.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### TS

SRR@100: 17.8. Result ID: 6a4cbd9660b88bb339c8e122.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### TS

SRR@100: 17.8. Result ID: 6a4cbd9660b88bb339c8e15b.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### PRADA

SRR@100: 14.7. Result ID: 6a4cbd9660b88bb339c8e124.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6cb51e209131cea356b0.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### PRADA

SRR@100: 14.7. Result ID: 6a4cbd9660b88bb339c8e15d.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6cb51e209131cea356b0.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### PAT

SRR@100: 10.4. Result ID: 6a4cbd9660b88bb339c8e123.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f171e209131cea43d7f.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### PAT

SRR@100: 10.4. Result ID: 6a4cbd9660b88bb339c8e15c.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f171e209131cea43d7f.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### SentAttackConcat

SRR@100: 9.7. Result ID: 6a4cbd9660b88bb339c8e126.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

Recorded evaluation configuration: {"variant":"centroid document concatenation only"}. This record does not assert independent reproduction.

### TF-IDF

SRR@100: 6.1. Result ID: 6a4cbd9660b88bb339c8e121.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### TF-IDF

SRR@100: 6.1. Result ID: 6a4cbd9660b88bb339c8e15a.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
