# Ranking Attack on MS-MARCO Passage (Hard)

Source: [Ranking Attack on MS-MARCO Passage (Hard)](<https://www.sota2.com/research/sota/ranking-attack-on-ms-marco-passage-hard>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-07-07T08:49:51.750Z

Evaluation of Ranking Attack performance on the hard subset of the MS MARCO Passage dataset, measured using SRR@100, SRR@1000, and NRS@1000 metrics.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Ranking Attack |
| Dataset (including any stated split) | MS-MARCO Passage (Hard) |
| Metric | SRR@100 |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 15 of 15 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [SRR@100](<https://www.sota2.com/research/sota/ranking-attack-on-ms-marco-passage-hard.md?metric=SRR%40100>): Higher is better; unit: SCALAR.

- [SRR@1000](<https://www.sota2.com/research/sota/ranking-attack-on-ms-marco-passage-hard.md?metric=SRR%401000>): Higher is better; unit: SCALAR.

- [NRS@1000](<https://www.sota2.com/research/sota/ranking-attack-on-ms-marco-passage-hard.md?metric=NRS%401000>): Higher is better; unit: SCALAR.

## Recorded results

| Method | SRR@100 | Result date | Report paper |
| --- | --- | --- | --- |
| SentAttack | 31.2 | Not recorded | 6a4c881485dba69fef8b27f5 |
| SentAttack | 31.2 | Not recorded | 6a4c881485dba69fef8b27f5 |
| SentAttacknoit | 30.8 | Not recorded | 6a4c881485dba69fef8b27f5 |
| MCARA | 15.3 | Not recorded | 6a4c881485dba69fef8b27f5 |
| MCARA | 15.3 | Not recorded | 6a4c881485dba69fef8b27f5 |
| SentAttackSyn | 12.1 | Not recorded | 6a4c881485dba69fef8b27f5 |
| PRADA | 10.6 | Not recorded | 6a4c881485dba69fef8b27f5 |
| PRADA | 10.6 | Not recorded | 6a4c881485dba69fef8b27f5 |
| TS | 8.4 | Not recorded | 6a4c881485dba69fef8b27f5 |
| TS | 8.4 | Not recorded | 6a4c881485dba69fef8b27f5 |
| PAT | 5.3 | Not recorded | 6a4c881485dba69fef8b27f5 |
| PAT | 5.3 | Not recorded | 6a4c881485dba69fef8b27f5 |
| SentAttackConcat | 2.2 | Not recorded | 6a4c881485dba69fef8b27f5 |
| TF-IDF | 2.1 | Not recorded | 6a4c881485dba69fef8b27f5 |
| TF-IDF | 2.1 | Not recorded | 6a4c881485dba69fef8b27f5 |

### SentAttack

SRR@100: 31.2. Result ID: 6a4cbd9660b88bb339c8e120.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

Recorded evaluation configuration: {"variant":"full method"}. This record does not assert independent reproduction.

### SentAttack

SRR@100: 31.2. Result ID: 6a4cbd9660b88bb339c8e159.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

Recorded evaluation configuration: {"Iterative Retrieval":"true"}. This record does not assert independent reproduction.

### SentAttacknoit

SRR@100: 30.8. Result ID: 6a4cbd9660b88bb339c8e158.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

Recorded evaluation configuration: {"Iterative Retrieval":"false"}. This record does not assert independent reproduction.

### MCARA

SRR@100: 15.3. Result ID: 6a4cbd9660b88bb339c8e11d.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70591e209131cea4a769.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### MCARA

SRR@100: 15.3. Result ID: 6a4cbd9660b88bb339c8e157.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70591e209131cea4a769.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### SentAttackSyn

SRR@100: 12.1. Result ID: 6a4cbd9660b88bb339c8e11f.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

Recorded evaluation configuration: {"variant":"gradient-guided synonym substitution only"}. This record does not assert independent reproduction.

### PRADA

SRR@100: 10.6. Result ID: 6a4cbd9660b88bb339c8e11c.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6cb51e209131cea356b0.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### PRADA

SRR@100: 10.6. Result ID: 6a4cbd9660b88bb339c8e156.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6cb51e209131cea356b0.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### TS

SRR@100: 8.4. Result ID: 6a4cbd9660b88bb339c8e11a.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### TS

SRR@100: 8.4. Result ID: 6a4cbd9660b88bb339c8e154.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### PAT

SRR@100: 5.3. Result ID: 6a4cbd9660b88bb339c8e11b.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f171e209131cea43d7f.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### PAT

SRR@100: 5.3. Result ID: 6a4cbd9660b88bb339c8e155.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f171e209131cea43d7f.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### SentAttackConcat

SRR@100: 2.2. Result ID: 6a4cbd9660b88bb339c8e11e.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

Recorded evaluation configuration: {"variant":"centroid document concatenation only"}. This record does not assert independent reproduction.

### TF-IDF

SRR@100: 2.1. Result ID: 6a4cbd9660b88bb339c8e119.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### TF-IDF

SRR@100: 2.1. Result ID: 6a4cbd9660b88bb339c8e153.

[Reporting paper](<https://www.sota2.com/research/paper/6a4c881485dba69fef8b27f5.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
