# Approximate Nearest Neighbor Search on ANNS Empirical Evaluation Suite

Source: [Approximate Nearest Neighbor Search on ANNS Empirical Evaluation Suite](<https://www.sota2.com/research/sota/approximate-nearest-neighbor-search-on-anns-empirical-evaluation-suite>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-10T07:50:31.948Z

Evaluation of Approximate Nearest Neighbor Search (ANNS) performance across various dimensions, including query throughput (QPS), indexing time, memory usage, scalability, and dynamic update capabilities.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Approximate Nearest Neighbor Search |
| Dataset (including any stated split) | ANNS Empirical Evaluation Suite |
| Metric | QPS vs Recall Tier |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 9 of 9 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [QPS vs Recall Tier](<https://www.sota2.com/research/sota/approximate-nearest-neighbor-search-on-anns-empirical-evaluation-suite.md?metric=QPS%20vs%20Recall%20Tier>): Higher is better; unit: SCALAR.

- [Indexing Time](<https://www.sota2.com/research/sota/approximate-nearest-neighbor-search-on-anns-empirical-evaluation-suite.md?metric=Indexing%20Time>): Lower is better; unit: TIME.

- [Memory Footprint](<https://www.sota2.com/research/sota/approximate-nearest-neighbor-search-on-anns-empirical-evaluation-suite.md?metric=Memory%20Footprint>): Lower is better; unit: SIZE.

- [High-Dimensional Scalability](<https://www.sota2.com/research/sota/approximate-nearest-neighbor-search-on-anns-empirical-evaluation-suite.md?metric=High-Dimensional%20Scalability>): Higher is better; unit: SCALAR.

- [Retrieval Size Robustness](<https://www.sota2.com/research/sota/approximate-nearest-neighbor-search-on-anns-empirical-evaluation-suite.md?metric=Retrieval%20Size%20Robustness>): Higher is better; unit: SCALAR.

- [Online Insertion Support](<https://www.sota2.com/research/sota/approximate-nearest-neighbor-search-on-anns-empirical-evaluation-suite.md?metric=Online%20Insertion%20Support>): Higher is better; unit: SCALAR.

## Recorded results

| Method | QPS vs Recall Tier | Result date | Report paper |
| --- | --- | --- | --- |
| IVFPQFS | -1 | Not recorded | 69afa57e2d603e6de3e439e0 |
| ScaNN | -1 | Not recorded | 69afa57e2d603e6de3e439e0 |
| RaBitQ+ | -1 | Not recorded | 69afa57e2d603e6de3e439e0 |
| HNSW | -2 | Not recorded | 69afa57e2d603e6de3e439e0 |
| Vamana | -2 | Not recorded | 69afa57e2d603e6de3e439e0 |
| SymQG | -3 | Not recorded | 69afa57e2d603e6de3e439e0 |
| HNSW+KS2 | -3 | Not recorded | 69afa57e2d603e6de3e439e0 |
| PAG-Lite | -3 | Not recorded | 69afa57e2d603e6de3e439e0 |
| PAG-Base | -4 | Not recorded | 69afa57e2d603e6de3e439e0 |

### IVFPQFS

QPS vs Recall Tier: -1. Result ID: 69afcd2c6dbb7075b957e57c.

[Reporting paper](<https://www.sota2.com/research/paper/69afa57e2d603e6de3e439e0.md>)

Recorded evaluation configuration: {"Category":"Quantization-Based","Reranking":"enabled"}. This record does not assert independent reproduction.

### ScaNN

QPS vs Recall Tier: -1. Result ID: 69afcd2c6dbb7075b957e57d.

[Reporting paper](<https://www.sota2.com/research/paper/69afa57e2d603e6de3e439e0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68de1e209131cea1ed83.md>)

Recorded evaluation configuration: {"Category":"Quantization-Based","Reranking":"enabled"}. This record does not assert independent reproduction.

### RaBitQ+

QPS vs Recall Tier: -1. Result ID: 69afcd2c6dbb7075b957e57e.

[Reporting paper](<https://www.sota2.com/research/paper/69afa57e2d603e6de3e439e0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74dd1e209131cea6445b.md>)

Recorded evaluation configuration: {"Category":"Quantization-Based"}. This record does not assert independent reproduction.

### HNSW

QPS vs Recall Tier: -2. Result ID: 69afcd2c6dbb7075b957e57a.

[Reporting paper](<https://www.sota2.com/research/paper/69afa57e2d603e6de3e439e0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64bf1e209131cea0645b.md>)

Recorded evaluation configuration: {"Category":"Graph-Based"}. This record does not assert independent reproduction.

### Vamana

QPS vs Recall Tier: -2. Result ID: 69afcd2c6dbb7075b957e57b.

[Reporting paper](<https://www.sota2.com/research/paper/69afa57e2d603e6de3e439e0.md>)

Recorded evaluation configuration: {"Category":"Graph-Based"}. This record does not assert independent reproduction.

### SymQG

QPS vs Recall Tier: -3. Result ID: 69afcd2c6dbb7075b957e57f.

[Reporting paper](<https://www.sota2.com/research/paper/69afa57e2d603e6de3e439e0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75be1e209131cea69a6e.md>)

Recorded evaluation configuration: {"Category":"QG"}. This record does not assert independent reproduction.

### HNSW+KS2

QPS vs Recall Tier: -3. Result ID: 69afcd2c6dbb7075b957e580.

[Reporting paper](<https://www.sota2.com/research/paper/69afa57e2d603e6de3e439e0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78da1e209131cea7ace7.md>)

Recorded evaluation configuration: {"Category":"PG"}. This record does not assert independent reproduction.

### PAG-Lite

QPS vs Recall Tier: -3. Result ID: 69afcd2c6dbb7075b957e582.

[Reporting paper](<https://www.sota2.com/research/paper/69afa57e2d603e6de3e439e0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69afa57e2d603e6de3e439e0.md>)

Recorded evaluation configuration: {"Category":"PAG","Optimization":"for fast indexing and small index size"}. This record does not assert independent reproduction.

### PAG-Base

QPS vs Recall Tier: -4. Result ID: 69afcd2c6dbb7075b957e581.

[Reporting paper](<https://www.sota2.com/research/paper/69afa57e2d603e6de3e439e0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69afa57e2d603e6de3e439e0.md>)

Recorded evaluation configuration: {"Category":"PAG","Optimization":"for high QPS"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
