# Open-vocabulary sensor-language retrieval on ActivityNarrated XP 1.0 (Cross-Position)

Source: [Open-vocabulary sensor-language retrieval on ActivityNarrated XP 1.0 (Cross-Position)](<https://www.sota2.com/research/sota/open-vocabulary-sensor-language-retrieval-on-activitynarrated-xp-1-0-cross-position>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-02T10:03:34.315Z

Evaluation of open-vocabulary sensor-language retrieval capabilities on the ActivityNarrated XP 1.0 (Cross-Position) dataset, measured using rank and utility metrics (R@K, MRR, nDCG).

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Open-vocabulary sensor-language retrieval |
| Dataset (including any stated split) | ActivityNarrated XP 1.0 (Cross-Position) |
| Metric | R@1 |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 10 of 10 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [R@1](<https://www.sota2.com/research/sota/open-vocabulary-sensor-language-retrieval-on-activitynarrated-xp-1-0-cross-position.md?metric=R%401>): Higher is better; unit: PERCENT.

- [R@5](<https://www.sota2.com/research/sota/open-vocabulary-sensor-language-retrieval-on-activitynarrated-xp-1-0-cross-position.md?metric=R%405>): Higher is better; unit: PERCENT.

- [MRR](<https://www.sota2.com/research/sota/open-vocabulary-sensor-language-retrieval-on-activitynarrated-xp-1-0-cross-position.md?metric=MRR>): Higher is better; unit: PERCENT.

- [nDCG@5](<https://www.sota2.com/research/sota/open-vocabulary-sensor-language-retrieval-on-activitynarrated-xp-1-0-cross-position.md?metric=nDCG%405>): Higher is better; unit: PERCENT.

## Recorded results

| Method | R@1 | Result date | Report paper |
| --- | --- | --- | --- |
| Spectral + Q-Former + T.a. | 34 | Not recorded | 69cdf84b0636e5bf4afccd99 |
| Spectral + Q-Former | 30.9 | Not recorded | 69cdf84b0636e5bf4afccd99 |
| Spectral + attention | 28 | Not recorded | 69cdf84b0636e5bf4afccd99 |
| Spectral + mean pooling | 25.7 | Not recorded | 69cdf84b0636e5bf4afccd99 |
| Raw + Q-Former | 23.2 | Not recorded | 69cdf84b0636e5bf4afccd99 |
| Raw + attention | 21 | Not recorded | 69cdf84b0636e5bf4afccd99 |
| PaLM-E | 20.9 | Not recorded | 69cdf84b0636e5bf4afccd99 |
| Raw + mean pooling | 20.1 | Not recorded | 69cdf84b0636e5bf4afccd99 |
| OVHAR | 19.3 | Not recorded | 69cdf84b0636e5bf4afccd99 |
| IMU2CLIP | 8.9 | Not recorded | 69cdf84b0636e5bf4afccd99 |

### Spectral + Q-Former + T.a.

R@1: 34. Result ID: 69ce3db547f34ce924b7e798.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf84b0636e5bf4afccd99.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69cdf84b0636e5bf4afccd99.md>)

Recorded evaluation configuration: {"Discretization":"Spectral","Aggregation":"Q-Former","T.a.":"true"}. This record does not assert independent reproduction.

### Spectral + Q-Former

R@1: 30.9. Result ID: 69ce3db547f34ce924b7e797.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf84b0636e5bf4afccd99.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69cdf84b0636e5bf4afccd99.md>)

Recorded evaluation configuration: {"Discretization":"Spectral","Aggregation":"Q-Former"}. This record does not assert independent reproduction.

### Spectral + attention

R@1: 28. Result ID: 69ce3db547f34ce924b7e796.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf84b0636e5bf4afccd99.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69cdf84b0636e5bf4afccd99.md>)

Recorded evaluation configuration: {"Discretization":"Spectral","Aggregation":"attention"}. This record does not assert independent reproduction.

### Spectral + mean pooling

R@1: 25.7. Result ID: 69ce3db547f34ce924b7e795.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf84b0636e5bf4afccd99.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69cdf84b0636e5bf4afccd99.md>)

Recorded evaluation configuration: {"Discretization":"Spectral","Aggregation":"mean pooling"}. This record does not assert independent reproduction.

### Raw + Q-Former

R@1: 23.2. Result ID: 69ce3db547f34ce924b7e794.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf84b0636e5bf4afccd99.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69cdf84b0636e5bf4afccd99.md>)

Recorded evaluation configuration: {"Discretization":"Raw","Aggregation":"Q-Former"}. This record does not assert independent reproduction.

### Raw + attention

R@1: 21. Result ID: 69ce3db547f34ce924b7e793.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf84b0636e5bf4afccd99.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69cdf84b0636e5bf4afccd99.md>)

Recorded evaluation configuration: {"Discretization":"Raw","Aggregation":"attention"}. This record does not assert independent reproduction.

### PaLM-E

R@1: 20.9. Result ID: 69ce3db547f34ce924b7e791.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf84b0636e5bf4afccd99.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6eb61e209131cea41b08.md>)

[Implementation](<https://palm-e.github.io/>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Raw + mean pooling

R@1: 20.1. Result ID: 69ce3db547f34ce924b7e792.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf84b0636e5bf4afccd99.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69cdf84b0636e5bf4afccd99.md>)

Recorded evaluation configuration: {"Discretization":"Raw","Aggregation":"mean pooling"}. This record does not assert independent reproduction.

### OVHAR

R@1: 19.3. Result ID: 69ce3db547f34ce924b7e790.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf84b0636e5bf4afccd99.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa768d1e209131cea6da81.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### IMU2CLIP

R@1: 8.9. Result ID: 69ce3db547f34ce924b7e78f.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf84b0636e5bf4afccd99.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
