# Open-vocabulary sensor-language retrieval on ActivityNarrated XS 1.0 (Cross-Subject)

Source: [Open-vocabulary sensor-language retrieval on ActivityNarrated XS 1.0 (Cross-Subject)](<https://www.sota2.com/research/sota/open-vocabulary-sensor-language-retrieval-on-activitynarrated-xs-1-0-cross-subject>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-02T10:03:34.271Z

Evaluation of open-vocabulary sensor-language retrieval capabilities on the ActivityNarrated XS 1.0 (Cross-Subject) dataset, measured using R@K, MRR, and nDCG metrics.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Open-vocabulary sensor-language retrieval |
| Dataset (including any stated split) | ActivityNarrated XS 1.0 (Cross-Subject) |
| Metric | R@1 |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 10 of 10 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [R@1](<https://www.sota2.com/research/sota/open-vocabulary-sensor-language-retrieval-on-activitynarrated-xs-1-0-cross-subject.md?metric=R%401>): Higher is better; unit: PERCENT.

- [R@5](<https://www.sota2.com/research/sota/open-vocabulary-sensor-language-retrieval-on-activitynarrated-xs-1-0-cross-subject.md?metric=R%405>): Higher is better; unit: PERCENT.

- [MRR](<https://www.sota2.com/research/sota/open-vocabulary-sensor-language-retrieval-on-activitynarrated-xs-1-0-cross-subject.md?metric=MRR>): Higher is better; unit: PERCENT.

- [nDCG@5](<https://www.sota2.com/research/sota/open-vocabulary-sensor-language-retrieval-on-activitynarrated-xs-1-0-cross-subject.md?metric=nDCG%405>): Higher is better; unit: PERCENT.

## Recorded results

| Method | R@1 | Result date | Report paper |
| --- | --- | --- | --- |
| Spectral + Q-Former + T.a. | 38.5 | Not recorded | 69cdf84b0636e5bf4afccd99 |
| Spectral + Q-Former | 34.7 | Not recorded | 69cdf84b0636e5bf4afccd99 |
| Spectral + attention | 31.4 | Not recorded | 69cdf84b0636e5bf4afccd99 |
| Spectral + mean pooling | 29.1 | Not recorded | 69cdf84b0636e5bf4afccd99 |
| Raw + Q-Former | 26.1 | Not recorded | 69cdf84b0636e5bf4afccd99 |
| Raw + attention | 23.3 | Not recorded | 69cdf84b0636e5bf4afccd99 |
| PaLM-E | 23.1 | Not recorded | 69cdf84b0636e5bf4afccd99 |
| Raw + mean pooling | 22.8 | Not recorded | 69cdf84b0636e5bf4afccd99 |
| OVHAR | 21.9 | Not recorded | 69cdf84b0636e5bf4afccd99 |
| IMU2CLIP | 10.4 | Not recorded | 69cdf84b0636e5bf4afccd99 |

### Spectral + Q-Former + T.a.

R@1: 38.5. Result ID: 69ce3db547f34ce924b7e78e.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf84b0636e5bf4afccd99.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69cdf84b0636e5bf4afccd99.md>)

Recorded evaluation configuration: {"Discretization":"Spectral","Aggregation":"Q-Former","T.a.":"true"}. This record does not assert independent reproduction.

### Spectral + Q-Former

R@1: 34.7. Result ID: 69ce3db547f34ce924b7e78d.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf84b0636e5bf4afccd99.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69cdf84b0636e5bf4afccd99.md>)

Recorded evaluation configuration: {"Discretization":"Spectral","Aggregation":"Q-Former"}. This record does not assert independent reproduction.

### Spectral + attention

R@1: 31.4. Result ID: 69ce3db547f34ce924b7e78c.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf84b0636e5bf4afccd99.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69cdf84b0636e5bf4afccd99.md>)

Recorded evaluation configuration: {"Discretization":"Spectral","Aggregation":"attention"}. This record does not assert independent reproduction.

### Spectral + mean pooling

R@1: 29.1. Result ID: 69ce3db547f34ce924b7e78b.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf84b0636e5bf4afccd99.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69cdf84b0636e5bf4afccd99.md>)

Recorded evaluation configuration: {"Discretization":"Spectral","Aggregation":"mean pooling"}. This record does not assert independent reproduction.

### Raw + Q-Former

R@1: 26.1. Result ID: 69ce3db547f34ce924b7e78a.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf84b0636e5bf4afccd99.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69cdf84b0636e5bf4afccd99.md>)

Recorded evaluation configuration: {"Discretization":"Raw","Aggregation":"Q-Former"}. This record does not assert independent reproduction.

### Raw + attention

R@1: 23.3. Result ID: 69ce3db547f34ce924b7e789.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf84b0636e5bf4afccd99.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69cdf84b0636e5bf4afccd99.md>)

Recorded evaluation configuration: {"Discretization":"Raw","Aggregation":"attention"}. This record does not assert independent reproduction.

### PaLM-E

R@1: 23.1. Result ID: 69ce3db547f34ce924b7e787.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf84b0636e5bf4afccd99.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6eb61e209131cea41b08.md>)

[Implementation](<https://palm-e.github.io/>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Raw + mean pooling

R@1: 22.8. Result ID: 69ce3db547f34ce924b7e788.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf84b0636e5bf4afccd99.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69cdf84b0636e5bf4afccd99.md>)

Recorded evaluation configuration: {"Discretization":"Raw","Aggregation":"mean pooling"}. This record does not assert independent reproduction.

### OVHAR

R@1: 21.9. Result ID: 69ce3db547f34ce924b7e786.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf84b0636e5bf4afccd99.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa768d1e209131cea6da81.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### IMU2CLIP

R@1: 10.4. Result ID: 69ce3db547f34ce924b7e785.

[Reporting paper](<https://www.sota2.com/research/paper/69cdf84b0636e5bf4afccd99.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
