# Response Ranking on Ubuntu Dialog Corpus v1 (test)

Source: [Response Ranking on Ubuntu Dialog Corpus v1 (test)](<https://www.sota2.com/research/sota/response-ranking-on-ubuntu-dialog-corpus-v1-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T06:01:30.793Z

Evaluation of response ranking performance on the test split of the Ubuntu Dialog Corpus v1, typically measured using Recall@K metrics.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Response Ranking |
| Dataset (including any stated split) | Ubuntu Dialog Corpus v1 (test) |
| Metric | Recall@1 (1/2) |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 16 of 16 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Recall@1 (1/2)](<https://www.sota2.com/research/sota/response-ranking-on-ubuntu-dialog-corpus-v1-test.md?metric=Recall%401%20(1%2F2)>): Higher is better; unit: PERCENT.

- [Recall@1 (1/10)](<https://www.sota2.com/research/sota/response-ranking-on-ubuntu-dialog-corpus-v1-test.md?metric=Recall%401%20(1%2F10)>): Higher is better; unit: PERCENT.

- [Recall@2 (1/10)](<https://www.sota2.com/research/sota/response-ranking-on-ubuntu-dialog-corpus-v1-test.md?metric=Recall%402%20(1%2F10)>): Higher is better; unit: PERCENT.

- [Recall@5 (1/10)](<https://www.sota2.com/research/sota/response-ranking-on-ubuntu-dialog-corpus-v1-test.md?metric=Recall%405%20(1%2F10)>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Recall@1 (1/2) | Result date | Report paper |
| --- | --- | --- | --- |
| HRDE-LTC | 91.6 | Not recorded | 68fa64441e209131cea039d8 |
| Ensemble | 91.5 | Not recorded | 68fa622d1e209131ce9f7f56 |
| HRDE | 91.5 | Not recorded | 68fa64441e209131cea039d8 |
| RDE-LTC | 90.3 | Not recorded | 68fa64441e209131cea039d8 |
| LSTM | 90.1 | Not recorded | 68fa622d1e209131ce9f7f56 |
| LSTM | 90.1 | Not recorded | 68fa64441e209131cea039d8 |
| RDE | 89.8 | Not recorded | 68fa64441e209131cea039d8 |
| BiMPM | 89.7 | Not recorded | 68fa64441e209131cea039d8 |
| Bi-LSTM | 89.5 | Not recorded | 68fa622d1e209131ce9f7f56 |
| CompAgg | 88.4 | Not recorded | 68fa64441e209131cea039d8 |
| LSTM | 87.8 | Not recorded | 68fa622d1e209131ce9f7f56 |
| CNN | 84.8 | Not recorded | 68fa622d1e209131ce9f7f56 |
| CNN | 84.8 | Not recorded | 68fa64441e209131cea039d8 |
| RNN | 76.8 | Not recorded | 68fa622d1e209131ce9f7f56 |
| TF-IDF | 65.9 | Not recorded | 68fa622d1e209131ce9f7f56 |
| TF-IDF | 65.9 | Not recorded | 68fa64441e209131cea039d8 |

### HRDE-LTC

Recall@1 (1/2): 91.6. Result ID: 698c819a37894ef7d9cedd40.

[Reporting paper](<https://www.sota2.com/research/paper/68fa64441e209131cea039d8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64441e209131cea039d8.md>)

[Implementation](<http://github.com/david-yoon/QA_HRDE_LTC>)

Recorded evaluation configuration: {"LTC module":"enabled"}. This record does not assert independent reproduction.

### Ensemble

Recall@1 (1/2): 91.5. Result ID: 698bd3457a967eddb7719ea4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa622d1e209131ce9f7f56.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa622d1e209131ce9f7f56.md>)

Recorded evaluation configuration: {"source":"Our Architectures","composition":"11 LSTMs, 7 Bi-LSTMs and 10 CNNs"}. This record does not assert independent reproduction.

### HRDE

Recall@1 (1/2): 91.5. Result ID: 698c819a37894ef7d9cedd3f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa64441e209131cea039d8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64441e209131cea039d8.md>)

[Implementation](<http://github.com/david-yoon/QA_HRDE_LTC>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### RDE-LTC

Recall@1 (1/2): 90.3. Result ID: 698c819a37894ef7d9cedd3e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa64441e209131cea039d8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa64441e209131cea039d8.md>)

[Implementation](<http://github.com/david-yoon/QA_HRDE_LTC>)

Recorded evaluation configuration: {"LTC module":"enabled"}. This record does not assert independent reproduction.

### LSTM

Recall@1 (1/2): 90.1. Result ID: 698bd3457a967eddb7719ea2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa622d1e209131ce9f7f56.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa622d1e209131ce9f7f56.md>)

Recorded evaluation configuration: {"source":"Our Architectures","parameters":"shared","hidden units":200,"batch size":256}. This record does not assert independent reproduction.

### LSTM

Recall@1 (1/2): 90.1. Result ID: 698c819a37894ef7d9cedd3a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa64441e209131cea039d8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa622d1e209131ce9f7f56.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### RDE

Recall@1 (1/2): 89.8. Result ID: 698c819a37894ef7d9cedd3d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa64441e209131cea039d8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62a31e209131ce9fa6ff.md>)

[Implementation](<http://github.com/npow/ubottu>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### BiMPM

Recall@1 (1/2): 89.7. Result ID: 698c819a37894ef7d9cedd3c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa64441e209131cea039d8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63851e209131ce9ff349.md>)

[Implementation](<https://zhiguowang.github.io/>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Bi-LSTM

Recall@1 (1/2): 89.5. Result ID: 698bd3457a967eddb7719ea3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa622d1e209131ce9f7f56.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa622d1e209131ce9f7f56.md>)

Recorded evaluation configuration: {"source":"Our Architectures","parameters":"shared","hidden units":250,"batch size":128}. This record does not assert independent reproduction.

### CompAgg

Recall@1 (1/2): 88.4. Result ID: 698c819a37894ef7d9cedd3b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa64441e209131cea039d8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62da1e209131ce9fba99.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### LSTM

Recall@1 (1/2): 87.8. Result ID: 698bd3457a967eddb7719ea0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa622d1e209131ce9f7f56.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa622d1e209131ce9f7f56.md>)

Recorded evaluation configuration: {"source":"Baselines from \[1\]"}. This record does not assert independent reproduction.

### CNN

Recall@1 (1/2): 84.8. Result ID: 698bd3457a967eddb7719ea1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa622d1e209131ce9f7f56.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa622d1e209131ce9f7f56.md>)

Recorded evaluation configuration: {"source":"Our Architectures","parameters":"shared","filters":"400 length 1, 100 length 2, 100 length 3","batch size":256}. This record does not assert independent reproduction.

### CNN

Recall@1 (1/2): 84.8. Result ID: 698c819a37894ef7d9cedd39.

[Reporting paper](<https://www.sota2.com/research/paper/68fa64441e209131cea039d8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa622d1e209131ce9f7f56.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### RNN

Recall@1 (1/2): 76.8. Result ID: 698bd3457a967eddb7719e9f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa622d1e209131ce9f7f56.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62a31e209131ce9fa6ff.md>)

[Implementation](<http://github.com/npow/ubottu>)

Recorded evaluation configuration: {"source":"Baselines from \[1\]"}. This record does not assert independent reproduction.

### TF-IDF

Recall@1 (1/2): 65.9. Result ID: 698bd3457a967eddb7719e9e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa622d1e209131ce9f7f56.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62a31e209131ce9fa6ff.md>)

[Implementation](<http://github.com/npow/ubottu>)

Recorded evaluation configuration: {"source":"Baselines from \[1\]"}. This record does not assert independent reproduction.

### TF-IDF

Recall@1 (1/2): 65.9. Result ID: 698c819a37894ef7d9cedd38.

[Reporting paper](<https://www.sota2.com/research/paper/68fa64441e209131cea039d8.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62a31e209131ce9fa6ff.md>)

[Implementation](<http://github.com/npow/ubottu>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
