# End-to-End Dialog Modeling on CamRest676 (few-shot re-organized)

Source: [End-to-End Dialog Modeling on CamRest676 (few-shot re-organized)](<https://www.sota2.com/research/sota/end-to-end-dialog-modeling-on-camrest676-few-shot-re-organized>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:47:12.035Z

Evaluation of End-to-End Dialog Modeling performance on the few-shot re-organized split of the CamRest676 dataset, measured using Inform, Success, and BLEU scores.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | End-to-End Dialog Modeling |
| Dataset (including any stated split) | CamRest676 few-shot re-organized |
| Metric | Inform Rate |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 4 of 4 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Inform Rate](<https://www.sota2.com/research/sota/end-to-end-dialog-modeling-on-camrest676-few-shot-re-organized.md?metric=Inform%20Rate>): Higher is better; unit: PERCENT.

- [Success Rate](<https://www.sota2.com/research/sota/end-to-end-dialog-modeling-on-camrest676-few-shot-re-organized.md?metric=Success%20Rate>): Higher is better; unit: PERCENT.

- [BLEU](<https://www.sota2.com/research/sota/end-to-end-dialog-modeling-on-camrest676-few-shot-re-organized.md?metric=BLEU>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Inform Rate | Result date | Report paper |
| --- | --- | --- | --- |
| SOLOISTL | 88.05 | Not recorded | 68fa69b11e209131cea23707 |
| SOLOIST | 85.82 | Not recorded | 68fa69b11e209131cea23707 |
| SOLOIST w/o pre-training | 73.88 | Not recorded | 68fa69b11e209131cea23707 |
| Sequicity | 60.61 | Not recorded | 68fa69b11e209131cea23707 |

### SOLOISTL

Inform Rate: 88.05. Result ID: 698f500c3a6c314849f7da22.

[Reporting paper](<https://www.sota2.com/research/paper/68fa69b11e209131cea23707.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69b11e209131cea23707.md>)

[Implementation](<https://aka.ms/soloist>)

Recorded evaluation configuration: {"setting":"few-shot fine-tuning","pre-training":true}. This record does not assert independent reproduction.

### SOLOIST

Inform Rate: 85.82. Result ID: 698f500c3a6c314849f7da21.

[Reporting paper](<https://www.sota2.com/research/paper/68fa69b11e209131cea23707.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69b11e209131cea23707.md>)

[Implementation](<https://aka.ms/soloist>)

Recorded evaluation configuration: {"setting":"few-shot fine-tuning","pre-training":true}. This record does not assert independent reproduction.

### SOLOIST w/o pre-training

Inform Rate: 73.88. Result ID: 698f500c3a6c314849f7da20.

[Reporting paper](<https://www.sota2.com/research/paper/68fa69b11e209131cea23707.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69b11e209131cea23707.md>)

[Implementation](<https://aka.ms/soloist>)

Recorded evaluation configuration: {"setting":"few-shot fine-tuning","pre-training":false}. This record does not assert independent reproduction.

### Sequicity

Inform Rate: 60.61. Result ID: 698f500c3a6c314849f7da1f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa69b11e209131cea23707.md>)

Recorded evaluation configuration: {"setting":"few-shot fine-tuning"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.