# Hypothesis Identification in Dialogues on BarExamQA Legal domain (test)

Source: [Hypothesis Identification in Dialogues on BarExamQA Legal domain (test)](<https://www.sota2.com/research/sota/hypothesis-identification-in-dialogues-on-barexamqa-legal-domain-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-09T07:49:36.260Z

Evaluation of model performance on the test split of the BarExamQA Legal domain dataset, focusing on the task of identifying hypotheses within dialogues, measured by success rate and average turns.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Hypothesis identification in dialogues |
| Dataset (including any stated split) | BarExamQA Legal domain (test) |
| Metric | Success Rate |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 10 of 10 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Success Rate](<https://www.sota2.com/research/sota/hypothesis-identification-in-dialogues-on-barexamqa-legal-domain-test.md?metric=Success%20Rate>): Higher is better; unit: PERCENT.

- [Average Turns](<https://www.sota2.com/research/sota/hypothesis-identification-in-dialogues-on-barexamqa-legal-domain-test.md?metric=Average%20Turns>): Lower is better; unit: SCALAR.

## Recorded results

| Method | Success Rate | Result date | Report paper |
| --- | --- | --- | --- |
| INFOGATHERER | 66.5 | Not recorded | 69ae53d82d603e6de3e427ff |
| INFOGATHERER | 64.3 | Not recorded | 69ae53d82d603e6de3e427ff |
| IG Bayesian | 61.3 | Not recorded | 69ae53d82d603e6de3e427ff |
| UoT | 60.8 | Not recorded | 69ae53d82d603e6de3e427ff |
| IG Bayesian | 57.9 | Not recorded | 69ae53d82d603e6de3e427ff |
| UoT | 32.8 | Not recorded | 69ae53d82d603e6de3e427ff |
| MediQ | 27.2 | Not recorded | 69ae53d82d603e6de3e427ff |
| MediQ | 25.7 | Not recorded | 69ae53d82d603e6de3e427ff |
| AoP | 17.1 | Not recorded | 69ae53d82d603e6de3e427ff |
| AoP | 15.4 | Not recorded | 69ae53d82d603e6de3e427ff |

### INFOGATHERER

Success Rate: 66.5. Result ID: 69ae7ade6dbb7075b95656f4.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53d82d603e6de3e427ff.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69ae53d82d603e6de3e427ff.md>)

Recorded evaluation configuration: {"Model":"gpt-5-nano"}. This record does not assert independent reproduction.

### INFOGATHERER

Success Rate: 64.3. Result ID: 69ae7ade6dbb7075b95656f9.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53d82d603e6de3e427ff.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69ae53d82d603e6de3e427ff.md>)

Recorded evaluation configuration: {"Model":"Qwen3 32B"}. This record does not assert independent reproduction.

### IG Bayesian

Success Rate: 61.3. Result ID: 69ae7ade6dbb7075b95656f3.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53d82d603e6de3e427ff.md>)

Recorded evaluation configuration: {"Model":"gpt-5-nano"}. This record does not assert independent reproduction.

### UoT

Success Rate: 60.8. Result ID: 69ae7ade6dbb7075b95656f7.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53d82d603e6de3e427ff.md>)

Recorded evaluation configuration: {"Model":"Qwen3 32B"}. This record does not assert independent reproduction.

### IG Bayesian

Success Rate: 57.9. Result ID: 69ae7ade6dbb7075b95656f8.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53d82d603e6de3e427ff.md>)

Recorded evaluation configuration: {"Model":"Qwen3 32B"}. This record does not assert independent reproduction.

### UoT

Success Rate: 32.8. Result ID: 69ae7ade6dbb7075b95656f2.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53d82d603e6de3e427ff.md>)

Recorded evaluation configuration: {"Model":"gpt-5-nano"}. This record does not assert independent reproduction.

### MediQ

Success Rate: 27.2. Result ID: 69ae7ade6dbb7075b95656f1.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53d82d603e6de3e427ff.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa759c1e209131cea68f2f.md>)

[Implementation](<https://github.com/stellali7/MediQ>)

Recorded evaluation configuration: {"Model":"gpt-5-nano"}. This record does not assert independent reproduction.

### MediQ

Success Rate: 25.7. Result ID: 69ae7ade6dbb7075b95656f6.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53d82d603e6de3e427ff.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa759c1e209131cea68f2f.md>)

[Implementation](<https://github.com/stellali7/MediQ>)

Recorded evaluation configuration: {"Model":"Qwen3 32B"}. This record does not assert independent reproduction.

### AoP

Success Rate: 17.1. Result ID: 69ae7ade6dbb7075b95656f0.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53d82d603e6de3e427ff.md>)

Recorded evaluation configuration: {"Model":"gpt-5-nano"}. This record does not assert independent reproduction.

### AoP

Success Rate: 15.4. Result ID: 69ae7ade6dbb7075b95656f5.

[Reporting paper](<https://www.sota2.com/research/paper/69ae53d82d603e6de3e427ff.md>)

Recorded evaluation configuration: {"Model":"Qwen3 32B"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
