# Quality Estimation on Portuguese (pt-BR) dialect sentences (test)

Source: [Quality Estimation on Portuguese (pt-BR) dialect sentences (test)](<https://www.sota2.com/research/sota/quality-estimation-on-portuguese-pt-br-dialect-sentences-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T06:04:57.434Z

Evaluation of Quality Estimation performance on the test split of the Portuguese (pt-BR) dialect sentences dataset, measured using Success Rate.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Quality Estimation |
| Dataset (including any stated split) | Portuguese (pt-BR) dialect sentences (test) |
| Metric | Success Rate |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 11 of 11 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Success Rate](<https://www.sota2.com/research/sota/quality-estimation-on-portuguese-pt-br-dialect-sentences-test.md?metric=Success%20Rate>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Success Rate | Result date | Report paper |
| --- | --- | --- | --- |
| NANO | 86 | Not recorded | 68fa6ddb1e209131cea3c762 |
| NANO | 85 | Not recorded | 68fa6ddb1e209131cea3c762 |
| NANO | 85 | Not recorded | 68fa6ddb1e209131cea3c762 |
| NANO | 84 | Not recorded | 68fa6ddb1e209131cea3c762 |
| NANO | 76 | Not recorded | 68fa6ddb1e209131cea3c762 |
| NANO | 67 | Not recorded | 68fa6ddb1e209131cea3c762 |
| NANO | 64 | Not recorded | 68fa6ddb1e209131cea3c762 |
| NANO | 63 | Not recorded | 68fa6ddb1e209131cea3c762 |
| COMET | 54 | Not recorded | 68fa6ddb1e209131cea3c762 |
| COMET | 53 | Not recorded | 68fa6ddb1e209131cea3c762 |
| PRISM | 44 | Not recorded | 68fa6ddb1e209131cea3c762 |

### NANO

Success Rate: 86. Result ID: 698fec7a3a6c314849fcd135.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ddb1e209131cea3c762.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ddb1e209131cea3c762.md>)

Recorded evaluation configuration: {"Evaluation Setting":"Reference-based","Model Size":"XXL","Pre-training Stage":"Without all-data (-)"}. This record does not assert independent reproduction.

### NANO

Success Rate: 85. Result ID: 698fec7a3a6c314849fcd131.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ddb1e209131cea3c762.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ddb1e209131cea3c762.md>)

Recorded evaluation configuration: {"Evaluation Setting":"Reference-free","Model Size":"XXL","Pre-training Stage":"With all-data (+)"}. This record does not assert independent reproduction.

### NANO

Success Rate: 85. Result ID: 698fec7a3a6c314849fcd136.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ddb1e209131cea3c762.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ddb1e209131cea3c762.md>)

Recorded evaluation configuration: {"Evaluation Setting":"Reference-based","Model Size":"XXL","Pre-training Stage":"With all-data (+)"}. This record does not assert independent reproduction.

### NANO

Success Rate: 84. Result ID: 698fec7a3a6c314849fcd130.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ddb1e209131cea3c762.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ddb1e209131cea3c762.md>)

Recorded evaluation configuration: {"Evaluation Setting":"Reference-free","Model Size":"XXL","Pre-training Stage":"Without all-data (-)"}. This record does not assert independent reproduction.

### NANO

Success Rate: 76. Result ID: 698fec7a3a6c314849fcd12f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ddb1e209131cea3c762.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ddb1e209131cea3c762.md>)

Recorded evaluation configuration: {"Evaluation Setting":"Reference-free","Model Size":"XL","Pre-training Stage":"With all-data (+)"}. This record does not assert independent reproduction.

### NANO

Success Rate: 67. Result ID: 698fec7a3a6c314849fcd12e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ddb1e209131cea3c762.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ddb1e209131cea3c762.md>)

Recorded evaluation configuration: {"Evaluation Setting":"Reference-free","Model Size":"XL","Pre-training Stage":"Without all-data (-)"}. This record does not assert independent reproduction.

### NANO

Success Rate: 64. Result ID: 698fec7a3a6c314849fcd134.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ddb1e209131cea3c762.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ddb1e209131cea3c762.md>)

Recorded evaluation configuration: {"Evaluation Setting":"Reference-based","Model Size":"XL","Pre-training Stage":"With all-data (+)"}. This record does not assert independent reproduction.

### NANO

Success Rate: 63. Result ID: 698fec7a3a6c314849fcd133.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ddb1e209131cea3c762.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ddb1e209131cea3c762.md>)

Recorded evaluation configuration: {"Evaluation Setting":"Reference-based","Model Size":"XL","Pre-training Stage":"Without all-data (-)"}. This record does not assert independent reproduction.

### COMET

Success Rate: 54. Result ID: 698fec7a3a6c314849fcd12d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ddb1e209131cea3c762.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa688c1e209131cea1cdb6.md>)

Recorded evaluation configuration: {"Evaluation Setting":"Reference-free"}. This record does not assert independent reproduction.

### COMET

Success Rate: 53. Result ID: 698fec7a3a6c314849fcd132.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ddb1e209131cea3c762.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa688c1e209131cea1cdb6.md>)

Recorded evaluation configuration: {"Evaluation Setting":"Reference-based"}. This record does not assert independent reproduction.

### PRISM

Success Rate: 44. Result ID: 698fec7a3a6c314849fcd12c.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6ddb1e209131cea3c762.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa689d1e209131cea1d157.md>)

Recorded evaluation configuration: {"Evaluation Setting":"Reference-free"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
