# Open-ended QA Response Ranking on GaokaoBench Minos

Source: [Open-ended QA Response Ranking on GaokaoBench Minos](<https://www.sota2.com/research/sota/open-ended-qa-response-ranking-on-gaokaobench-minos>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:47:41.400Z

Evaluation of model performance on open-ended question answering response ranking using the GaokaoBench Minos dataset, assessed using metrics like K, S, and RBO.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Open-ended QA Response Ranking |
| Dataset (including any stated split) | GaokaoBench Minos |
| Metric | K Score |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 9 of 9 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [K Score](<https://www.sota2.com/research/sota/open-ended-qa-response-ranking-on-gaokaobench-minos.md?metric=K%20Score>): Higher is better; unit: SCALAR.

- [S Score](<https://www.sota2.com/research/sota/open-ended-qa-response-ranking-on-gaokaobench-minos.md?metric=S%20Score>): Higher is better; unit: SCALAR.

- [RBO (p=0.5)](<https://www.sota2.com/research/sota/open-ended-qa-response-ranking-on-gaokaobench-minos.md?metric=RBO%20(p%3D0.5)>): Higher is better; unit: SCALAR.

- [RBO (p=0.9)](<https://www.sota2.com/research/sota/open-ended-qa-response-ranking-on-gaokaobench-minos.md?metric=RBO%20(p%3D0.9)>): Higher is better; unit: SCALAR.

## Recorded results

| Method | K Score | Result date | Report paper |
| --- | --- | --- | --- |
| MinosEval | 59.77 | Not recorded | 68fa797f1e209131cea7dd11 |
| MinosEval | 56.12 | Not recorded | 68fa797f1e209131cea7dd11 |
| Listwise | 55.33 | Not recorded | 68fa797f1e209131cea7dd11 |
| Pairwise | 45.71 | Not recorded | 68fa797f1e209131cea7dd11 |
| LINKAGE | 37.45 | Not recorded | 68fa797f1e209131cea7dd11 |
| Pointwise | 31.06 | Not recorded | 68fa797f1e209131cea7dd11 |
| BERTScore | 12.92 | Not recorded | 68fa797f1e209131cea7dd11 |
| BLEU | 11.08 | Not recorded | 68fa797f1e209131cea7dd11 |
| ROUGE-L | 4.89 | Not recorded | 68fa797f1e209131cea7dd11 |

### MinosEval

K Score: 59.77. Result ID: 698b4feb8d67a41d0a6cfcb6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa797f1e209131cea7dd11.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa797f1e209131cea7dd11.md>)

[Implementation](<https://github.com/JOHNNY-fans/MinosEval>)

Recorded evaluation configuration: {"Manual Factoid Classification":true}. This record does not assert independent reproduction.

### MinosEval

K Score: 56.12. Result ID: 698b4feb8d67a41d0a6cfcb5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa797f1e209131cea7dd11.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa797f1e209131cea7dd11.md>)

[Implementation](<https://github.com/JOHNNY-fans/MinosEval>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Listwise

K Score: 55.33. Result ID: 698b4feb8d67a41d0a6cfcb3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa797f1e209131cea7dd11.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Pairwise

K Score: 45.71. Result ID: 698b4feb8d67a41d0a6cfcb2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa797f1e209131cea7dd11.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78081e209131cea76714.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### LINKAGE

K Score: 37.45. Result ID: 698b4feb8d67a41d0a6cfcb4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa797f1e209131cea7dd11.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74f71e209131cea64ef3.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Pointwise

K Score: 31.06. Result ID: 698b4feb8d67a41d0a6cfcb1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa797f1e209131cea7dd11.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f6b1e209131cea4574f.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### BERTScore

K Score: 12.92. Result ID: 698b4feb8d67a41d0a6cfcb0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa797f1e209131cea7dd11.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa67171e209131cea140d5.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### BLEU

K Score: 11.08. Result ID: 698b4feb8d67a41d0a6cfcae.

[Reporting paper](<https://www.sota2.com/research/paper/68fa797f1e209131cea7dd11.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### ROUGE-L

K Score: 4.89. Result ID: 698b4feb8d67a41d0a6cfcaf.

[Reporting paper](<https://www.sota2.com/research/paper/68fa797f1e209131cea7dd11.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
