# Human-centric Quality Evaluation on Arena-Hard

Source: [Human-centric Quality Evaluation on Arena-Hard](<https://www.sota2.com/research/sota/human-centric-quality-evaluation-on-arena-hard>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-29T10:43:46.200Z

Evaluation of model performance based on human-centric quality judgments using the Arena-Hard dataset.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Human-centric Quality Evaluation |
| Dataset (including any stated split) | Arena-Hard |
| Metric | Arena-Hard Score |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 15 of 15 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Arena-Hard Score](<https://www.sota2.com/research/sota/human-centric-quality-evaluation-on-arena-hard.md?metric=Arena-Hard%20Score>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Arena-Hard Score | Result date | Report paper |
| --- | --- | --- | --- |
| Instruct | 28.8 | Not recorded | 6a191de0dbd7150506f82bbd |
| REDIPO | 28.5 | Not recorded | 6a191de0dbd7150506f82bbd |
| DPO | 28.2 | Not recorded | 6a191de0dbd7150506f82bbd |
| DivPO | 28.2 | Not recorded | 6a191de0dbd7150506f82bbd |
| Base | 19.5 | Not recorded | 6a191de0dbd7150506f82bbd |
| Instruct | 19.3 | Not recorded | 6a191de0dbd7150506f82bbd |
| REDIPO | 18.6 | Not recorded | 6a191de0dbd7150506f82bbd |
| DPO | 18.3 | Not recorded | 6a191de0dbd7150506f82bbd |
| DivPO | 18.1 | Not recorded | 6a191de0dbd7150506f82bbd |
| Base | 14.6 | Not recorded | 6a191de0dbd7150506f82bbd |
| Instruct | 14 | Not recorded | 6a191de0dbd7150506f82bbd |
| DPO | 14 | Not recorded | 6a191de0dbd7150506f82bbd |
| REDIPO | 14 | Not recorded | 6a191de0dbd7150506f82bbd |
| Base | 13.4 | Not recorded | 6a191de0dbd7150506f82bbd |
| DivPO | 12.8 | Not recorded | 6a191de0dbd7150506f82bbd |

### Instruct

Arena-Hard Score: 28.8. Result ID: 6a196dbbfbc373592c1480cd.

[Reporting paper](<https://www.sota2.com/research/paper/6a191de0dbd7150506f82bbd.md>)

Recorded evaluation configuration: {"Model":"Qwen3-4B"}. This record does not assert independent reproduction.

### REDIPO

Arena-Hard Score: 28.5. Result ID: 6a196dbbfbc373592c1480d0.

[Reporting paper](<https://www.sota2.com/research/paper/6a191de0dbd7150506f82bbd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a191de0dbd7150506f82bbd.md>)

Recorded evaluation configuration: {"Model":"Qwen3-4B"}. This record does not assert independent reproduction.

### DPO

Arena-Hard Score: 28.2. Result ID: 6a196dbbfbc373592c1480ce.

[Reporting paper](<https://www.sota2.com/research/paper/6a191de0dbd7150506f82bbd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74511e209131cea6105d.md>)

Recorded evaluation configuration: {"Model":"Qwen3-4B"}. This record does not assert independent reproduction.

### DivPO

Arena-Hard Score: 28.2. Result ID: 6a196dbbfbc373592c1480cf.

[Reporting paper](<https://www.sota2.com/research/paper/6a191de0dbd7150506f82bbd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78bc1e209131cea7a1fa.md>)

Recorded evaluation configuration: {"Model":"Qwen3-4B"}. This record does not assert independent reproduction.

### Base

Arena-Hard Score: 19.5. Result ID: 6a196dbbfbc373592c1480cc.

[Reporting paper](<https://www.sota2.com/research/paper/6a191de0dbd7150506f82bbd.md>)

Recorded evaluation configuration: {"Model":"Qwen3-4B"}. This record does not assert independent reproduction.

### Instruct

Arena-Hard Score: 19.3. Result ID: 6a196dbbfbc373592c1480d7.

[Reporting paper](<https://www.sota2.com/research/paper/6a191de0dbd7150506f82bbd.md>)

Recorded evaluation configuration: {"Model":"LLaMA-3.1-8B"}. This record does not assert independent reproduction.

### REDIPO

Arena-Hard Score: 18.6. Result ID: 6a196dbbfbc373592c1480da.

[Reporting paper](<https://www.sota2.com/research/paper/6a191de0dbd7150506f82bbd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a191de0dbd7150506f82bbd.md>)

Recorded evaluation configuration: {"Model":"LLaMA-3.1-8B"}. This record does not assert independent reproduction.

### DPO

Arena-Hard Score: 18.3. Result ID: 6a196dbbfbc373592c1480d8.

[Reporting paper](<https://www.sota2.com/research/paper/6a191de0dbd7150506f82bbd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74511e209131cea6105d.md>)

Recorded evaluation configuration: {"Model":"LLaMA-3.1-8B"}. This record does not assert independent reproduction.

### DivPO

Arena-Hard Score: 18.1. Result ID: 6a196dbbfbc373592c1480d9.

[Reporting paper](<https://www.sota2.com/research/paper/6a191de0dbd7150506f82bbd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78bc1e209131cea7a1fa.md>)

Recorded evaluation configuration: {"Model":"LLaMA-3.1-8B"}. This record does not assert independent reproduction.

### Base

Arena-Hard Score: 14.6. Result ID: 6a196dbbfbc373592c1480d1.

[Reporting paper](<https://www.sota2.com/research/paper/6a191de0dbd7150506f82bbd.md>)

Recorded evaluation configuration: {"Model":"OLMo-3-7B"}. This record does not assert independent reproduction.

### Instruct

Arena-Hard Score: 14. Result ID: 6a196dbbfbc373592c1480d2.

[Reporting paper](<https://www.sota2.com/research/paper/6a191de0dbd7150506f82bbd.md>)

Recorded evaluation configuration: {"Model":"OLMo-3-7B"}. This record does not assert independent reproduction.

### DPO

Arena-Hard Score: 14. Result ID: 6a196dbbfbc373592c1480d3.

[Reporting paper](<https://www.sota2.com/research/paper/6a191de0dbd7150506f82bbd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74511e209131cea6105d.md>)

Recorded evaluation configuration: {"Model":"OLMo-3-7B"}. This record does not assert independent reproduction.

### REDIPO

Arena-Hard Score: 14. Result ID: 6a196dbbfbc373592c1480d5.

[Reporting paper](<https://www.sota2.com/research/paper/6a191de0dbd7150506f82bbd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a191de0dbd7150506f82bbd.md>)

Recorded evaluation configuration: {"Model":"OLMo-3-7B"}. This record does not assert independent reproduction.

### Base

Arena-Hard Score: 13.4. Result ID: 6a196dbbfbc373592c1480d6.

[Reporting paper](<https://www.sota2.com/research/paper/6a191de0dbd7150506f82bbd.md>)

Recorded evaluation configuration: {"Model":"LLaMA-3.1-8B"}. This record does not assert independent reproduction.

### DivPO

Arena-Hard Score: 12.8. Result ID: 6a196dbbfbc373592c1480d4.

[Reporting paper](<https://www.sota2.com/research/paper/6a191de0dbd7150506f82bbd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78bc1e209131cea7a1fa.md>)

Recorded evaluation configuration: {"Model":"OLMo-3-7B"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
