# Reward-wise QA Fairness and Alignment on GLOBALQA

Source: [Reward-wise QA Fairness and Alignment on GLOBALQA](<https://www.sota2.com/research/sota/reward-wise-qa-fairness-and-alignment-on-globalqa>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-07T10:09:25.591Z

Evaluation of model performance on the GLOBALQA dataset focusing on reward-wise fairness and alignment, measured using Jensen-Shannon (JS), Wasserstein (Was.), and Cosine (Cos.) divergence metrics, alongside a Format Score.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Reward-wise QA fairness and alignment |
| Dataset (including any stated split) | GLOBALQA |
| Metric | FI JS Score |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 15 of 15 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [FI JS Score](<https://www.sota2.com/research/sota/reward-wise-qa-fairness-and-alignment-on-globalqa.md?metric=FI%20JS%20Score>): Higher is better; unit: SCALAR.

- [FI Wasserstein Score](<https://www.sota2.com/research/sota/reward-wise-qa-fairness-and-alignment-on-globalqa.md?metric=FI%20Wasserstein%20Score>): Higher is better; unit: SCALAR.

- [FI Cosine Score](<https://www.sota2.com/research/sota/reward-wise-qa-fairness-and-alignment-on-globalqa.md?metric=FI%20Cosine%20Score>): Higher is better; unit: SCALAR.

- [Avg AS JS Score](<https://www.sota2.com/research/sota/reward-wise-qa-fairness-and-alignment-on-globalqa.md?metric=Avg%20AS%20JS%20Score>): Higher is better; unit: SCALAR.

- [Avg AS Wasserstein Score](<https://www.sota2.com/research/sota/reward-wise-qa-fairness-and-alignment-on-globalqa.md?metric=Avg%20AS%20Wasserstein%20Score>): Higher is better; unit: SCALAR.

- [Avg AS Cosine Score](<https://www.sota2.com/research/sota/reward-wise-qa-fairness-and-alignment-on-globalqa.md?metric=Avg%20AS%20Cosine%20Score>): Higher is better; unit: SCALAR.

- [Min AS JS Score](<https://www.sota2.com/research/sota/reward-wise-qa-fairness-and-alignment-on-globalqa.md?metric=Min%20AS%20JS%20Score>): Higher is better; unit: SCALAR.

- [Min AS Wasserstein Score](<https://www.sota2.com/research/sota/reward-wise-qa-fairness-and-alignment-on-globalqa.md?metric=Min%20AS%20Wasserstein%20Score>): Higher is better; unit: SCALAR.

- [Min AS Cosine Score](<https://www.sota2.com/research/sota/reward-wise-qa-fairness-and-alignment-on-globalqa.md?metric=Min%20AS%20Cosine%20Score>): Higher is better; unit: SCALAR.

- [Format Score](<https://www.sota2.com/research/sota/reward-wise-qa-fairness-and-alignment-on-globalqa.md?metric=Format%20Score>): Higher is better; unit: SCALAR.

## Recorded results

| Method | FI JS Score | Result date | Report paper |
| --- | --- | --- | --- |
| APPA | 0.9996 | Not recorded | 69d48fdd7d0172140ec746fd |
| PPO/JS | 0.9995 | Not recorded | 69d48fdd7d0172140ec746fd |
| APPA | 0.9995 | Not recorded | 69d48fdd7d0172140ec746fd |
| APPA | 0.9994 | Not recorded | 69d48fdd7d0172140ec746fd |
| PPO/JS | 0.9994 | Not recorded | 69d48fdd7d0172140ec746fd |
| PPO/JS | 0.9993 | Not recorded | 69d48fdd7d0172140ec746fd |
| PPO/JS | 0.9695 | Not recorded | 69d48fdd7d0172140ec746fd |
| PPO/JS | 0.9694 | Not recorded | 69d48fdd7d0172140ec746fd |
| PPO/JS | 0.9693 | Not recorded | 69d48fdd7d0172140ec746fd |
| SFT | 0.9399 | Not recorded | 69d48fdd7d0172140ec746fd |
| SFT | 0.9394 | Not recorded | 69d48fdd7d0172140ec746fd |
| BASE | 0.9392 | Not recorded | 69d48fdd7d0172140ec746fd |
| SFT | 0.9391 | Not recorded | 69d48fdd7d0172140ec746fd |
| BASE | 0.9389 | Not recorded | 69d48fdd7d0172140ec746fd |
| BASE | 0.9389 | Not recorded | 69d48fdd7d0172140ec746fd |

### APPA

FI JS Score: 0.9996. Result ID: 69d4d7d247f34ce924bd2bf2.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fdd7d0172140ec746fd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48fdd7d0172140ec746fd.md>)

Recorded evaluation configuration: {"Model":"Qwen3-0.6B-Instruct"}. This record does not assert independent reproduction.

### PPO/JS

FI JS Score: 0.9995. Result ID: 69d4d7d247f34ce924bd2be6.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fdd7d0172140ec746fd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63a01e209131ce9ffdaa.md>)

Recorded evaluation configuration: {"Model":"gemma-2-2b","Server Agg.":"MIN"}. This record does not assert independent reproduction.

### APPA

FI JS Score: 0.9995. Result ID: 69d4d7d247f34ce924bd2bed.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fdd7d0172140ec746fd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48fdd7d0172140ec746fd.md>)

Recorded evaluation configuration: {"Model":"llama-3.2-3b"}. This record does not assert independent reproduction.

### APPA

FI JS Score: 0.9994. Result ID: 69d4d7d247f34ce924bd2be8.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fdd7d0172140ec746fd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48fdd7d0172140ec746fd.md>)

Recorded evaluation configuration: {"Model":"gemma-2-2b"}. This record does not assert independent reproduction.

### PPO/JS

FI JS Score: 0.9994. Result ID: 69d4d7d247f34ce924bd2beb.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fdd7d0172140ec746fd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63a01e209131ce9ffdaa.md>)

Recorded evaluation configuration: {"Model":"llama-3.2-3b","Server Agg.":"MIN"}. This record does not assert independent reproduction.

### PPO/JS

FI JS Score: 0.9993. Result ID: 69d4d7d247f34ce924bd2bf0.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fdd7d0172140ec746fd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63a01e209131ce9ffdaa.md>)

Recorded evaluation configuration: {"Model":"Qwen3-0.6B-Instruct","Server Agg.":"MIN"}. This record does not assert independent reproduction.

### PPO/JS

FI JS Score: 0.9695. Result ID: 69d4d7d247f34ce924bd2be7.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fdd7d0172140ec746fd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63a01e209131ce9ffdaa.md>)

Recorded evaluation configuration: {"Model":"gemma-2-2b","Server Agg.":"AVERAGE"}. This record does not assert independent reproduction.

### PPO/JS

FI JS Score: 0.9694. Result ID: 69d4d7d247f34ce924bd2bec.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fdd7d0172140ec746fd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63a01e209131ce9ffdaa.md>)

Recorded evaluation configuration: {"Model":"llama-3.2-3b","Server Agg.":"AVERAGE"}. This record does not assert independent reproduction.

### PPO/JS

FI JS Score: 0.9693. Result ID: 69d4d7d247f34ce924bd2bf1.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fdd7d0172140ec746fd.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa63a01e209131ce9ffdaa.md>)

Recorded evaluation configuration: {"Model":"Qwen3-0.6B-Instruct","Server Agg.":"AVERAGE"}. This record does not assert independent reproduction.

### SFT

FI JS Score: 0.9399. Result ID: 69d4d7d247f34ce924bd2be5.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fdd7d0172140ec746fd.md>)

Recorded evaluation configuration: {"Model":"gemma-2-2b"}. This record does not assert independent reproduction.

### SFT

FI JS Score: 0.9394. Result ID: 69d4d7d247f34ce924bd2bef.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fdd7d0172140ec746fd.md>)

Recorded evaluation configuration: {"Model":"Qwen3-0.6B-Instruct"}. This record does not assert independent reproduction.

### BASE

FI JS Score: 0.9392. Result ID: 69d4d7d247f34ce924bd2bee.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fdd7d0172140ec746fd.md>)

Recorded evaluation configuration: {"Model":"Qwen3-0.6B-Instruct"}. This record does not assert independent reproduction.

### SFT

FI JS Score: 0.9391. Result ID: 69d4d7d247f34ce924bd2bea.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fdd7d0172140ec746fd.md>)

Recorded evaluation configuration: {"Model":"llama-3.2-3b"}. This record does not assert independent reproduction.

### BASE

FI JS Score: 0.9389. Result ID: 69d4d7d247f34ce924bd2be4.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fdd7d0172140ec746fd.md>)

Recorded evaluation configuration: {"Model":"gemma-2-2b"}. This record does not assert independent reproduction.

### BASE

FI JS Score: 0.9389. Result ID: 69d4d7d247f34ce924bd2be9.

[Reporting paper](<https://www.sota2.com/research/paper/69d48fdd7d0172140ec746fd.md>)

Recorded evaluation configuration: {"Model":"llama-3.2-3b"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
