# Preference Learning on Simulated Matchmaking Environment (p\_flip=0.2, T=6,400)

Source: [Preference Learning on Simulated Matchmaking Environment (p\_flip=0.2, T=6,400)](<https://www.sota2.com/research/sota/preference-learning-on-simulated-matchmaking-environment-p_flip-0-2-t-6-400>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-14T07:43:56.633Z

Evaluation of Preference Learning performance within a custom Simulated Matchmaking Environment, configured with row-norm sampling, a flip probability (p\_flip) of 0.2, and a total size (T) of 6,400. Evaluated using Like rate, Align@20, and Δs.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Preference Learning |
| Dataset (including any stated split) | Simulated Matchmaking Environment row-norm sampling, p\_flip=0.2, T=6,400 |
| Metric | Like Rate |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 6 of 6 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Like Rate](<https://www.sota2.com/research/sota/preference-learning-on-simulated-matchmaking-environment-p_flip-0-2-t-6-400.md?metric=Like%20Rate>): Higher is better; unit: PERCENT.

- [Align@20](<https://www.sota2.com/research/sota/preference-learning-on-simulated-matchmaking-environment-p_flip-0-2-t-6-400.md?metric=Align%4020>): Higher is better; unit: PERCENT.

- [Delta S (Δs)](<https://www.sota2.com/research/sota/preference-learning-on-simulated-matchmaking-environment-p_flip-0-2-t-6-400.md?metric=Delta%20S%20(%CE%94s)>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Like Rate | Result date | Report paper |
| --- | --- | --- | --- |
| TK | 80 | Not recorded | 69ddc9e97d0172140ec7981d |
| Block-TK | 80 | Not recorded | 69ddc9e97d0172140ec7981d |
| Block-NK | 80 | Not recorded | 69ddc9e97d0172140ec7981d |
| NK | 80 | Not recorded | 69ddc9e97d0172140ec7981d |
| K-NoNorm | 80 | Not recorded | 69ddc9e97d0172140ec7981d |
| OGD-0.1 | 80 | Not recorded | 69ddc9e97d0172140ec7981d |

### TK

Like Rate: 80. Result ID: 69ddf02147f34ce924c51679.

[Reporting paper](<https://www.sota2.com/research/paper/69ddc9e97d0172140ec7981d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69ddc9e97d0172140ec7981d.md>)

Recorded evaluation configuration: {"α":"1"}. This record does not assert independent reproduction.

### Block-TK

Like Rate: 80. Result ID: 69ddf02147f34ce924c5167a.

[Reporting paper](<https://www.sota2.com/research/paper/69ddc9e97d0172140ec7981d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69ddc9e97d0172140ec7981d.md>)

Recorded evaluation configuration: {"α":"1"}. This record does not assert independent reproduction.

### Block-NK

Like Rate: 80. Result ID: 69ddf02147f34ce924c5167b.

[Reporting paper](<https://www.sota2.com/research/paper/69ddc9e97d0172140ec7981d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69ddc9e97d0172140ec7981d.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### NK

Like Rate: 80. Result ID: 69ddf02147f34ce924c5167c.

[Reporting paper](<https://www.sota2.com/research/paper/69ddc9e97d0172140ec7981d.md>)

Recorded evaluation configuration: {"η":"0.5"}. This record does not assert independent reproduction.

### K-NoNorm

Like Rate: 80. Result ID: 69ddf02147f34ce924c5167d.

[Reporting paper](<https://www.sota2.com/research/paper/69ddc9e97d0172140ec7981d.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### OGD-0.1

Like Rate: 80. Result ID: 69ddf02147f34ce924c5167e.

[Reporting paper](<https://www.sota2.com/research/paper/69ddc9e97d0172140ec7981d.md>)

Recorded evaluation configuration: {"parameter":"0.1"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
