# Thematic fit estimation on Fer-Ins (test)

Source: [Thematic fit estimation on Fer-Ins (test)](<https://www.sota2.com/research/sota/thematic-fit-estimation-on-fer-ins-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T06:04:37.468Z

Evaluation of model performance on estimating thematic fit using the test split of the Fer-Ins dataset, measured by Spearman rank correlation.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Thematic fit estimation |
| Dataset (including any stated split) | Fer-Ins (test) |
| Metric | Spearman Rho |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Spearman Rho](<https://www.sota2.com/research/sota/thematic-fit-estimation-on-fer-ins-test.md?metric=Spearman%20Rho>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Spearman Rho | Result date | Report paper |
| --- | --- | --- | --- |
| ResRoFA-MT | 0.48 | Not recorded | 68fa75551e209131cea67400 |
| NN RF | 0.45 | Not recorded | 68fa75551e209131cea67400 |
| Glove-shared tuned with 20%M | 0.43 | Not recorded | 68fa75551e209131cea67400 |
| GSD2015 | 0.42 | Not recorded | 68fa75551e209131cea67400 |
| Glove-shared not-tuned | 0.34 | Not recorded | 68fa75551e209131cea67400 |
| Exp.1.1 | 0.33 | Not recorded | 68fa75551e209131cea67400 |
| Exp.2.1 | 0.33 | Not recorded | 68fa75551e209131cea67400 |
| Glove-shared tuned | 0.29 | Not recorded | 68fa75551e209131cea67400 |
| Exp.3.1 | 0.29 | Not recorded | 68fa75551e209131cea67400 |
| Exp.4.1 | 0.28 | Not recorded | 68fa75551e209131cea67400 |
| Exp.3.2 | 0.24 | Not recorded | 68fa75551e209131cea67400 |
| Exp.4.2 | 0.24 | Not recorded | 68fa75551e209131cea67400 |
| Exp.1.2 | 0.23 | Not recorded | 68fa75551e209131cea67400 |
| Exp.2.2 | 0.22 | Not recorded | 68fa75551e209131cea67400 |

### ResRoFA-MT

Spearman Rho: 0.48. Result ID: 699e13cc5698665ec4cc1410.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75551e209131cea67400.md>)

Recorded evaluation configuration: {"Backbone":"Llama","Category":"Baseline"}. This record does not assert independent reproduction.

### NN RF

Spearman Rho: 0.45. Result ID: 699e13cc5698665ec4cc140f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75551e209131cea67400.md>)

Recorded evaluation configuration: {"Backbone":"Llama","Category":"Baseline"}. This record does not assert independent reproduction.

### Glove-shared tuned with 20%M

Spearman Rho: 0.43. Result ID: 699e13cc5698665ec4cc1413.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75551e209131cea67400.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6db71e209131cea3b7c4.md>)

Recorded evaluation configuration: {"Backbone":"Llama","Category":"Baseline"}. This record does not assert independent reproduction.

### GSD2015

Spearman Rho: 0.42. Result ID: 699e13cc5698665ec4cc140e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75551e209131cea67400.md>)

Recorded evaluation configuration: {"Backbone":"Llama","Category":"Baseline"}. This record does not assert independent reproduction.

### Glove-shared not-tuned

Spearman Rho: 0.34. Result ID: 699e13cc5698665ec4cc1411.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75551e209131cea67400.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6db71e209131cea3b7c4.md>)

Recorded evaluation configuration: {"Backbone":"Llama","Category":"Baseline"}. This record does not assert independent reproduction.

### Exp.1.1

Spearman Rho: 0.33. Result ID: 699e13cc5698665ec4cc1414.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75551e209131cea67400.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75551e209131cea67400.md>)

Recorded evaluation configuration: {"Backbone":"Llama"}. This record does not assert independent reproduction.

### Exp.2.1

Spearman Rho: 0.33. Result ID: 699e13cc5698665ec4cc1416.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75551e209131cea67400.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75551e209131cea67400.md>)

Recorded evaluation configuration: {"Backbone":"Llama"}. This record does not assert independent reproduction.

### Glove-shared tuned

Spearman Rho: 0.29. Result ID: 699e13cc5698665ec4cc1412.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75551e209131cea67400.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6db71e209131cea3b7c4.md>)

Recorded evaluation configuration: {"Backbone":"Llama","Category":"Baseline"}. This record does not assert independent reproduction.

### Exp.3.1

Spearman Rho: 0.29. Result ID: 699e13cc5698665ec4cc1418.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75551e209131cea67400.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75551e209131cea67400.md>)

Recorded evaluation configuration: {"Backbone":"Llama"}. This record does not assert independent reproduction.

### Exp.4.1

Spearman Rho: 0.28. Result ID: 699e13cc5698665ec4cc141a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75551e209131cea67400.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75551e209131cea67400.md>)

Recorded evaluation configuration: {"Backbone":"Llama"}. This record does not assert independent reproduction.

### Exp.3.2

Spearman Rho: 0.24. Result ID: 699e13cc5698665ec4cc1419.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75551e209131cea67400.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75551e209131cea67400.md>)

Recorded evaluation configuration: {"Backbone":"Llama"}. This record does not assert independent reproduction.

### Exp.4.2

Spearman Rho: 0.24. Result ID: 699e13cc5698665ec4cc141b.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75551e209131cea67400.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75551e209131cea67400.md>)

Recorded evaluation configuration: {"Backbone":"Llama"}. This record does not assert independent reproduction.

### Exp.1.2

Spearman Rho: 0.23. Result ID: 699e13cc5698665ec4cc1415.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75551e209131cea67400.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75551e209131cea67400.md>)

Recorded evaluation configuration: {"Backbone":"Llama"}. This record does not assert independent reproduction.

### Exp.2.2

Spearman Rho: 0.22. Result ID: 699e13cc5698665ec4cc1417.

[Reporting paper](<https://www.sota2.com/research/paper/68fa75551e209131cea67400.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75551e209131cea67400.md>)

Recorded evaluation configuration: {"Backbone":"Llama"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
