# Performance Prediction on Chatino to Spanish

Source: [Performance Prediction on Chatino to Spanish](<https://www.sota2.com/research/sota/performance-prediction-on-chatino-to-spanish>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:49:04.801Z

Evaluation of model performance prediction capabilities using the Chatino to Spanish dataset, measured by MAE and Kendall correlation.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Performance Prediction |
| Dataset (including any stated split) | Chatino to Spanish |
| Metric | MAE |
| Unit | SCALAR |
| Direction | Lower is better |
| Results loaded | 4 of 4 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [MAE](<https://www.sota2.com/research/sota/performance-prediction-on-chatino-to-spanish.md?metric=MAE>): Lower is better; unit: SCALAR.

- [Kendall Correlation](<https://www.sota2.com/research/sota/performance-prediction-on-chatino-to-spanish.md?metric=Kendall%20Correlation>): Higher is better; unit: SCALAR.

## Recorded results

| Method | MAE | Result date | Report paper |
| --- | --- | --- | --- |
| Neuron-wise MoS | 0.01 | Not recorded | 68fa74611e209131cea61572 |
| LLM-PP | 0.01 | Not recorded | 68fa74611e209131cea61572 |
| HAT | 0.02 | Not recorded | 68fa74611e209131cea61572 |
| Layer-wise MoS | 0.02 | Not recorded | 68fa74611e209131cea61572 |

### Neuron-wise MoS

MAE: 0.01. Result ID: 699351c73a6c314849152647.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74611e209131cea61572.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74611e209131cea61560.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### LLM-PP

MAE: 0.01. Result ID: 699351c73a6c314849152648.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74611e209131cea61572.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74611e209131cea61572.md>)

Recorded evaluation configuration: {"Model":"GPT-4"}. This record does not assert independent reproduction.

### HAT

MAE: 0.02. Result ID: 699351c73a6c314849152645.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74611e209131cea61572.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72d31e209131cea58c0e.md>)

[Implementation](<https://github.com/mit-han-lab/hardware-aware-transformers.git>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Layer-wise MoS

MAE: 0.02. Result ID: 699351c73a6c314849152646.

[Reporting paper](<https://www.sota2.com/research/paper/68fa74611e209131cea61572.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa74611e209131cea61560.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
