# Helpfulness evaluation on LINGUASAFE

Source: [Helpfulness evaluation on LINGUASAFE](<https://www.sota2.com/research/sota/helpfulness-evaluation-on-linguasafe>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-16T08:27:21.255Z

Evaluation of model helpfulness performance using the LINGUASAFE dataset, measured by Win%, Lose%, and Delta (∆) metrics.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Helpfulness evaluation |
| Dataset (including any stated split) | LINGUASAFE |
| Metric | Win Rate |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Win Rate](<https://www.sota2.com/research/sota/helpfulness-evaluation-on-linguasafe.md?metric=Win%20Rate>): Higher is better; unit: PERCENT.

- [Lose Rate](<https://www.sota2.com/research/sota/helpfulness-evaluation-on-linguasafe.md?metric=Lose%20Rate>): Lower is better; unit: PERCENT.

- [Delta (Win-Lose)](<https://www.sota2.com/research/sota/helpfulness-evaluation-on-linguasafe.md?metric=Delta%20(Win-Lose)>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Win Rate | Result date | Report paper |
| --- | --- | --- | --- |
| SHARD | 73.3 | Not recorded | 6a30d8cdd33dfb23e783ceaf |
| SHARD | 64.2 | Not recorded | 6a30d8cdd33dfb23e783ceaf |
| SHARD | 60.8 | Not recorded | 6a30d8cdd33dfb23e783ceaf |
| Benign Intent | 51.5 | Not recorded | 6a30d8cdd33dfb23e783ceaf |
| SHARD | 46.2 | Not recorded | 6a30d8cdd33dfb23e783ceaf |
| SHARD | 44.5 | Not recorded | 6a30d8cdd33dfb23e783ceaf |
| Benign Intent | 44.4 | Not recorded | 6a30d8cdd33dfb23e783ceaf |
| SHARD | 41 | Not recorded | 6a30d8cdd33dfb23e783ceaf |
| Benign Intent | 39.7 | Not recorded | 6a30d8cdd33dfb23e783ceaf |
| Benign Intent | 39.6 | Not recorded | 6a30d8cdd33dfb23e783ceaf |
| Benign Intent | 36.1 | Not recorded | 6a30d8cdd33dfb23e783ceaf |
| Benign Intent | 33.5 | Not recorded | 6a30d8cdd33dfb23e783ceaf |
| Benign Intent | 33.2 | Not recorded | 6a30d8cdd33dfb23e783ceaf |
| SHARD | 18 | Not recorded | 6a30d8cdd33dfb23e783ceaf |

### SHARD

Win Rate: 73.3. Result ID: 6a3108d7fbc373592c2d4222.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d8cdd33dfb23e783ceaf.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a30d8cdd33dfb23e783ceaf.md>)

Recorded evaluation configuration: {"Reframing condition":"SHARD","Backbone":"Qwen3.5 27B"}. This record does not assert independent reproduction.

### SHARD

Win Rate: 64.2. Result ID: 6a3108d7fbc373592c2d4224.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d8cdd33dfb23e783ceaf.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a30d8cdd33dfb23e783ceaf.md>)

Recorded evaluation configuration: {"Reframing condition":"SHARD","Backbone":"Qwen3.5 9B"}. This record does not assert independent reproduction.

### SHARD

Win Rate: 60.8. Result ID: 6a3108d7fbc373592c2d421a.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d8cdd33dfb23e783ceaf.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a30d8cdd33dfb23e783ceaf.md>)

Recorded evaluation configuration: {"Reframing condition":"SHARD","Backbone":"Llama 3.1 8B"}. This record does not assert independent reproduction.

### Benign Intent

Win Rate: 51.5. Result ID: 6a3108d7fbc373592c2d4221.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d8cdd33dfb23e783ceaf.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bb01e209131cea89e31.md>)

Recorded evaluation configuration: {"Reframing condition":"Benign Intent","Backbone":"Phi-4"}. This record does not assert independent reproduction.

### SHARD

Win Rate: 46.2. Result ID: 6a3108d7fbc373592c2d4220.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d8cdd33dfb23e783ceaf.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a30d8cdd33dfb23e783ceaf.md>)

Recorded evaluation configuration: {"Reframing condition":"SHARD","Backbone":"Phi-4"}. This record does not assert independent reproduction.

### SHARD

Win Rate: 44.5. Result ID: 6a3108d7fbc373592c2d4218.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d8cdd33dfb23e783ceaf.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a30d8cdd33dfb23e783ceaf.md>)

Recorded evaluation configuration: {"Reframing condition":"SHARD","Backbone":"Llama 3.3 70B"}. This record does not assert independent reproduction.

### Benign Intent

Win Rate: 44.4. Result ID: 6a3108d7fbc373592c2d4223.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d8cdd33dfb23e783ceaf.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bb01e209131cea89e31.md>)

Recorded evaluation configuration: {"Reframing condition":"Benign Intent","Backbone":"Qwen3.5 27B"}. This record does not assert independent reproduction.

### SHARD

Win Rate: 41. Result ID: 6a3108d7fbc373592c2d421c.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d8cdd33dfb23e783ceaf.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a30d8cdd33dfb23e783ceaf.md>)

Recorded evaluation configuration: {"Reframing condition":"SHARD","Backbone":"Mistral 24B"}. This record does not assert independent reproduction.

### Benign Intent

Win Rate: 39.7. Result ID: 6a3108d7fbc373592c2d4225.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d8cdd33dfb23e783ceaf.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bb01e209131cea89e31.md>)

Recorded evaluation configuration: {"Reframing condition":"Benign Intent","Backbone":"Qwen3.5 9B"}. This record does not assert independent reproduction.

### Benign Intent

Win Rate: 39.6. Result ID: 6a3108d7fbc373592c2d4219.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d8cdd33dfb23e783ceaf.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bb01e209131cea89e31.md>)

Recorded evaluation configuration: {"Reframing condition":"Benign Intent","Backbone":"Llama 3.3 70B"}. This record does not assert independent reproduction.

### Benign Intent

Win Rate: 36.1. Result ID: 6a3108d7fbc373592c2d421b.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d8cdd33dfb23e783ceaf.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bb01e209131cea89e31.md>)

Recorded evaluation configuration: {"Reframing condition":"Benign Intent","Backbone":"Llama 3.1 8B"}. This record does not assert independent reproduction.

### Benign Intent

Win Rate: 33.5. Result ID: 6a3108d7fbc373592c2d421f.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d8cdd33dfb23e783ceaf.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bb01e209131cea89e31.md>)

Recorded evaluation configuration: {"Reframing condition":"Benign Intent","Backbone":"Mistral 7B"}. This record does not assert independent reproduction.

### Benign Intent

Win Rate: 33.2. Result ID: 6a3108d7fbc373592c2d421d.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d8cdd33dfb23e783ceaf.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bb01e209131cea89e31.md>)

Recorded evaluation configuration: {"Reframing condition":"Benign Intent","Backbone":"Mistral 24B"}. This record does not assert independent reproduction.

### SHARD

Win Rate: 18. Result ID: 6a3108d7fbc373592c2d421e.

[Reporting paper](<https://www.sota2.com/research/paper/6a30d8cdd33dfb23e783ceaf.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a30d8cdd33dfb23e783ceaf.md>)

Recorded evaluation configuration: {"Reframing condition":"SHARD","Backbone":"Mistral 7B"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
