# Hate Speech Classification on MHS

Source: [Hate Speech Classification on MHS](<https://www.sota2.com/research/sota/hate-speech-classification-on-mhs>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-27T09:52:18.314Z

Evaluation of Hate Speech Classification performance on the MHS dataset, measured using F1 score, Accuracy, Precision, and Recall.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Hate Speech Classification |
| Dataset (including any stated split) | MHS |
| Metric | F1 Score |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [F1 Score](<https://www.sota2.com/research/sota/hate-speech-classification-on-mhs.md?metric=F1%20Score>): Higher is better; unit: PERCENT.

- [Accuracy](<https://www.sota2.com/research/sota/hate-speech-classification-on-mhs.md?metric=Accuracy>): Higher is better; unit: PERCENT.

- [Precision](<https://www.sota2.com/research/sota/hate-speech-classification-on-mhs.md?metric=Precision>): Higher is better; unit: PERCENT.

- [Recall](<https://www.sota2.com/research/sota/hate-speech-classification-on-mhs.md?metric=Recall>): Higher is better; unit: PERCENT.

## Recorded results

| Method | F1 Score | Result date | Report paper |
| --- | --- | --- | --- |
| Zero-shot | 70.6 | Not recorded | 6a167acadbd7150506f801e1 |
| Definition | 69.64 | Not recorded | 6a167acadbd7150506f801e1 |
| Attr. aware | 69.45 | Not recorded | 6a167acadbd7150506f801e1 |
| Vanilla | 69.2 | Not recorded | 6a167acadbd7150506f801e1 |
| Persona | 68.95 | Not recorded | 6a167acadbd7150506f801e1 |
| Vanilla | 68.63 | Not recorded | 6a167acadbd7150506f801e1 |
| Persona | 67.63 | Not recorded | 6a167acadbd7150506f801e1 |
| Definition | 61.61 | Not recorded | 6a167acadbd7150506f801e1 |
| Few-shot | 60.63 | Not recorded | 6a167acadbd7150506f801e1 |
| Zero-shot | 60.3 | Not recorded | 6a167acadbd7150506f801e1 |
| Attr. aware | 60.3 | Not recorded | 6a167acadbd7150506f801e1 |
| Attr. value | 54.91 | Not recorded | 6a167acadbd7150506f801e1 |
| Attr. value | 50.71 | Not recorded | 6a167acadbd7150506f801e1 |
| Few-shot | 50.33 | Not recorded | 6a167acadbd7150506f801e1 |

### Zero-shot

F1 Score: 70.6. Result ID: 6a16bebffbc373592c105d29.

[Reporting paper](<https://www.sota2.com/research/paper/6a167acadbd7150506f801e1.md>)

Recorded evaluation configuration: {"Model":"Qwen-72B","Prompting Condition":"Zero-shot"}. This record does not assert independent reproduction.

### Definition

F1 Score: 69.64. Result ID: 6a16bebffbc373592c105d2b.

[Reporting paper](<https://www.sota2.com/research/paper/6a167acadbd7150506f801e1.md>)

Recorded evaluation configuration: {"Model":"Qwen-72B","Prompting Condition":"Definition"}. This record does not assert independent reproduction.

### Attr. aware

F1 Score: 69.45. Result ID: 6a16bebffbc373592c105d2c.

[Reporting paper](<https://www.sota2.com/research/paper/6a167acadbd7150506f801e1.md>)

Recorded evaluation configuration: {"Model":"Qwen-72B","Prompting Condition":"Attr. aware"}. This record does not assert independent reproduction.

### Vanilla

F1 Score: 69.2. Result ID: 6a16bebffbc373592c105d2e.

[Reporting paper](<https://www.sota2.com/research/paper/6a167acadbd7150506f801e1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a167acadbd7150506f801e1.md>)

Recorded evaluation configuration: {"Model":"Qwen-72B","Prompting Condition":"Vanilla"}. This record does not assert independent reproduction.

### Persona

F1 Score: 68.95. Result ID: 6a16bebffbc373592c105d28.

[Reporting paper](<https://www.sota2.com/research/paper/6a167acadbd7150506f801e1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a167acadbd7150506f801e1.md>)

Recorded evaluation configuration: {"Model":"Llama-70B","Prompting Condition":"Persona"}. This record does not assert independent reproduction.

### Vanilla

F1 Score: 68.63. Result ID: 6a16bebffbc373592c105d27.

[Reporting paper](<https://www.sota2.com/research/paper/6a167acadbd7150506f801e1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a167acadbd7150506f801e1.md>)

Recorded evaluation configuration: {"Model":"Llama-70B","Prompting Condition":"Vanilla"}. This record does not assert independent reproduction.

### Persona

F1 Score: 67.63. Result ID: 6a16bebffbc373592c105d2f.

[Reporting paper](<https://www.sota2.com/research/paper/6a167acadbd7150506f801e1.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a167acadbd7150506f801e1.md>)

Recorded evaluation configuration: {"Model":"Qwen-72B","Prompting Condition":"Persona"}. This record does not assert independent reproduction.

### Definition

F1 Score: 61.61. Result ID: 6a16bebffbc373592c105d24.

[Reporting paper](<https://www.sota2.com/research/paper/6a167acadbd7150506f801e1.md>)

Recorded evaluation configuration: {"Model":"Llama-70B","Prompting Condition":"Definition"}. This record does not assert independent reproduction.

### Few-shot

F1 Score: 60.63. Result ID: 6a16bebffbc373592c105d23.

[Reporting paper](<https://www.sota2.com/research/paper/6a167acadbd7150506f801e1.md>)

Recorded evaluation configuration: {"Model":"Llama-70B","Prompting Condition":"Few-shot"}. This record does not assert independent reproduction.

### Zero-shot

F1 Score: 60.3. Result ID: 6a16bebffbc373592c105d22.

[Reporting paper](<https://www.sota2.com/research/paper/6a167acadbd7150506f801e1.md>)

Recorded evaluation configuration: {"Model":"Llama-70B","Prompting Condition":"Zero-shot"}. This record does not assert independent reproduction.

### Attr. aware

F1 Score: 60.3. Result ID: 6a16bebffbc373592c105d25.

[Reporting paper](<https://www.sota2.com/research/paper/6a167acadbd7150506f801e1.md>)

Recorded evaluation configuration: {"Model":"Llama-70B","Prompting Condition":"Attr. aware"}. This record does not assert independent reproduction.

### Attr. value

F1 Score: 54.91. Result ID: 6a16bebffbc373592c105d26.

[Reporting paper](<https://www.sota2.com/research/paper/6a167acadbd7150506f801e1.md>)

Recorded evaluation configuration: {"Model":"Llama-70B","Prompting Condition":"Attr. value"}. This record does not assert independent reproduction.

### Attr. value

F1 Score: 50.71. Result ID: 6a16bebffbc373592c105d2d.

[Reporting paper](<https://www.sota2.com/research/paper/6a167acadbd7150506f801e1.md>)

Recorded evaluation configuration: {"Model":"Qwen-72B","Prompting Condition":"Attr. value"}. This record does not assert independent reproduction.

### Few-shot

F1 Score: 50.33. Result ID: 6a16bebffbc373592c105d2a.

[Reporting paper](<https://www.sota2.com/research/paper/6a167acadbd7150506f801e1.md>)

Recorded evaluation configuration: {"Model":"Qwen-72B","Prompting Condition":"Few-shot"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
