# UoT-UWF-PartAI at SemEval-2021 Task 5: Self Attention Based Bi-GRU with Multi-Embedding Representation for Toxicity Highlighter

Source: [UoT-UWF-PartAI at SemEval-2021 Task 5: Self Attention Based Bi-GRU with Multi-Embedding Representation for Toxicity Highlighter](<https://www.sota2.com/research/paper/68fa69d61e209131cea247ea>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-25T23:10:38.141Z

Authors: Hamed Babaei Giglou, Taher Rahgooy, Mostafa Rahgouy, Jafar Razmara

Published: 2021-04-27T13:18:28.000Z

## Abstract

Toxic Spans Detection(TSD) task is defined as highlighting spans that make a text toxic. Many works have been done to classify a given comment or document as toxic or non-toxic. However, none of those proposed models work at the token level. In this paper, we propose a self-attention-based bidirectional gated recurrent unit(BiGRU) with a multi-embedding representation of the tokens. Our proposed model enriches the representation by a combination of GPT-2, GloVe, and RoBERTa embeddings, which led to promising results. Experimental results show that our proposed approach is very effective in detecting span tokens.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Toxicity Classification on Jigsaw (test)](<https://www.sota2.com/research/sota/toxicity-classification-on-jigsaw-test.md>): Toxicity Classification; Jigsaw (test); Accuracy: 94.4.

- [Toxic Comment Classification on Jigsaw Toxic Comment Classification](<https://www.sota2.com/research/sota/toxic-comment-classification-on-jigsaw-toxic-comment-classification.md>): Toxic Comment Classification; Jigsaw Toxic Comment Classification; Accuracy: 94.37.

- [Toxicity Classification on Toxicity Dataset (test)](<https://www.sota2.com/research/sota/toxicity-classification-on-toxicity-dataset-test.md>): Toxicity Classification; Toxicity Dataset (test); Test Accuracy: 94.37.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2104.13164>)

[PDF](<https://arxiv.org/pdf/2104.13164.pdf>)
