Argument Component Detection & Classification on ElecDeb (test)
63Macro F1RooseBERT
Evaluation Results
| Method | Links | |
|---|---|---|
| RooseBERTCasing=cased, Pre-training Strategy=CONT2025.08 | 63 | |
| RooseBERTCasing=cased, Pre-training Strategy=SCR2025.08 | 63 | |
| RooseBERTCasing=uncased, Pre-training Strategy=SCR2025.08 | 63 | |
| RooseBERTCasing=cased, Pre-training Strategy=SCR2025.08 | 63 | |
| ConfliBERTCasing=cased, Pre-training Strategy=CONT2025.08 | 62 | |
| ConfliBERTCasing=uncased, Pre-training Strategy=CONT2025.08 | 62 | |
| ConfliBERTCasing=cased, Pre-training Strategy=SCR2025.08 | 62 | |
| ConfliBERTCasing=uncased, Pre-training Strategy=SCR2025.08 | 62 | |
| RooseBERTCasing=uncased, Pre-training Strategy=CONT2025.08 | 62 | |
| RooseBERTCasing=uncased, Pre-training Strategy=SCR2025.08 | 62 | |
| BERTCasing=cased, Pre-training Strategy=Standard2025.08 | 61 | |
| BERTCasing=uncased, Pre-training Strategy=Standard2025.08 | 61 | |
| ConfliBERTCasing=cased, Pre-training Strategy=CONT2025.08 | 61 | |
| ConfliBERTCasing=uncased, Pre-training Strategy=CONT2025.08 | 61 | |
| RooseBERTCasing=cased, Pre-training Strategy=CONT2025.08 | 61 | |
| RooseBERTCasing=uncased, Pre-training Strategy=CONT2025.08 | 61 | |
| PoliBERTweetCasing=cased, Pre-training Strategy=CONT2025.08 | 60 | |
| BERTCasing=cased, Pre-training Strategy=Standard2025.08 | 58 | |
| BERTCasing=uncased, Pre-training Strategy=Standard2025.08 | 58 | |
| ConfliBERTCasing=cased, Pre-training Strategy=SCR2025.08 | 58 | |
| PoliBERTweetCasing=cased, Pre-training Strategy=CONT2025.08 | 54 | |
| ConfliBERTCasing=uncased, Pre-training Strategy=SCR2025.08 | 35 | |
| gpt-4.1-nanoEvaluation Protocol=one-shot2025.08 | 28 | |
| gpt-4.1-nanoEvaluation Protocol=3-shot2025.08 | 26 | |
| Mistral-7B-Instruct-v0.3Evaluation Protocol=one-shot2025.08 | 22 | |
| Mistral-7B-Instruct-v0.3Evaluation Protocol=3-shot2025.08 | 22 | |
| Llama-3.1-8B-InstructEvaluation Protocol=3-shot2025.08 | 22 | |
| gemma-3-4b-itEvaluation Protocol=one-shot2025.08 | 21 | |
| gemma-3-4b-itEvaluation Protocol=3-shot2025.08 | 21 | |
| Llama-3.1-8B-InstructEvaluation Protocol=one-shot2025.08 | 16 | |
| gemma-3-4b-itEvaluation Protocol=fine-tuning2025.08 | 8 | |
| Mistral-7B-Instruct-v0.3Evaluation Protocol=fine-tuning2025.08 | 8 | |
| Llama-3.1-8B-InstructEvaluation Protocol=fine-tuning2025.08 | 8 |