Dog Whistle Detection on FETCH! Balanced 1.0
14.81PrecisionBERT PREDICT
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| BERT PREDICTFiltering Model=RoBERTa R4, Keyword Extraction Model=KeyBERT, Threshold=50, Max n-grams=12024.12 | 14.81 | 1.65 | 5.7 | |
| FETCH LLM (EarShot)Filtering Model=LLaMa 13B, Keyword Extraction Model=KeyBERT, Threshold=100, Max n-grams=12024.12 | 11.43 | 1.65 | 5.22 | |
| DIRECT PipelineModel=LLaMa 13B2024.12 | 2.97 | 13.58 | 3.52 | |
| DIRECT PipelineModel=Mistral 7B2024.12 | 2.87 | 14.81 | 3.42 | |
| DIRECT PipelineModel=LLaMa 8B2024.12 | 2.35 | 21.4 | 2.86 |