Binary violation prediction on ECHR Non-Anonymized (test)
0.904Macro PrecisionHIER-BERT
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| HIER-BERTarchitecture=hierarchical, input_length=full case descriptions2019.06 | 0.904 | 0.793 | 0.82 | |
| HANembeddings=GloVe (d=200)2019.06 | 0.882 | 0.78 | 0.805 | |
| BIGRU-ATTembeddings=GloVe (d=200)2019.06 | 0.871 | 0.772 | 0.795 | |
| BOW-SVMfeatures=TF-IDF weighted bag-of-words [1, 5]-grams2019.06 | 0.715 | 0.72 | 0.718 | |
| COIN-TOSSstrategy=random2019.06 | 0.504 | 0.505 | 0.491 | |
| MAJORITYstrategy=majority-class2019.06 | 0.329 | 0.5 | 0.397 | |
| BERTmax_length=512, truncation=true2019.06 | 0.24 | 0.5 | 0.17 |