Error Detection on TtTSet 5662 samples (test)
55.6AccuracyTtT
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| TtTtrain_set=270k-size HybirdSet, scenario=VarLen2021.06 | 55.6 | 89.8 | 50.4 | 64.6 | |
| GPT2-finetunebeam-size=5, train_set=270k-size HybirdSet, scenario=VarLen2021.06 | 51.3 | 85.2 | 47.9 | 61.3 | |
| BERT-finetunetrain_set=270k-size HybirdSet, scenario=VarLen2021.06 | 46.8 | 89 | 38.9 | 54.1 | |
| Transformer-s2sbeam-size=5, train_set=270k-size HybirdSet, scenario=VarLen2021.06 | 25.6 | 65.6 | 16.1 | 25.9 |