Slot Filling and Intent Detection on PROSLU (test)
84.38Slot F1ELECTRA
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| ELECTRAModel Category=Pre-trained-based, Profile=w/ Profile (using Multi-level Knowledge Adapter)2021.12 | 84.38 | 86.63 | 82.3 | |
| XLNetModel Category=Pre-trained-based, Profile=w/ Profile (using Multi-level Knowledge Adapter)2021.12 | 83.39 | 85.88 | 81.73 | |
| General SLU ModelModel Category=Non Pre-trained, Profile=w/ Profile (using Multi-level Knowledge Adapter)2021.12 | 83.27 | 85.31 | 79.1 | |
| RoBERTaModel Category=Pre-trained-based, Profile=w/ Profile (using Multi-level Knowledge Adapter)2021.12 | 82.9 | 85.31 | 81.17 | |
| BERTModel Category=Pre-trained-based, Profile=w/ Profile (using Multi-level Knowledge Adapter)2021.12 | 82.51 | 84.56 | 80.98 | |
| Stack-PropagationModel Category=Non Pre-trained, Profile=w/ Profile (using Multi-level Knowledge Adapter)2021.12 | 81.08 | 83.99 | 78.91 | |
| Bi-ModelModel Category=Non Pre-trained, Profile=w/ Profile (using Multi-level Knowledge Adapter)2021.12 | 77.76 | 82.3 | 73.45 | |
| Slot-GatedModel Category=Non Pre-trained, Profile=w/ Profile (using Multi-level Knowledge Adapter)2021.12 | 74.18 | 83.24 | 69.11 | |
| SF-IDModel Category=Non Pre-trained, Profile=w/ Profile (using Multi-level Knowledge Adapter)2021.12 | 73.7 | 83.24 | 68.36 | |
| XLNetModel Category=Pre-trained-based, Profile=w/o Profile2021.12 | 46.92 | 48.59 | 43.88 | |
| ELECTRAModel Category=Pre-trained-based, Profile=w/o Profile2021.12 | 46.48 | 47.46 | 42.56 | |
| RoBERTaModel Category=Pre-trained-based, Profile=w/o Profile2021.12 | 45.92 | 47.83 | 43.13 | |
| BERTModel Category=Pre-trained-based, Profile=w/o Profile2021.12 | 44.8 | 45.76 | 42.18 | |
| General SLU ModelModel Category=Non Pre-trained, Profile=w/o Profile2021.12 | 42.24 | 43.13 | 37.85 | |
| SF-IDModel Category=Non Pre-trained, Profile=w/o Profile2021.12 | 39.63 | 42.37 | 30.89 | |
| Stack-PropagationModel Category=Non Pre-trained, Profile=w/o Profile2021.12 | 39.29 | 39.74 | 36.35 | |
| Bi-ModelModel Category=Non Pre-trained, Profile=w/o Profile2021.12 | 37.37 | 44.63 | 32.58 | |
| Slot-GatedModel Category=Non Pre-trained, Profile=w/o Profile2021.12 | 36.53 | 41.24 | 32.02 |