Incomplete Utterance Rewriting on REWRITE (test)
66.4EMRUN + BERT
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| RUN + BERTArchitecture=Rewritten U-shaped Network, Pre-trained Model=BERT2020.09 | 66.4 | 91.4 | 86.2 | 90.4 | 93.5 | |
| T-Ptr-X + BERTBackbone=Transformer, Pre-trained Model=BERT2020.09 | 57.5 | 86.5 | 79.9 | 86.9 | 90.5 | |
| RUNArchitecture=Rewritten U-shaped Network2020.09 | 53.8 | 86.1 | 79.4 | 85.1 | 89.5 | |
| T-Ptr-GenBackbone=Transformer, Mechanism=Pointer-Generator2020.09 | 53.1 | 84.4 | 77.6 | 85 | 89.1 | |
| T-Ptr-NetBackbone=Transformer, Mechanism=Pointer Network2020.09 | 53 | 83.9 | 77.1 | 85.1 | 88.7 | |
| T-Ptr-XBackbone=Transformer2020.09 | 52.6 | 85.6 | 78.1 | 85 | 89 | |
| L-Ptr-NetBackbone=LSTM, Mechanism=Pointer Network2020.09 | 51.5 | 82.7 | 75.5 | 84 | 88.2 | |
| L-Ptr-GenBackbone=LSTM, Mechanism=Pointer-Generator2020.09 | 50.5 | 82.9 | 75.4 | 83.8 | 87.8 | |
| L-GenBackbone=LSTM2020.09 | 47.3 | 81.2 | 73.6 | 80.9 | 86.3 | |
| L-Ptr-XBackbone=LSTM2020.09 | 42.3 | 82.9 | 73.8 | 81.1 | 84.1 | |
| T-GenBackbone=Transformer2020.09 | 35.4 | 72.7 | 62.5 | 74.5 | 82.9 |