Question Answering on FriendsQA (test)
58.7EMEnhanced Speaker-aware Model
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Enhanced Speaker-aware ModelBackbone=ELECTRA2021.09 | 58.7 | 75.4 | |
| Speaker EmbeddingBackbone=ELECTRA2021.09 | 57.8 | 75.2 | |
| MDFNBackbone=ELECTRA2021.09 | 57.8 | 75.2 | |
| QuISGBackbone=ELECTRA2022.10 | 57.79 | 75.22 | |
| Public BaselinesBackbone=ELECTRA2021.09 | 56.8 | 74 | |
| Our BaselinesBackbone=ELECTRA2021.09 | 56.7 | 74 | |
| SelfSuperBackbone=ELECTRA2022.10 | 55.8 | 72.3 | |
| Our Reimpl. ELECTRABackbone=ELECTRA2022.10 | 54.62 | 71.29 | |
| Enhanced Speaker-aware ModelBackbone=BERTwwm2021.09 | 52.1 | 68 | |
| MDFNBackbone=BERTwwm2021.09 | 50.4 | 66.2 | |
| Our BaselinesBackbone=BERTwwm2021.09 | 50.1 | 66.2 | |
| Speaker EmbeddingBackbone=BERTwwm2021.09 | 49.2 | 65.9 | |
| Enhanced Speaker-aware ModelBackbone=BERTlarge2021.09 | 49 | 64 | |
| MDFNBackbone=BERTlarge2021.09 | 48 | 63 | |
| Our BaselinesBackbone=BERTlarge2021.09 | 47.3 | 63.3 | |
| Enhanced Speaker-aware ModelBackbone=BERTbase2021.09 | 47 | 63 | |
| SelfSuperBERTBackbone=BERT2022.10 | 46.9 | 63.9 | |
| ULM+UOPBackbone=BERT2022.10 | 46.8 | 63.1 | |
| Speaker EmbeddingBackbone=BERTlarge2021.09 | 46.8 | 63.3 | |
| KnowledgeGraphBackbone=BERT2022.10 | 46.4 | 64.3 | |
| MDFNBackbone=BERTbase2021.09 | 46.1 | 62.9 | |
| Our BaselinesBackbone=BERTbase2021.09 | 45.6 | 61 | |
| Public BaselinesBackbone=BERTbase2021.09 | 45.2 | — | |
| Speaker EmbeddingBackbone=BERTbase2021.09 | 45 | 61.6 |