Question Answering on WebSRC (dev)
81.66EMTIE-Large
Evaluation results
| Method | Links | ||
|---|---|---|---|
| TIE-LargeSize=Large2023.07 | 81.66 | 86.24 | |
| AXEModalities=Text + HTML, Model Scale=Large2026.02 | 80.06 | 86.95 | |
| WebLMModalities=Text + HTML + Image, Model Scale=Large2026.02 | 78.4 | 84.24 | |
| WebAgent (oracle)Snippet Source=Oracle2023.07 | 76.91 | 86.64 | |
| WebAgentSnippet Source=Predicted by finetuned HTML-T52023.07 | 75.5 | 85.75 | |
| HTML-T5-XLSize=XL2023.07 | 74.73 | 78.73 | |
| MarkupLM-LargeSize=Large2023.07 | 74.43 | 80.54 | |
| MarkupLMModalities=Text + HTML, Model Scale=Large2026.02 | 73.38 | 79.83 | |
| V-PLM2023.07 | 73.22 | 76.16 | |
| V-PLM(Electra)Modalities=Text + HTML + Image, Model Scale=Large2026.02 | 73.22 | 76.16 | |
| HTML-T5-LargeSize=Large2023.07 | 73.09 | 76.66 | |
| LayoutLMv3Modalities=Text + Image, Model Scale=Large2026.02 | 71.38 | 75.73 | |
| H-PLM2023.07 | 70.12 | 74.14 | |
| H-PLM(Electra)Modalities=Text + HTML, Model Scale=Large2026.02 | 70.12 | 74.14 | |
| DOM-LMTraining Data Scale=Full2022.01 | 69.7 | 73.9 | |
| RoBERTa-StructuralTraining Data Scale=Full2022.01 | 68.9 | 73.2 | |
| RoBERTa-BaseTraining Data Scale=Full2022.01 | 65.7 | 70.1 | |
| V-PLM (BERT-Base)Training Data Scale=Full2022.01 | 62.1 | 66.7 | |
| T-PLM2023.07 | 61.67 | 69.85 | |
| T-PLM(Electra)Modalities=Text, Model Scale=Large2026.02 | 61.67 | 69.85 | |
| H-PLM (BERT-Base)Training Data Scale=Full2022.01 | 61.5 | 67 | |
| DOM-LMTraining Data Scale=1%2022.01 | 61.3 | 67.3 | |
| RoBERTa-StructuralTraining Data Scale=1%2022.01 | 58.7 | 64 | |
| RoBERTa-BaseTraining Data Scale=1%2022.01 | 55.8 | 61.7 | |
| T-PLM (BERT-Base)Training Data Scale=Full2022.01 | 52.1 | 61.6 | |
| Flan-U-PaLMshots=5-shot2023.07 | 40.01 | 47.56 |