Question Answering on SQuAD-Open (dev)
34.7EMOur Selector
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Our Selectorn sent=10.7, Inference Acc=64.0, Inference Sp=x5.82018.05 | 34.7 | 42.5 | — | — | |
| Our Selectorn sent=20.4, Inference Acc=68.1, Inference Sp=x3.02018.05 | 34.7 | 42.6 | — | — | |
| Our Selectorn sent=40.0, Inference Acc=71.4, Inference Sp=x1.52018.05 | 34.7 | 42.6 | — | — | |
| MINIMAL (Our Selector)n sent=10.7, Selector=Dyn2018.05 | 34.7 | 42.5 | 64 | 5.8 | |
| TF-IDFn sent=40, Inference Acc=65.8, Inference Sp=x1.62018.05 | 34.6 | 42.5 | — | — | |
| Our Selectorn sent=5.3, Inference Acc=58.9, Inference Sp=x11.72018.05 | 34.6 | 42.3 | — | — | |
| MINIMAL (Our Selector)n sent=5.3, Selector=Dyn2018.05 | 34.6 | 42.3 | 58.9 | 11.7 | |
| TF-IDFn sent=20, Inference Acc=62.4, Inference Sp=x3.12018.05 | 34.1 | 41.7 | — | — | |
| FULLn sent=124, Inference Acc=76.9, Inference Sp=x1.02018.05 | 33.1 | 41 | — | — | |
| FULLn sent=1242018.05 | 33.1 | 41 | 76.9 | 1 | |
| TF-IDFn sent=10, Inference Acc=54.3, Inference Sp=x6.22018.05 | 32.5 | 39.8 | — | — | |
| MINIMAL (TF-IDF)n sent=10, Selector=TF-IDF2018.05 | 32.5 | 39.8 | 54.3 | 6.2 | |
| DrQA (Multitask)n sent=2376, Inference Acc=77.82018.05 | 29.8 | — | — | — | |
| DrQA (Multitask)Rank=12018.05 | 29.8 | — | 77.8 | — | |
| TF-IDFn sent=5, Inference Acc=46.1, Inference Sp=x12.42018.05 | 29.6 | 36.6 | — | — | |
| MINIMAL (TF-IDF)n sent=5, Selector=TF-IDF2018.05 | 29.6 | 36.6 | 46.1 | 12.4 | |
| R32018.05 | 29.1 | 37.5 | — | — | |
| R^3Rank=22018.05 | 29.1 | 37.5 | — | — | |
| DrQAn sent=2376, Inference Acc=77.82018.05 | 28.4 | — | — | — | |
| DrQA (Plain)Rank=32018.05 | 28.4 | — | 77.8 | — |