Multi-hop Question Answering on WikiHop (dev)
79.8AccuracyETC-large
Evaluation results
| Method | Links | |
|---|---|---|
| ETC-largeInput length=4096, Configuration=lifting from RoBERTa, #Params=558M2020.04 | 79.8 | |
| Longformer-largeInput length=4096, #Params=435M*2020.04 | 77.6 | |
| ETC-largeInput length=4096, #Params=539M2020.04 | 77 | |
| ETCInput length=4096, Configuration=no hard g2l, #Params=166M2020.04 | 75.9 | |
| LongformerInput length=4096, #Params=149M*2020.04 | 75 | |
| ETCInput length=4096, Configuration=shared, #Params=109M2020.04 | 73.7 | |
| ETCInput length=4096, #Params=166M2020.04 | 73.2 | |
| ETCInput length=4096, Configuration=no CPC, #Params=166M2020.04 | 73 | |
| ETCInput length=4096, Configuration=flat structure, #Params=166M2020.04 | 70.7 | |
| ETCInput length=4096, Configuration=flat structure, no CPC, no hard g2l, #Params=166M2020.04 | 70 |