Keyphrase Extraction on OpenKP (dev)
44.27F1@3RealFormer
Evaluation results
| Method | Links | |
|---|---|---|
| RealFormerModel Scale=Large, Base Model=ETC2020.12 | 44.27 | |
| ETCModel Scale=Large2020.12 | 44.06 | |
| ETC-largeInput length=4096, Configuration=max loss, lifting from ROBERTa, #Params=558M2020.04 | 42.3 | |
| ETC-largeInput length=4096, Configuration=max loss, #Params=539M2020.04 | 41.9 | |
| ETCInput length=4096, Configuration=max loss, #Params=166M2020.04 | 41.6 | |
| ETCInput length=4096, #Params=166M2020.04 | 40.9 | |
| ETCInput length=4096, Configuration=shared, #Params=109M2020.04 | 40.9 | |
| ETCInput length=4096, Configuration=no visual features, #Params=166M2020.04 | 40.2 | |
| ETCInput length=4096, Configuration=fixed blocks, no CPC, no hard g2l, no visual features, #Params=166M2020.04 | 40 | |
| ETCInput length=4096, Configuration=no CPC, no hard g2l, no visual features, #Params=166M2020.04 | 40 | |
| ETCInput length=4096, Configuration=no hard g2l, no visual features, #Params=166M2020.04 | 40 | |
| ETCInput length=512, Configuration=fixed blocks, no CPC, no hard g2l, no visual features, #Params=166M2020.04 | 39.9 | |
| ROBERTa-JointKPEInput length=5122020.04 | 39.8 |