Language Modeling on English WSJ
24.7PPLGPT-2 + EDS
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| GPT-2 + EDSScope/Struct=sem const, #Labels=10, Speed=15, Size=+53.6M2021.12 | 24.7 | 2.92 | 43.1 | 45 | 52.7 | |
| GPT-2 + PTGScope/Struct=sem const, #Labels=72, Speed=15, Size=+54.6M2021.12 | 26.8 | 3.03 | 43.1 | 44.6 | 52.2 | |
| GPT-2 + PTB-fxnScope/Struct=syn const, #Labels=537, Speed=14, Size=+62.7M2021.12 | 29 | 3.07 | 42 | 43.8 | 51.4 | |
| GPT-2 + PTB-phrScope/Struct=syn const, #Labels=38, Speed=14, Size=+54.1M2021.12 | 29.8 | 3.14 | 41.2 | 42.8 | 50.7 | |
| GPT-2 + PSDScope/Struct=sem dep, #Labels=90, Speed=16, Size=+54.9M2021.12 | 30.7 | 3.21 | 39.1 | 40.9 | 49.1 | |
| GPT-2 + DMScope/Struct=sem dep, #Labels=59, Speed=15, Size=+54.4M2021.12 | 31.4 | 3.24 | 38.9 | 40.2 | 49.1 | |
| GPT-2 + UDScope/Struct=syn dep, #Labels=39, Speed=14, Size=+54.1M2021.12 | 32.7 | 3.3 | 39.1 | 40.1 | 48.6 | |
| GPT-2 + Domain#Labels=152021.12 | 45.9 | 3.64 | 33.3 | 34.9 | 43.5 | |
| GPT-2Size=124.4M2021.12 | 59.3 | 4.09 | 30 | 31.2 | 40.3 |