Open Information Extraction on OIE 2016 (test)
69.42F1SpanOIE_prev
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SpanOIE_prevtraining_source=OpenIE4 extractions with confidence score > 0.92019.01 | 69.42 | 0.491 | — | — | |
| SpanOIEType=Tagging-based2023.09 | 69.4 | — | — | — | |
| SpanOIE2019.01 | 68.65 | 0.489 | — | — | |
| BIO2019.01 | 68.55 | 0.462 | — | — | |
| LLAMA-2-70BStrategy=Selected Demo & Uncertainty2023.09 | 65.8 | — | 68.9 | 63 | |
| OpenIE6Speed (Sentences/sec.)=31.7, Components=CIGL-OIE + IGL-CA2020.10 | 65.6 | 48.4 | — | — | |
| GPT-3.5-TURBOStrategy=Selected Demo & Uncertainty2023.09 | 65.1 | — | 61.6 | 69.1 | |
| LLAMA-2-70BStrategy=Selected Demo2023.09 | 64.8 | — | 68.4 | 61.6 | |
| LLAMA-2-70BStrategy=Fixed Demo2023.09 | 63.7 | — | 57.5 | 71.3 | |
| GPT-3.5-TURBOStrategy=Selected Demo2023.09 | 63.1 | — | 59.5 | 67 | |
| GPT-3.5-TURBOStrategy=Fixed Demo2023.09 | 62.5 | — | 60.6 | 64.5 | |
| ClausIESpeed (Sentences/sec.)=42020.10 | 61 | 38 | — | — | |
| OpenIE4Type=Rule-based2023.09 | 60 | — | — | — | |
| OpenIE5Speed (Sentences/sec.)=3.12020.10 | 59.9 | 39.9 | — | — | |
| CIGL-OIESpeed (Sentences/sec.)=1422020.10 | 59.2 | 40 | — | — | |
| OpenIE42019.01 | 58.83 | 0.408 | — | — | |
| ClausIE2019.01 | 58.01 | 0.364 | — | — | |
| IMoJIESpeed (Sentences/sec.)=2.62020.10 | 56.8 | 39.6 | — | — | |
| RnnOIESpeed (Sentences/sec.)=149.22020.10 | 56 | 32 | — | — | |
| IGL-OIESpeed (Sentences/sec.)=1422020.10 | 55 | 36 | — | — | |
| PropS2019.01 | 54.38 | 0.32 | — | — | |
| OpenIE4Speed (Sentences/sec.)=20.12020.10 | 54.3 | 37.1 | — | — | |
| SpanOIESpeed (Sentences/sec.)=19.42020.10 | 54 | — | — | — | |
| Cui et al.Speed (Sentences/sec.)=11.52020.10 | 53.5 | 37 | — | — | |
| MinIESpeed (Sentences/sec.)=8.92020.10 | 52.3 | — | — | — | |
| GPT-3.5-TURBOStrategy=Vanilla2023.09 | 45.9 | — | 41.5 | 51.3 | |
| OLLIE2019.01 | 38.58 | 0.202 | — | — | |
| LLAMA-2-13BStrategy=Selected Demo & Uncertainty2023.09 | 36.9 | — | 41.1 | 33.5 | |
| LLAMA-2-13BStrategy=Selected Demo2023.09 | 36.2 | — | 40.7 | 32.6 | |
| LLAMA-2-13BStrategy=Fixed Demo2023.09 | 33.7 | — | 37.5 | 30.6 | |
| SenseOIE2020.10 | 31.1 | — | — | — | |
| Stanford2019.01 | 13.55 | 0.079 | — | — | |
| Seq2seq OIE2019.01 | — | 0.473 | — | — |