Open Information Extraction on ReOIE (test)
77F1 ScoreSpanOIE
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SpanOIEType=Tagging-based2023.09 | 77 | 79.7 | 74.5 | |
| IMOJIEType=Generation-based2023.09 | 76.2 | 88.1 | 67.1 | |
| OpenIE4Type=Rule-based2023.09 | 68.3 | — | — | |
| GPT-3.5-TURBOStrategy=Selected Demo & Uncertainty2023.09 | 67.9 | 65.8 | 70.2 | |
| GPT-3.5-TURBOStrategy=Fixed Demo2023.09 | 67.8 | 64.5 | 71.4 | |
| LLAMA-2-70BStrategy=Selected Demo & Uncertainty2023.09 | 67.5 | 69.4 | 65.7 | |
| LLAMA-2-70BStrategy=Selected Demo2023.09 | 66.9 | 62.1 | 72.5 | |
| LLAMA-2-70BStrategy=Fixed Demo2023.09 | 65.3 | 60.9 | 70.4 | |
| GPT-3.5-TURBOStrategy=Selected Demo2023.09 | 61.6 | 50.5 | 79.2 | |
| LLAMA-2-13BStrategy=Selected Demo2023.09 | 40.1 | 47.9 | 34.5 | |
| GPT-3.5-TURBOStrategy=Vanilla2023.09 | 25.9 | 35.8 | 20.2 | |
| LLAMA-2-13BStrategy=Selected Demo & Uncertainty2023.09 | 25.7 | 32.3 | 21.3 | |
| LLAMA-2-13BStrategy=Fixed Demo2023.09 | 22.9 | 31.2 | 18.1 |