Information Extraction on MMM Japanese SCNM
89TL F1OIELLM-13B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| OIELLM-13B2024.07 | 89 | 86.33 | 57.7 | |
| OIELLM-8Bvariant=*2024.07 | 87.3 | 89.28 | 64 | |
| GIELLM-13B-jp2024.07 | 85.47 | 84.46 | 54.2 | |
| OIELLM-8B2024.07 | 84.73 | 88.53 | 61.93 | |
| GPT-4o2024.07 | 58.3 | 23.42 | 8.57 | |
| GPT-3.5-Turbo2024.07 | 42.07 | 7.54 | 1.97 | |
| GPT-4o-mini2024.07 | 0.27 | 20.61 | 0 |