Information Extraction on MMM Japanese SCPOS: RW
0.946TL F1OIELLM-13B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| OIELLM-13B2024.07 | 0.946 | 0.5236 | 0.119 | |
| OIELLM-8Bvariant=*2024.07 | 0.882 | 0.5379 | 0.123 | |
| GPT-4o2024.07 | 0.87 | 0.0435 | 0.013 | |
| OIELLM-8B2024.07 | 0.865 | 0.5476 | 0.124 | |
| GIELLM-13B-jp2024.07 | 0.8601 | 0.6661 | 0.1739 | |
| GPT-4o-mini2024.07 | 0.812 | 0.0259 | 0.014 | |
| GPT-3.5-Turbo2024.07 | 0.572 | 0 | 0 | |
| USA-7B2024.07 | 0.5327 | 0.408 | 0.0767 |