Named Entity Recognition on REDFM (test)
31.12F1p ScoreSMADE-IE
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SMADE-IEBackbone=GPT-3.5-Turbo-0125, Prompting Strategy=multi-agent debate, Number of entity types=102026.06 | 31.12 | 27.13 | |
| CROSSAGENTIEBackbone=GPT-3.5-Turbo-0125, Prompting Strategy=multi-agent debate, Number of entity types=102026.06 | 29.2 | 25.16 | |
| G&OBackbone=GPT-3.5-Turbo-0125, Prompting Strategy=each-type prompting, Number of entity types=102026.06 | 27.07 | 20.61 | |
| One-StepBackbone=GPT-3.5-Turbo-0125, Prompting Strategy=each-type prompting, Number of entity types=102026.06 | 25.21 | 18.93 | |
| AEiOBackbone=GPT-3.5-Turbo-0125, Prompting Strategy=monolithic prompting, Number of entity types=102026.06 | 21.14 | 17.45 |