Relation Extraction on SemEval 2010
37.31F1 PrecisionAEiO
Evaluation results
| Method | Links | ||
|---|---|---|---|
| AEiOBackbone=gemini-3-flash-preview2026.06 | 37.31 | 21.64 | |
| SMADE-IEBackbone=gemini-3-flash-preview2026.06 | 30.6 | 23.73 | |
| SMADE-IEBackbone=GPT-3.5-Turbo-0125, Prompting Strategy=multi-agent debate2026.06 | 29.54 | 16.76 | |
| AEiOBackbone=GPT-3.5-Turbo-0125, Prompting Strategy=monolithic prompting2026.06 | 27.55 | 9.86 | |
| One-StepBackbone=GPT-3.5-Turbo-0125, Prompting Strategy=each-type prompting2026.06 | 16.13 | 5.16 | |
| CROSSAGENTIEBackbone=gemini-3-flash-preview2026.06 | 15.84 | 4.52 | |
| One-StepBackbone=gemini-3-flash-preview2026.06 | 15.39 | 4.31 | |
| G&OBackbone=gemini-3-flash-preview2026.06 | 12.65 | 3.91 | |
| G&OBackbone=GPT-3.5-Turbo-0125, Prompting Strategy=each-type prompting2026.06 | 12.16 | 4.56 | |
| CROSSAGENTIEBackbone=GPT-3.5-Turbo-0125, Prompting Strategy=multi-agent debate2026.06 | 11.77 | 2.91 |