Information Extraction on Amazon (F1 Scores)
77.5Micro-F1SchemaRAG + oracle
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SchemaRAG + oracleSegmentation=true, Schema reduction strategy=oracle, Oracle status=true, Backbone=GPT-4o2026.05 | 77.5 | 78.8 | |
| SchemaRAGSegmentation=true, Schema reduction strategy=top-k retrieval, Backbone=GPT-4o2026.05 | 51 | 51.5 | |
| Full schemaSegmentation=false, Schema reduction strategy=relevance sort, Backbone=GPT-4o2026.05 | 47.1 | 48.1 | |
| Full schema + segmentationSegmentation=true, Schema reduction strategy=relevance sort, Backbone=GPT-4o2026.05 | 42.3 | 45.1 |