Context Retrieval on Synthetic structural v1
100F1 ScoreOracleGold
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| OracleGoldBudget=1202026.06 | 100 | 100 | 89 | |
| AutoContextKGBudget=1202026.06 | 85 | 98.4 | 94.3 | |
| CICLBudget=1202026.06 | 62 | 81.7 | 117.8 | |
| VanillaRAGBudget=1202026.06 | 56.2 | 60.3 | 107.3 | |
| GraphMemoryBudget=1202026.06 | 51.1 | 65.4 | 116.8 | |
| CICL_Dist. (MLP)Budget=1202026.06 | 32.8 | 27.7 | 111.2 | |
| CICL_Dist. (linear)Budget=1202026.06 | 29.5 | 30.2 | 110.6 | |
| SelfGenExamplesBudget=1202026.06 | 13.8 | 33.8 | 98.6 | |
| FullContextBudget=1202026.06 | 2 | 3.7 | 115 | |
| SummaryMemoryBudget=1202026.06 | 1 | 1.8 | 99.8 | |
| NoContextBudget=1202026.06 | 0 | 0 | 0 |