Context retrieval on Synthetic semantic v3
100F1 ScoreOracleGold
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| OracleGoldBudget=1202026.06 | 100 | 100 | 45 | |
| VanillaRAGBudget=1202026.06 | 52.5 | 59.3 | 103.6 | |
| CICLBudget=1202026.06 | 42.5 | 89.6 | 117.2 | |
| AutoContextKGBudget=1202026.06 | 40.6 | 100 | 98.4 | |
| CICL_Dist. (MLP)Budget=1202026.06 | 33.4 | 27.3 | 113 | |
| GraphMemoryBudget=1202026.06 | 30.3 | 61.7 | 117 | |
| CICL_Dist. (linear)Budget=1202026.06 | 24.1 | 22.6 | 113.7 | |
| SelfGenExamplesBudget=1202026.06 | 12.4 | 36.6 | 101.9 | |
| FullContextBudget=1202026.06 | 2.7 | 4.5 | 114 | |
| SummaryMemoryBudget=1202026.06 | 0.7 | 1.4 | 102.4 | |
| NoContextBudget=1202026.06 | 0 | 0 | 0 |