Table Retrieval on Spider Lite 2.0 (test)
29.4PrecisionJAR (w. Contriever)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| JAR (w. Contriever)k=32026.04 | 29.4 | 42.3 | 26.9 | 31.6 | |
| JAR (w. UAE)k=32026.04 | 29.1 | 41.6 | 27.1 | 30.8 | |
| Murrek=3, Backbone=SGPT-5.8B2026.04 | 28.1 | 42.3 | 29.4 | 31 | |
| UAEk=32026.04 | 27.1 | 40.6 | 27.6 | 29.7 | |
| RankZephyrk=32026.04 | 26 | 39.3 | 26.4 | 28.7 | |
| Contrieverk=32026.04 | 24.7 | 37.6 | 24.8 | 27.4 | |
| JAR (w. Contriever)k=52026.04 | 21.9 | 48.6 | 34 | 27 | |
| ATR (w. Contriever)Retrieval Type=Adaptive2026.04 | 21.9 | 72.4 | 64.4 | 27.8 | |
| Murrek=5, Backbone=SGPT-5.8B2026.04 | 21.8 | 51.1 | 36.8 | 28 | |
| JAR (w. UAE)k=52026.04 | 21.8 | 47.9 | 33.8 | 26.5 | |
| UAEk=52026.04 | 20.7 | 48.5 | 34.9 | 26.3 | |
| ATR (w. UAE)Retrieval Type=Adaptive2026.04 | 19.9 | 75.4 | 68.7 | 26.7 | |
| RankZephyrk=52026.04 | 19.7 | 46.7 | 33.8 | 25.2 | |
| Contrieverk=52026.04 | 19.1 | 45.1 | 32.6 | 24.4 | |
| Murrek=10, Backbone=SGPT-5.8B2026.04 | 14.8 | 61.9 | 48.5 | 21.5 | |
| JAR (w. UAE)k=102026.04 | 14.3 | 56.4 | 43.9 | 19.7 | |
| UAEk=102026.04 | 14.2 | 60.7 | 49 | 20.7 | |
| JAR (w. Contriever)k=102026.04 | 14 | 55.1 | 41.4 | 19.5 | |
| RankZephyrk=102026.04 | 13.6 | 57.3 | 45.5 | 19.8 | |
| Contrieverk=102026.04 | 13.3 | 56.5 | 44.8 | 19.5 |