Table Retrieval on Spider union (test)
69.6Precision (P)ATR (w. Contriever)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| ATR (w. Contriever)Retrieval Type=Adaptive2026.04 | 69.6 | 99.5 | 99.2 | 78.3 | |
| ATR (w. UAE)Retrieval Type=Adaptive2026.04 | 69.3 | 99.6 | 99.4 | 78.1 | |
| JAR (w. UAE)k=32026.04 | 48.4 | 96.5 | 94.1 | 62.3 | |
| JAR (w. Contriever)k=32026.04 | 48.1 | 96.5 | 93.6 | 62 | |
| RankZephyrk=32026.04 | 47.7 | 95.9 | 92.8 | 61.5 | |
| Contrieverk=32026.04 | 46.5 | 94 | 89.2 | 60.1 | |
| UAEk=32026.04 | 46.1 | 93 | 88 | 59.5 | |
| Murrek=3, Backbone=SGPT-5.8B2026.04 | 40.5 | 82.9 | 73.8 | 52.5 | |
| JAR (w. UAE)k=52026.04 | 29.9 | 99.1 | 98.5 | 44.7 | |
| JAR (w. Contriever)k=52026.04 | 29.7 | 98.5 | 97.2 | 44.3 | |
| UAEk=52026.04 | 29.5 | 97.8 | 96.4 | 44.1 | |
| RankZephyrk=52026.04 | 29.5 | 98.2 | 96.9 | 44.1 | |
| Contrieverk=52026.04 | 29.3 | 97.4 | 95.5 | 43.7 | |
| Murrek=5, Backbone=SGPT-5.8B2026.04 | 26.9 | 90.3 | 85.5 | 40.3 | |
| RankZephyrk=102026.04 | 15.1 | 99.5 | 99.2 | 25.7 | |
| JAR (w. Contriever)k=102026.04 | 15.1 | 99.5 | 99.2 | 25.7 | |
| JAR (w. UAE)k=102026.04 | 15.1 | 99.5 | 99.2 | 25.7 | |
| Contrieverk=102026.04 | 15 | 99.2 | 98.7 | 25.6 | |
| UAEk=102026.04 | 15 | 99.4 | 99 | 25.6 | |
| Murrek=10, Backbone=SGPT-5.8B2026.04 | 14.6 | 96.8 | 95.1 | 24.8 |