Table Retrieval on BIRD union (test)
54.4PrecisionJAR (w. Contriever)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| JAR (w. Contriever)k=32026.04 | 54.4 | 87.4 | 76.3 | 65 | |
| ATR (w. Contriever)Retrieval Type=Adaptive2026.04 | 54 | 98.2 | 96 | 65.8 | |
| JAR (w. UAE)k=32026.04 | 53.6 | 86.3 | 74.8 | 64.4 | |
| ATR (w. UAE)Retrieval Type=Adaptive2026.04 | 52.8 | 98.6 | 97.1 | 65.1 | |
| UAEk=32026.04 | 48.2 | 79 | 63.5 | 58.3 | |
| RankZephyrk=32026.04 | 47.9 | 76.6 | 60.4 | 57.3 | |
| Contrieverk=32026.04 | 45.6 | 72.9 | 55.1 | 54.6 | |
| Murrek=3, Backbone=SGPT-5.8B2026.04 | 44.6 | 72.5 | 54.6 | 53.7 | |
| JAR (w. Contriever)k=52026.04 | 35.1 | 92.5 | 85.9 | 49.7 | |
| JAR (w. UAE)k=52026.04 | 34.4 | 91.1 | 82.9 | 48.9 | |
| UAEk=52026.04 | 32.7 | 87.2 | 77.3 | 46.5 | |
| RankZephyrk=52026.04 | 32.1 | 84.4 | 72.4 | 45.5 | |
| Contrieverk=52026.04 | 31.2 | 82.1 | 68.6 | 44.2 | |
| Murrek=5, Backbone=SGPT-5.8B2026.04 | 30.1 | 80.5 | 66.4 | 42.8 | |
| JAR (w. Contriever)k=102026.04 | 18.8 | 97.6 | 96 | 31 | |
| UAEk=102026.04 | 18.7 | 97.6 | 95.1 | 30.9 | |
| JAR (w. UAE)k=102026.04 | 18.7 | 97.2 | 95.2 | 30.9 | |
| Contrieverk=102026.04 | 18.5 | 96.1 | 92.6 | 30.5 | |
| RankZephyrk=102026.04 | 18.5 | 96.5 | 93.1 | 30.6 | |
| Murrek=10, Backbone=SGPT-5.8B2026.04 | 16.7 | 88.2 | 78.3 | 27.6 |