Rationale-based retrieval on Saycan (test)
71.2R@1LaHoRe
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| LaHoReSize=7B, Role=teacher2026.04 | 71.2 | 88.5 | 94.2 | 79.8 | 980 | |
| RabtrieverSize=7B2026.04 | 67.3 | 76.9 | 78.8 | 73.7 | 95 | |
| OneGenSize=7B2026.04 | 44.2 | 67.3 | 75 | 56.8 | — | |
| GritLMSize=7B2026.04 | 35.8 | 43.5 | 43.1 | 46.3 | — | |
| RankLLaMASize=7B2026.04 | 26.9 | 50 | 75 | 44.9 | — | |
| InstructOR XLSize=1.5B2026.04 | 17.3 | 26.9 | 34.6 | 28.4 | — | |
| LlaMA2VecSize=7B2026.04 | 17.3 | 40.4 | 46.2 | 31.1 | 93 | |
| E5-MistralSize=7B2026.04 | 14.9 | 19.1 | 19.1 | 17 | — | |
| RepLLaMASize=7B2026.04 | 9.6 | 25 | 38.4 | 23.6 | — | |
| E5-large-instructSize=550M2026.04 | 7.7 | 17.3 | 26.9 | 18.2 | — | |
| PromptrieverSize=7B2026.04 | 5.8 | 19.2 | 34.6 | 19 | — | |
| TART-ContrieverSize=110M2026.04 | 1.2 | 19.2 | 36.5 | 17.5 | — |