Multimodal Image-Retrieval Re-ranking on INQUIRE Rerank iNaturalist 2024 (test)
100Parse Rate (%)Constrained-decoding Base
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Constrained-decoding BaseEvaluation Protocol=Zero-shot, N=102026.06 | 100 | 0.841 | |
| PRISMR (α-mode) (concat)Evaluation Protocol=Zero-shot, N=102026.06 | 100 | 0.705 | |
| PRISMR (β-mode) (mean)Evaluation Protocol=In-domain fine-tune, N=102026.06 | 100 | 0.831 | |
| PRISMR (α-mode) (concat)Evaluation Protocol=In-domain fine-tune, N=102026.06 | 100 | 0.804 | |
| RankGPTEvaluation Protocol=Zero-shot, N=102026.06 | 90 | 0.728 | |
| Base (score-by-score)Evaluation Protocol=Zero-shot, N=102026.06 | 10 | 0.707 |