Retrieval on QASPER (test)
30.27F1 ScoreDISRetrieval
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| DISRetrievalToken Budget=200, Embedding Model=OpenAI2025.05 | 30.27 | 65.33 | |
| BisectionToken Budget=200, Embedding Model=OpenAI2025.05 | 29.29 | 63.11 | |
| flatten-chunkToken Budget=200, Embedding Model=OpenAI2025.05 | 29.17 | 62.16 | |
| flatten-sentenceToken Budget=200, Embedding Model=OpenAI2025.05 | 28.25 | 62.78 | |
| DISRetrievalToken Budget=200, Embedding Model=SBERT2025.05 | 28.13 | 60.75 | |
| BisectionToken Budget=200, Embedding Model=SBERT2025.05 | 27.63 | 59.82 | |
| RAPTORToken Budget=200, Embedding Model=OpenAI2025.05 | 27.18 | 58.49 | |
| flatten-sentenceToken Budget=200, Embedding Model=SBERT2025.05 | 26.15 | 57.8 | |
| flatten-chunkToken Budget=200, Embedding Model=SBERT2025.05 | 26.13 | 56.05 | |
| DISRetrievalToken Budget=300, Embedding Model=OpenAI2025.05 | 26 | 71.71 | |
| BisectionToken Budget=300, Embedding Model=OpenAI2025.05 | 25.16 | 69.94 | |
| flatten-chunkToken Budget=300, Embedding Model=OpenAI2025.05 | 25.12 | 69.04 | |
| DISRetrievalToken Budget=300, Embedding Model=SBERT2025.05 | 24.62 | 67.98 | |
| RAPTORToken Budget=200, Embedding Model=SBERT2025.05 | 24.57 | 52.42 | |
| flatten-sentenceToken Budget=300, Embedding Model=OpenAI2025.05 | 24.04 | 68.43 | |
| BisectionToken Budget=300, Embedding Model=SBERT2025.05 | 23.83 | 66.69 | |
| RAPTORToken Budget=300, Embedding Model=OpenAI2025.05 | 23.57 | 65.63 | |
| flatten-chunkToken Budget=300, Embedding Model=SBERT2025.05 | 23.1 | 63.92 | |
| DISRetrievalToken Budget=400, Embedding Model=OpenAI2025.05 | 22.79 | 75.95 | |
| flatten-sentenceToken Budget=300, Embedding Model=SBERT2025.05 | 22.68 | 64.63 | |
| BisectionToken Budget=400, Embedding Model=OpenAI2025.05 | 21.98 | 74.18 | |
| flatten-chunkToken Budget=400, Embedding Model=OpenAI2025.05 | 21.91 | 73.38 | |
| RAPTORToken Budget=300, Embedding Model=SBERT2025.05 | 21.71 | 60 | |
| DISRetrievalToken Budget=400, Embedding Model=SBERT2025.05 | 21.58 | 72.61 | |
| BisectionToken Budget=400, Embedding Model=SBERT2025.05 | 21.1 | 71.52 | |
| flatten-sentenceToken Budget=400, Embedding Model=OpenAI2025.05 | 21.06 | 72.42 | |
| RAPTORToken Budget=400, Embedding Model=OpenAI2025.05 | 20.64 | 70.04 | |
| flatten-chunkToken Budget=400, Embedding Model=SBERT2025.05 | 20.38 | 68.75 | |
| flatten-sentenceToken Budget=400, Embedding Model=SBERT2025.05 | 19.98 | 69.02 | |
| RAPTORToken Budget=400, Embedding Model=SBERT2025.05 | 19.27 | 65.11 |