Long-document Retrieval on LongEmbed
81.92Average ScoreDICE
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| DICEBackbone=Dream, Chunk size=1024, Aggregation rule=mean2026.06 | 81.92 | 90 | 74 | 65.01 | 50.54 | 98.53 | 86.04 | |
| DICEBackbone=Mistral, Chunk size=1024, Aggregation rule=mean2026.06 | 74.38 | 86 | 58.67 | 55.73 | 50.79 | 96.48 | 71.38 | |
| SINGLEBackbone=Dream2026.06 | 63.41 | 30 | 23.33 | 43.63 | 43.93 | 97.77 | 79.43 | |
| DICEBackbone=Qwen, Chunk size=1024, Aggregation rule=mean2026.06 | 59.06 | 66.67 | 20 | 35.25 | 42.06 | 91.83 | 61.51 | |
| SINGLEBackbone=Mistral2026.06 | 57.24 | 30 | 18 | 33.1 | 43.5 | 92.64 | 61.08 | |
| DICEBackbone=Llama3, Chunk size=1024, Aggregation rule=mean2026.06 | 50.56 | 35.33 | 25.33 | 45.64 | 27.59 | 93 | 61.16 | |
| SINGLEBackbone=Qwen2026.06 | 43.8 | 8.67 | 9.33 | 19.51 | 35.82 | 87.89 | 51.95 | |
| SINGLEBackbone=Llama32026.06 | 34.64 | 3.33 | 7.33 | 18.06 | 29.24 | 77.45 | 40.08 |