Information Retrieval on PIRE single-chunk 1.0 (test)
86R@10ChunkNorris
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| ChunkNorrisChunker=ChunkNorris, Embedding Model=Snowflake 305M2025.11 | 86 | 66 | |
| ChunkNorrisChunker=ChunkNorris, Embedding Model=BGE 335M2025.11 | 86 | 68 | |
| ChunkNorrisChunker=ChunkNorris, Embedding Model=BGE 33M2025.11 | 84 | 65 | |
| ChunkNorrisChunker=Page, Embedding Model=Snowflake 305M2025.11 | 83 | 62 | |
| PyPDFChunker=Page, Embedding Model=Snowflake 305M2025.11 | 83 | 63 | |
| DoclingChunker=Docling, Embedding Model=BGE 109M2025.11 | 83 | 63 | |
| DoclingChunker=Docling, Embedding Model=BGE 335M2025.11 | 82 | 65 | |
| DoclingChunker=Page, Embedding Model=Snowflake 305M2025.11 | 81 | 62 | |
| DoclingChunker=Docling, Embedding Model=Snowflake 305M2025.11 | 81 | 61 | |
| PyPDFChunker=Recursive Character, Embedding Model=Snowflake 305M2025.11 | 81 | 61 | |
| ChunkNorrisChunker=ChunkNorris, Embedding Model=BGE 109M2025.11 | 81 | 61 | |
| ChunkNorrisChunker=Recursive Character, Embedding Model=Snowflake 305M2025.11 | 80 | 61 | |
| DoclingChunker=Docling, Embedding Model=BGE 33M2025.11 | 80 | 61 | |
| MarkerChunker=Page, Embedding Model=Snowflake 305M2025.11 | 79 | 59 | |
| PyPDFChunker=Recursive Character, Embedding Model=BGE 33M2025.11 | 79 | 60 | |
| ChunkNorrisChunker=Page, Embedding Model=BGE 335M2025.11 | 79 | 60 | |
| PyPDFChunker=Page, Embedding Model=BGE 335M2025.11 | 79 | 61 | |
| PyPDFChunker=Recursive Character, Embedding Model=BGE 335M2025.11 | 79 | 62 | |
| MarkerChunker=Recursive Character, Embedding Model=Snowflake 305M2025.11 | 78 | 59 | |
| Open-Parse-UChunker=Page, Embedding Model=Snowflake 305M2025.11 | 78 | 60 | |
| PyPDFChunker=Page, Embedding Model=BGE 33M2025.11 | 78 | 59 | |
| Open-Parse-PChunker=Page, Embedding Model=Snowflake 305M2025.11 | 77 | 59 | |
| MarkerChunker=Page, Embedding Model=BGE 33M2025.11 | 77 | 58 | |
| MarkerChunker=Recursive Character, Embedding Model=BGE 33M2025.11 | 77 | 58 | |
| PyPDFChunker=Page, Embedding Model=BGE 109M2025.11 | 77 | 59 | |
| ChunkNorrisChunker=Recursive Character, Embedding Model=BGE 335M2025.11 | 77 | 60 | |
| DoclingChunker=Page, Embedding Model=BGE 335M2025.11 | 77 | 59 | |
| MarkerChunker=Page, Embedding Model=BGE 335M2025.11 | 77 | 59 | |
| MarkerChunker=Recursive Character, Embedding Model=BGE 335M2025.11 | 77 | 60 | |
| DoclingChunker=Recursive Character, Embedding Model=Snowflake 305M2025.11 | 76 | 57 | |
| DoclingChunker=Page, Embedding Model=BGE 33M2025.11 | 76 | 57 | |
| MarkerChunker=Page, Embedding Model=BGE 109M2025.11 | 76 | 56 | |
| MarkerChunker=Recursive Character, Embedding Model=BGE 109M2025.11 | 76 | 56 | |
| DoclingChunker=Recursive Character, Embedding Model=BGE 335M2025.11 | 76 | 60 | |
| ChunkNorrisChunker=Page, Embedding Model=BGE 33M2025.11 | 75 | 57 | |
| ChunkNorrisChunker=Recursive Character, Embedding Model=BGE 33M2025.11 | 75 | 57 | |
| DoclingChunker=Recursive Character, Embedding Model=BGE 33M2025.11 | 75 | 56 | |
| DoclingChunker=Page, Embedding Model=BGE 109M2025.11 | 75 | 57 | |
| Open-Parse-UChunker=Recursive Character, Embedding Model=Snowflake 305M2025.11 | 74 | 57 | |
| PyPDFChunker=Recursive Character, Embedding Model=BGE 109M2025.11 | 74 | 57 | |
| Open-Parse-PChunker=Recursive Character, Embedding Model=Snowflake 305M2025.11 | 73 | 57 | |
| Open-Parse-PChunker=Open-Parse, Embedding Model=Snowflake 305M2025.11 | 73 | 58 | |
| Open-Parse-PChunker=Page, Embedding Model=BGE 33M2025.11 | 73 | 55 | |
| Open-Parse-PChunker=Open-Parse, Embedding Model=BGE 33M2025.11 | 73 | 57 | |
| ChunkNorrisChunker=Page, Embedding Model=BGE 109M2025.11 | 73 | 56 | |
| ChunkNorrisChunker=Recursive Character, Embedding Model=BGE 109M2025.11 | 73 | 56 | |
| DoclingChunker=Recursive Character, Embedding Model=BGE 109M2025.11 | 73 | 56 | |
| Open-Parse-PChunker=Page, Embedding Model=BGE 335M2025.11 | 73 | 55 | |
| Open-Parse-PChunker=Open-Parse, Embedding Model=BGE 335M2025.11 | 73 | 61 | |
| Open-Parse-UChunker=Page, Embedding Model=BGE 335M2025.11 | 73 | 55 | |
| Open-Parse-UChunker=Recursive Character, Embedding Model=BGE 335M2025.11 | 73 | 56 | |
| Open-Parse-PChunker=Recursive Character, Embedding Model=BGE 33M2025.11 | 72 | 55 | |
| Open-Parse-PChunker=Recursive Character, Embedding Model=BGE 335M2025.11 | 72 | 55 | |
| Open-Parse-UChunker=Page, Embedding Model=BGE 33M2025.11 | 71 | 53 | |
| Open-Parse-UChunker=Recursive Character, Embedding Model=BGE 33M2025.11 | 71 | 54 | |
| Open-Parse-PChunker=Page, Embedding Model=BGE 109M2025.11 | 71 | 53 | |
| Open-Parse-PChunker=Recursive Character, Embedding Model=BGE 109M2025.11 | 71 | 52 | |
| Open-Parse-PChunker=Open-Parse, Embedding Model=BGE 109M2025.11 | 71 | 56 | |
| Open-Parse-UChunker=Open-Parse, Embedding Model=BGE 335M2025.11 | 71 | 58 | |
| Open-Parse-UChunker=Open-Parse, Embedding Model=Snowflake 305M2025.11 | 70 | 55 | |
| Open-Parse-UChunker=Open-Parse, Embedding Model=BGE 33M2025.11 | 69 | 53 | |
| Open-Parse-UChunker=Page, Embedding Model=BGE 109M2025.11 | 69 | 52 | |
| Open-Parse-UChunker=Recursive Character, Embedding Model=BGE 109M2025.11 | 69 | 52 | |
| Open-Parse-UChunker=Open-Parse, Embedding Model=BGE 109M2025.11 | 68 | 53 | |
| ChunkNorrisChunker=ChunkNorris, Embedding Model=Snowflake 23M2025.11 | 57 | 35 | |
| Open-Parse-PChunker=Recursive Character, Embedding Model=Snowflake 23M2025.11 | 48 | 31 | |
| ChunkNorrisChunker=Page, Embedding Model=Snowflake 23M2025.11 | 45 | 28 | |
| ChunkNorrisChunker=Recursive Character, Embedding Model=Snowflake 23M2025.11 | 45 | 30 | |
| DoclingChunker=Page, Embedding Model=Snowflake 23M2025.11 | 45 | 30 | |
| Open-Parse-PChunker=Page, Embedding Model=Snowflake 23M2025.11 | 45 | 30 | |
| Open-Parse-UChunker=Page, Embedding Model=Snowflake 23M2025.11 | 45 | 31 | |
| DoclingChunker=Docling, Embedding Model=Snowflake 23M2025.11 | 44 | 29 | |
| Open-Parse-UChunker=Recursive Character, Embedding Model=Snowflake 23M2025.11 | 44 | 31 | |
| MarkerChunker=Page, Embedding Model=Snowflake 23M2025.11 | 43 | 28 | |
| MarkerChunker=Recursive Character, Embedding Model=Snowflake 23M2025.11 | 43 | 29 | |
| PyPDFChunker=Recursive Character, Embedding Model=Snowflake 23M2025.11 | 43 | 29 | |
| PyPDFChunker=Page, Embedding Model=Snowflake 23M2025.11 | 40 | 27 | |
| Open-Parse-PChunker=Open-Parse, Embedding Model=Snowflake 23M2025.11 | 38 | 26 | |
| ChunkNorrisChunker=ChunkNorris, Embedding Model=Snowflake 109M2025.11 | 38 | 21 | |
| DoclingChunker=Recursive Character, Embedding Model=Snowflake 23M2025.11 | 36 | 25 | |
| Open-Parse-UChunker=Open-Parse, Embedding Model=Snowflake 23M2025.11 | 35 | 25 | |
| Open-Parse-PChunker=Page, Embedding Model=Snowflake 109M2025.11 | 29 | 20 | |
| Open-Parse-PChunker=Recursive Character, Embedding Model=Snowflake 109M2025.11 | 29 | 20 | |
| Open-Parse-UChunker=Page, Embedding Model=Snowflake 109M2025.11 | 29 | 19 | |
| ChunkNorrisChunker=Recursive Character, Embedding Model=Snowflake 109M2025.11 | 28 | 19 | |
| Open-Parse-UChunker=Recursive Character, Embedding Model=Snowflake 109M2025.11 | 27 | 19 | |
| ChunkNorrisChunker=Page, Embedding Model=Snowflake 109M2025.11 | 26 | 18 | |
| DoclingChunker=Docling, Embedding Model=Snowflake 109M2025.11 | 26 | 18 | |
| MarkerChunker=Recursive Character, Embedding Model=Snowflake 109M2025.11 | 26 | 17 | |
| MarkerChunker=Page, Embedding Model=Snowflake 109M2025.11 | 25 | 17 | |
| DoclingChunker=Page, Embedding Model=Snowflake 109M2025.11 | 24 | 16 | |
| PyPDFChunker=Recursive Character, Embedding Model=Snowflake 109M2025.11 | 24 | 16 | |
| DoclingChunker=Recursive Character, Embedding Model=Snowflake 109M2025.11 | 22 | 14 | |
| Open-Parse-PChunker=Open-Parse, Embedding Model=Snowflake 109M2025.11 | 21 | 14 | |
| PyPDFChunker=Page, Embedding Model=Snowflake 109M2025.11 | 21 | 15 | |
| Open-Parse-UChunker=Open-Parse, Embedding Model=Snowflake 109M2025.11 | 19 | 13 |