Information Retrieval on PIRE multi-chunk
81R@10ChunkNorris
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| ChunkNorrisParser=ChunkNorris, Chunker=ChunkNorris, Embedding Model=BGE, Embedding Parameters=335M2025.11 | 81 | 59 | |
| ChunkNorrisParser=ChunkNorris, Chunker=ChunkNorris, Embedding Model=BGE, Embedding Parameters=109M2025.11 | 79 | 52 | |
| ChunkNorrisParser=ChunkNorris, Chunker=ChunkNorris, Embedding Model=BGE, Embedding Parameters=33M2025.11 | 78 | 56 | |
| Open-Parse-UParser=Open-Parse-U, Chunker=Page, Embedding Model=Snowflake, Embedding Parameters=305M2025.11 | 75 | 54 | |
| ChunkNorrisParser=ChunkNorris, Chunker=ChunkNorris, Embedding Model=Snowflake, Embedding Parameters=305M2025.11 | 74 | 56 | |
| ChunkNorrisParser=ChunkNorris, Chunker=Page, Embedding Model=Snowflake, Embedding Parameters=305M2025.11 | 72 | 50 | |
| Open-Parse-PParser=Open-Parse-P, Chunker=Page, Embedding Model=Snowflake, Embedding Parameters=305M2025.11 | 72 | 54 | |
| PyPDFParser=PyPDF, Chunker=RC, Embedding Model=Snowflake, Embedding Parameters=305M2025.11 | 72 | 51 | |
| MarkerParser=Marker, Chunker=Page, Embedding Model=BGE, Embedding Parameters=335M2025.11 | 72 | 48 | |
| DoclingParser=Docling, Chunker=Page, Embedding Model=Snowflake, Embedding Parameters=305M2025.11 | 71 | 49 | |
| Open-Parse-PParser=Open-Parse-P, Chunker=RC, Embedding Model=Snowflake, Embedding Parameters=305M2025.11 | 71 | 52 | |
| Open-Parse-UParser=Open-Parse-U, Chunker=RC, Embedding Model=Snowflake, Embedding Parameters=305M2025.11 | 71 | 50 | |
| Open-Parse-PParser=Open-Parse-P, Chunker=RC, Embedding Model=BGE, Embedding Parameters=335M2025.11 | 71 | 51 | |
| ChunkNorrisParser=ChunkNorris, Chunker=RC, Embedding Model=Snowflake, Embedding Parameters=305M2025.11 | 70 | 49 | |
| PyPDFParser=PyPDF, Chunker=Page, Embedding Model=Snowflake, Embedding Parameters=305M2025.11 | 70 | 51 | |
| MarkerParser=Marker, Chunker=RC, Embedding Model=BGE, Embedding Parameters=335M2025.11 | 70 | 49 | |
| Open-Parse-UParser=Open-Parse-U, Chunker=RC, Embedding Model=BGE, Embedding Parameters=335M2025.11 | 70 | 50 | |
| ChunkNorrisParser=ChunkNorris, Chunker=Page, Embedding Model=BGE, Embedding Parameters=335M2025.11 | 69 | 50 | |
| DoclingParser=Docling, Chunker=Page, Embedding Model=BGE, Embedding Parameters=335M2025.11 | 68 | 48 | |
| Open-Parse-PParser=Open-Parse-P, Chunker=Page, Embedding Model=BGE, Embedding Parameters=335M2025.11 | 68 | 50 | |
| Open-Parse-UParser=Open-Parse-U, Chunker=Page, Embedding Model=BGE, Embedding Parameters=335M2025.11 | 68 | 50 | |
| DoclingParser=Docling, Chunker=Docling, Embedding Model=BGE, Embedding Parameters=335M2025.11 | 67 | 53 | |
| DoclingParser=Docling, Chunker=Docling, Embedding Model=BGE, Embedding Parameters=33M2025.11 | 66 | 48 | |
| PyPDFParser=PyPDF, Chunker=RC, Embedding Model=BGE, Embedding Parameters=335M2025.11 | 66 | 46 | |
| ChunkNorrisParser=ChunkNorris, Chunker=RC, Embedding Model=BGE, Embedding Parameters=335M2025.11 | 65 | 50 | |
| PyPDFParser=PyPDF, Chunker=Page, Embedding Model=BGE, Embedding Parameters=335M2025.11 | 65 | 45 | |
| MarkerParser=Marker, Chunker=Page, Embedding Model=BGE, Embedding Parameters=109M2025.11 | 64 | 41 | |
| ChunkNorrisParser=ChunkNorris, Chunker=ChunkNorris, Embedding Model=Snowflake, Embedding Parameters=23M2025.11 | 63 | 30 | |
| Open-Parse-PParser=Open-Parse-P, Chunker=Page, Embedding Model=BGE, Embedding Parameters=33M2025.11 | 63 | 46 | |
| MarkerParser=Marker, Chunker=Page, Embedding Model=Snowflake, Embedding Parameters=305M2025.11 | 62 | 43 | |
| MarkerParser=Marker, Chunker=RC, Embedding Model=BGE, Embedding Parameters=33M2025.11 | 62 | 44 | |
| Open-Parse-PParser=Open-Parse-P, Chunker=RC, Embedding Model=BGE, Embedding Parameters=33M2025.11 | 62 | 46 | |
| Open-Parse-UParser=Open-Parse-U, Chunker=Page, Embedding Model=BGE, Embedding Parameters=33M2025.11 | 62 | 44 | |
| MarkerParser=Marker, Chunker=RC, Embedding Model=Snowflake, Embedding Parameters=305M2025.11 | 61 | 44 | |
| PyPDFParser=PyPDF, Chunker=Page, Embedding Model=BGE, Embedding Parameters=33M2025.11 | 61 | 44 | |
| PyPDFParser=PyPDF, Chunker=Page, Embedding Model=BGE, Embedding Parameters=109M2025.11 | 61 | 43 | |
| MarkerParser=Marker, Chunker=Page, Embedding Model=BGE, Embedding Parameters=33M2025.11 | 60 | 42 | |
| Open-Parse-UParser=Open-Parse-U, Chunker=RC, Embedding Model=BGE, Embedding Parameters=33M2025.11 | 60 | 42 | |
| ChunkNorrisParser=ChunkNorris, Chunker=Page, Embedding Model=BGE, Embedding Parameters=109M2025.11 | 60 | 42 | |
| DoclingParser=Docling, Chunker=Docling, Embedding Model=BGE, Embedding Parameters=109M2025.11 | 60 | 49 | |
| DoclingParser=Docling, Chunker=Docling, Embedding Model=Snowflake, Embedding Parameters=305M2025.11 | 59 | 44 | |
| PyPDFParser=PyPDF, Chunker=RC, Embedding Model=BGE, Embedding Parameters=109M2025.11 | 59 | 42 | |
| ChunkNorrisParser=ChunkNorris, Chunker=Page, Embedding Model=BGE, Embedding Parameters=33M2025.11 | 58 | 44 | |
| MarkerParser=Marker, Chunker=RC, Embedding Model=BGE, Embedding Parameters=109M2025.11 | 58 | 40 | |
| Open-Parse-PParser=Open-Parse-P, Chunker=Page, Embedding Model=BGE, Embedding Parameters=109M2025.11 | 58 | 42 | |
| Open-Parse-UParser=Open-Parse-U, Chunker=Page, Embedding Model=BGE, Embedding Parameters=109M2025.11 | 58 | 43 | |
| DoclingParser=Docling, Chunker=RC, Embedding Model=BGE, Embedding Parameters=335M2025.11 | 57 | 42 | |
| DoclingParser=Docling, Chunker=Page, Embedding Model=BGE, Embedding Parameters=33M2025.11 | 56 | 41 | |
| PyPDFParser=PyPDF, Chunker=RC, Embedding Model=BGE, Embedding Parameters=33M2025.11 | 56 | 43 | |
| DoclingParser=Docling, Chunker=RC, Embedding Model=BGE, Embedding Parameters=109M2025.11 | 56 | 39 | |
| Open-Parse-PParser=Open-Parse-P, Chunker=RC, Embedding Model=BGE, Embedding Parameters=109M2025.11 | 55 | 43 | |
| DoclingParser=Docling, Chunker=Page, Embedding Model=BGE, Embedding Parameters=109M2025.11 | 54 | 40 | |
| Open-Parse-UParser=Open-Parse-U, Chunker=RC, Embedding Model=BGE, Embedding Parameters=109M2025.11 | 53 | 42 | |
| ChunkNorrisParser=ChunkNorris, Chunker=RC, Embedding Model=BGE, Embedding Parameters=33M2025.11 | 52 | 41 | |
| ChunkNorrisParser=ChunkNorris, Chunker=RC, Embedding Model=BGE, Embedding Parameters=109M2025.11 | 52 | 40 | |
| DoclingParser=Docling, Chunker=RC, Embedding Model=Snowflake, Embedding Parameters=305M2025.11 | 51 | 34 | |
| DoclingParser=Docling, Chunker=RC, Embedding Model=BGE, Embedding Parameters=33M2025.11 | 48 | 35 | |
| Open-Parse-UParser=Open-Parse-U, Chunker=Open-Parse, Embedding Model=BGE, Embedding Parameters=109M2025.11 | 48 | 36 | |
| Open-Parse-UParser=Open-Parse-U, Chunker=Open-Parse, Embedding Model=BGE, Embedding Parameters=335M2025.11 | 47 | 37 | |
| Open-Parse-PParser=Open-Parse-P, Chunker=Open-Parse, Embedding Model=BGE, Embedding Parameters=33M2025.11 | 44 | 34 | |
| Open-Parse-UParser=Open-Parse-U, Chunker=Open-Parse, Embedding Model=BGE, Embedding Parameters=33M2025.11 | 43 | 33 | |
| Open-Parse-PParser=Open-Parse-P, Chunker=Open-Parse, Embedding Model=BGE, Embedding Parameters=109M2025.11 | 43 | 34 | |
| ChunkNorrisParser=ChunkNorris, Chunker=Page, Embedding Model=Snowflake, Embedding Parameters=23M2025.11 | 42 | 27 | |
| Open-Parse-UParser=Open-Parse-U, Chunker=Open-Parse, Embedding Model=Snowflake, Embedding Parameters=305M2025.11 | 42 | 32 | |
| Open-Parse-PParser=Open-Parse-P, Chunker=Open-Parse, Embedding Model=BGE, Embedding Parameters=335M2025.11 | 41 | 34 | |
| Open-Parse-UParser=Open-Parse-U, Chunker=Page, Embedding Model=Snowflake, Embedding Parameters=23M2025.11 | 40 | 30 | |
| ChunkNorrisParser=ChunkNorris, Chunker=ChunkNorris, Embedding Model=Snowflake, Embedding Parameters=109M2025.11 | 40 | 22 | |
| ChunkNorrisParser=ChunkNorris, Chunker=RC, Embedding Model=Snowflake, Embedding Parameters=23M2025.11 | 39 | 25 | |
| Open-Parse-PParser=Open-Parse-P, Chunker=Page, Embedding Model=Snowflake, Embedding Parameters=23M2025.11 | 39 | 36 | |
| Open-Parse-PParser=Open-Parse-P, Chunker=RC, Embedding Model=Snowflake, Embedding Parameters=23M2025.11 | 39 | 33 | |
| Open-Parse-PParser=Open-Parse-P, Chunker=Open-Parse, Embedding Model=Snowflake, Embedding Parameters=305M2025.11 | 39 | 31 | |
| Open-Parse-UParser=Open-Parse-U, Chunker=RC, Embedding Model=Snowflake, Embedding Parameters=23M2025.11 | 36 | 28 | |
| DoclingParser=Docling, Chunker=Docling, Embedding Model=Snowflake, Embedding Parameters=23M2025.11 | 35 | 20 | |
| DoclingParser=Docling, Chunker=Page, Embedding Model=Snowflake, Embedding Parameters=23M2025.11 | 34 | 20 | |
| ChunkNorrisParser=ChunkNorris, Chunker=RC, Embedding Model=Snowflake, Embedding Parameters=109M2025.11 | 33 | 21 | |
| MarkerParser=Marker, Chunker=RC, Embedding Model=Snowflake, Embedding Parameters=23M2025.11 | 32 | 21 | |
| ChunkNorrisParser=ChunkNorris, Chunker=Page, Embedding Model=Snowflake, Embedding Parameters=109M2025.11 | 32 | 22 | |
| MarkerParser=Marker, Chunker=Page, Embedding Model=Snowflake, Embedding Parameters=23M2025.11 | 31 | 20 | |
| Open-Parse-PParser=Open-Parse-P, Chunker=Page, Embedding Model=Snowflake, Embedding Parameters=109M2025.11 | 31 | 23 | |
| Open-Parse-PParser=Open-Parse-P, Chunker=RC, Embedding Model=Snowflake, Embedding Parameters=109M2025.11 | 30 | 21 | |
| Open-Parse-UParser=Open-Parse-U, Chunker=Page, Embedding Model=Snowflake, Embedding Parameters=109M2025.11 | 30 | 21 | |
| Open-Parse-PParser=Open-Parse-P, Chunker=Open-Parse, Embedding Model=Snowflake, Embedding Parameters=23M2025.11 | 28 | 20 | |
| Open-Parse-UParser=Open-Parse-U, Chunker=RC, Embedding Model=Snowflake, Embedding Parameters=109M2025.11 | 28 | 18 | |
| Open-Parse-UParser=Open-Parse-U, Chunker=Open-Parse, Embedding Model=Snowflake, Embedding Parameters=23M2025.11 | 25 | 17 | |
| MarkerParser=Marker, Chunker=RC, Embedding Model=Snowflake, Embedding Parameters=109M2025.11 | 25 | 15 | |
| PyPDFParser=PyPDF, Chunker=Page, Embedding Model=Snowflake, Embedding Parameters=23M2025.11 | 24 | 18 | |
| PyPDFParser=PyPDF, Chunker=RC, Embedding Model=Snowflake, Embedding Parameters=23M2025.11 | 24 | 18 | |
| MarkerParser=Marker, Chunker=Page, Embedding Model=Snowflake, Embedding Parameters=109M2025.11 | 22 | 14 | |
| DoclingParser=Docling, Chunker=Page, Embedding Model=Snowflake, Embedding Parameters=109M2025.11 | 20 | 13 | |
| DoclingParser=Docling, Chunker=RC, Embedding Model=Snowflake, Embedding Parameters=23M2025.11 | 18 | 11 | |
| Open-Parse-PParser=Open-Parse-P, Chunker=Open-Parse, Embedding Model=Snowflake, Embedding Parameters=109M2025.11 | 18 | 12 | |
| DoclingParser=Docling, Chunker=RC, Embedding Model=Snowflake, Embedding Parameters=109M2025.11 | 17 | 10 | |
| Open-Parse-UParser=Open-Parse-U, Chunker=Open-Parse, Embedding Model=Snowflake, Embedding Parameters=109M2025.11 | 17 | 10 | |
| PyPDFParser=PyPDF, Chunker=RC, Embedding Model=Snowflake, Embedding Parameters=109M2025.11 | 17 | 13 | |
| DoclingParser=Docling, Chunker=Docling, Embedding Model=Snowflake, Embedding Parameters=109M2025.11 | 15 | 12 | |
| PyPDFParser=PyPDF, Chunker=Page, Embedding Model=Snowflake, Embedding Parameters=109M2025.11 | 15 | 13 |