Retrieval on MRAMG-Bench reconstructed single-document setting
90.77Top-1 Hit RateCHOP
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| CHOPChunking Strategy=CHOP, Embedding Model=text-embedding-3-large, Embedding Dimension=3072, Vector Database=ChromaDB, Index Type=HNSW, Similarity Metric=Cosine similarity, Backbone LLM=Gemma-12B, Temperature=02026.04 | 90.77 | 96.41 | 93.25 | 93.8 | 98.21 | 93.68 | 93.8 | 99.23 | 93.81 | 92.91 | |
| Native-500TChunking Strategy=Native-500T, Embedding Model=text-embedding-3-large, Embedding Dimension=3072, Vector Database=ChromaDB, Index Type=HNSW, Similarity Metric=Cosine similarity, Backbone LLM=Gemma-12B, Temperature=02026.04 | 81.28 | 91.03 | 85.51 | 86.56 | 94.87 | 86.37 | 87.16 | 97.44 | 86.76 | 86.98 | |
| Cosine-ChunkingChunking Strategy=Cosine-Chunking, Embedding Model=text-embedding-3-large, Embedding Dimension=3072, Vector Database=ChromaDB, Index Type=HNSW, Similarity Metric=Cosine similarity, Backbone LLM=Gemma-12B, Temperature=02026.04 | 70.77 | 89.74 | 79.44 | 83.09 | 94.36 | 80.52 | 84.42 | 98.46 | 81.1 | 83.89 |