Chunking Strategy Evaluation for RAG on QASC Evaluation Set (5-fold cross-validation)
85PrecisionQASC
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| QASCLatency (ms)=380 ± 502026.04 | 85 | 83 | 85 | 80 | 87 | |
| Semantic ChunkingLatency (ms)=340 ± 452026.04 | 78 | 75 | 76 | 72 | 79 | |
| Agentic ChunkingLatency (ms)=2,850 ± 6202026.04 | 76 | 73 | 74 | 70 | 77 | |
| FixedChunk Size=500, Latency (ms)=110 ± 102026.04 | 74 | 70 | 72 | 67 | 74 | |
| Recursive SplittingLatency (ms)=118 ± 132026.04 | 74 | 71 | 72 | 68 | 75 | |
| FixedChunk Size=700, Latency (ms)=108 ± 112026.04 | 73 | 69 | 71 | 66 | 72 | |
| FixedChunk Size=300, Latency (ms)=115 ± 122026.04 | 72 | 68 | 70 | 65 | 73 | |
| FixedChunk Size=1000, Latency (ms)=105 ± 102026.04 | 71 | 67 | 69 | 64 | 70 | |
| FixedChunk Size=150, Latency (ms)=120 ± 152026.04 | 70 | 65 | 67 | 62 | 71 |