Question Answering on WebCPM (test)
27.45ROUGE-LMeta-chunker-1.5B
Evaluation results
| Method | Links | |
|---|---|---|
| Meta-chunker-1.5BChunking Method=Meta-chunker, Backbone=Qwen2.5-1.5B2025.03 | 27.45 | |
| LumberChunkerChunking Method=Model-based (Qwen2.5-14B)2025.03 | 27.3 | |
| Qwen2.5-72BChunking Method=Direct LLM Inference, Backbone=Qwen2.5-72B2025.03 | 26.93 | |
| Semantic ChunkingChunking Method=Semantic-based2025.03 | 26.91 | |
| Qwen2.5-14BChunking Method=Direct LLM Inference, Backbone=Qwen2.5-14B2025.03 | 26.91 | |
| OriginalChunking Method=Rule-based/Original2025.03 | 26.42 | |
| Llama_indexChunking Method=LlamaIndex default2025.03 | 26.3 |