RAG Question Answering on Musique
20.5F1 ScoreFirecrawl Extract
Evaluation Results
| Method | Links | |
|---|---|---|
| Firecrawl Extractanswer model=Gemma3-27B-it, Avg. Tokens=13192025.12 | 20.5 | |
| Qwen3-4B + promptanswer model=Gemma3-27B-it, Avg. Tokens=25632025.12 | 15.23 | |
| IndexLM-0.6Banswer model=Gemma3-27B-it, Avg. Tokens=19662025.12 | 15.17 | |
| IndexLM-4Banswer model=Gemma3-27B-it, Avg. Tokens=19282025.12 | 14.93 | |
| IndexLM-1.7Banswer model=Gemma3-27B-it, Avg. Tokens=20432025.12 | 14.32 | |
| Qwen3-4B + promptanswer model=Qwen3-4B, Avg. Tokens=25632025.12 | 12.64 | |
| Chunk-Rerankanswer model=Gemma3-27B-it, Avg. Tokens=40942025.12 | 12.28 | |
| Firecrawl Extractanswer model=Qwen3-4B, Avg. Tokens=13192025.12 | 11.85 | |
| IndexLM-4Banswer model=Qwen3-4B, Avg. Tokens=19282025.12 | 10.94 | |
| HtmlRAGanswer model=Gemma3-27B-it, Avg. Tokens=35622025.12 | 10.94 | |
| IndexLM-1.7Banswer model=Qwen3-4B, Avg. Tokens=20432025.12 | 10.58 | |
| IndexLM-0.6Banswer model=Qwen3-4B, Avg. Tokens=19662025.12 | 10.56 | |
| HtmlRAGanswer model=Qwen3-4B, Avg. Tokens=35622025.12 | 10.01 | |
| ReaderLM-v2answer model=Gemma3-27B-it, Avg. Tokens=40002025.12 | 8.75 | |
| Markdown (raw)answer model=Gemma3-27B-it, Avg. Tokens=40962025.12 | 8.24 | |
| ReaderLM-v2answer model=Qwen3-4B, Avg. Tokens=40002025.12 | 7.94 | |
| Chunk-Rerankanswer model=Qwen3-4B, Avg. Tokens=40942025.12 | 7.09 | |
| Markdown (raw)answer model=Qwen3-4B, Avg. Tokens=40962025.12 | 6.71 | |
| HTML (raw)answer model=Qwen3-4B, Avg. Tokens=40962025.12 | 5.43 | |
| HTML (raw)answer model=Gemma3-27B-it, Avg. Tokens=40962025.12 | 4.2 |