Question Answering on CS (EM/F1)
37.45F1 ScoreGraph-R1 (3B)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Graph-R1 (3B)Base Model=Qwen2.5-3B-Instruct, Evaluation Protocol=Zero-Shot Results Without Domain Training2025.07 | 37.45 | 27.54 | |
| HyperGraphRAGBase Model=GPT-4o-mini2025.07 | 31.3 | — | |
| StandardRAGBase Model=GPT-4o-mini2025.07 | 28.93 | — | |
| PathRAGBase Model=GPT-4o-mini2025.07 | 26.73 | — | |
| Search-R1 (3B)Base Model=Qwen2.5-3B-Instruct, Evaluation Protocol=Zero-Shot Results Without Domain Training2025.07 | 25.39 | 17.97 | |
| GraphRAGBase Model=GPT-4o-mini2025.07 | 23.33 | — | |
| LightRAGBase Model=GPT-4o-mini2025.07 | 22.72 | — | |
| NaiveGenerationBase Model=GPT-4o-mini2025.07 | 18.65 | — | |
| HippoRAG2Base Model=GPT-4o-mini2025.07 | 17.34 | — |