Medical Question Answering on MedAgentsBench
59.55MedBullets ScoreGSEM
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| GSEMBackbone=Qwen3.5-35B2026.03 | 59.55 | 77.02 | 41 | 29 | 41 | 69.24 | |
| Mem0gBackbone=Qwen3.5-35B2026.03 | 58.43 | 76.8 | 36 | 21 | 41 | 64.25 | |
| VanillaBackbone=Qwen3.5-35B2026.03 | 55.06 | 74.62 | 41 | 27 | 40 | 66.74 | |
| Mem0Backbone=Qwen3.5-35B2026.03 | 53.93 | 76.8 | 36 | 21 | 30 | 59.94 | |
| GraphRAGBackbone=Qwen3.5-35B2026.03 | 52.81 | 72 | 43 | 21 | 30 | 61 | |
| A-MemBackbone=Qwen3.5-35B2026.03 | 52.81 | 71.99 | 38 | 23 | 36 | 65.46 | |
| ReMeBackbone=Qwen3.5-35B2026.03 | 51.69 | 76.38 | 35 | 26 | 36 | 67.2 | |
| Mem0gBackbone=DeepSeek-V3.22026.03 | 50.56 | 74.62 | 37 | 29 | 27 | 63.19 | |
| Naïve RAGBackbone=Qwen3.5-35B2026.03 | 50.56 | 76.37 | 43 | 24 | 35 | 65.38 | |
| GSEMBackbone=DeepSeek-V3.22026.03 | 49.43 | 74.84 | 41 | 34 | 27 | 70.9 | |
| VanillaBackbone=DeepSeek-V3.22026.03 | 48.31 | 74.62 | 40 | 28 | 31 | 64.78 | |
| A-MemBackbone=DeepSeek-V3.22026.03 | 48.31 | 72.43 | 36 | 26 | 32 | 69.01 | |
| Naïve RAGBackbone=DeepSeek-V3.22026.03 | 47.19 | 74.84 | 38 | 29 | 27 | 68.56 | |
| ReMeBackbone=DeepSeek-V3.22026.03 | 47.19 | 74.18 | 37 | 27 | 27 | 68.03 | |
| FLEXBackbone=DeepSeek-V3.22026.03 | 43.82 | 70.72 | 30 | 24 | 19 | 66.06 | |
| GraphRAGBackbone=DeepSeek-V3.22026.03 | 42.7 | 68.93 | 38 | 27 | 24 | 65.61 | |
| FLEXBackbone=Qwen3.5-35B2026.03 | 40.45 | 60.61 | 24 | 13 | 22 | 56.01 | |
| Mem0Backbone=DeepSeek-V3.22026.03 | 39.32 | 73.74 | 36 | 26 | 29 | 62.96 |