Question Answering on DiaASQ (test)
50LLM-as-a-Judge ScorePersonalAI
Evaluation results
| Method | Links | |
|---|---|---|
| PersonalAILLM=GPT4o-mini, Retrieval algorithm=BeamSearch + WaterCircles, Graph restriction=episodic vertices excluded2025.06 | 50 | |
| PersonalAILLM=DeepSeek V3, Retrieval algorithm=BeamSearch + WaterCircles, Graph restriction=object vertices excluded2025.06 | 47 | |
| PersonalAILLM=Qwen2.5 7B, Retrieval algorithm=BeamSearch, Graph restriction=no restrictions2025.06 | 22 | |
| PersonalAILLM=Llama3.1 8B, Retrieval algorithm=BeamSearch, Graph restriction=episodic vertices excluded2025.06 | 19 | |
| PersonalAILLM=DeepSeek R1 7B, Retrieval algorithm=A*, Graph restriction=episodic vertices excluded2025.06 | 12 |