Knowledge Retrieval on STARK MAG official (test)
44.36Hit@1AVATAR
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| AVATAR2024.06 | 44.36 | 59.66 | 50.63 | 51.15 | |
| Reflexion2024.06 | 40.71 | 54.44 | 49.55 | 47.06 | |
| AVATAR-CAblation=Removes the comparator2024.06 | 33.25 | 52.17 | 47.88 | 41.34 | |
| ReAct2024.06 | 31.07 | 49.49 | 47.03 | 39.25 | |
| ada-0022024.06 | 29.08 | 49.61 | 48.36 | 38.62 | |
| multi-ada-0022024.06 | 25.92 | 50.43 | 50.8 | 36.94 | |
| QAGNN2024.06 | 12.88 | 39.01 | 46.97 | 29.12 | |
| DPR2024.06 | 10.51 | 35.23 | 42.11 | 21.34 |