Knowledge Retrieval on STARK Amazon official (test)
49.87Hit@1AVATAR
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| AVATAR2024.06 | 49.87 | 69.16 | 60.57 | 58.7 | |
| Reflexion2024.06 | 42.79 | 65.05 | 54.7 | 52.91 | |
| ReAct2024.06 | 42.14 | 64.56 | 50.81 | 52.3 | |
| AVATAR-CAblation=Removes the comparator2024.06 | 40.92 | 63.63 | 53.68 | 51.73 | |
| multi-ada-0022024.06 | 40.07 | 64.98 | 55.12 | 51.55 | |
| ada-0022024.06 | 39.16 | 62.73 | 51.29 | 50.35 | |
| QAGNN2024.06 | 26.56 | 50.01 | 52.05 | 37.75 | |
| DPR2024.06 | 15.29 | 47.93 | 44.49 | 30.2 |