List your company

ResearchFormerly WizWand

HotPot

Benchmarks

TaskDatasetSOTA resultTrendResults

Hotpot (test)

60.9AUARC

25

Retrieval-Augmented Generation

Hotpot ENKB5 (In-Domain Average)

86.51Language Consistency

15

Question Answering

ADVHOTPOT

82.4Accuracy

12

Selective Question Answering

HOTPOT

92.5Area under Coverage-F1

12

Cross-lingual Retrieval-Augmented Generation

Hotpot-ENKB5 (all)

86.54Language Consistency (ALL-AVG)

11

Retrieval-Augmented Generation

Hotpot-ENKB5 v1 (Indonesian)

69.36Language Consistency

11

Question Answering

HotPot D2 (test)

96.1Macro F1

11

Retrieval Question Answering

HotPot

47.7MRR

6

Information Retrieval

Hotpot BEIR

0.687nDCG

5

Multi-hop Question Answering

Hotpot Kimi

54.07EM

4

Retrieval Question Answering

HotPot (in-domain)

63.8MRR

4

Retrieval-Augmented Generation

Hotpot-ENKB5 (Korean)

99.73Language Consistency

3

Error Detection and Recovery

Hotpot Robot Data (test)

5Recovery Success Ratio

3

Human-Robot Interaction

Hotpot

10Successes

2