Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

HotPot dataset and benchmarks · SOTA2 Research

Research Datasets

HotPot

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Hotpot (test)

60.9AUARC

25

Retrieval-Augmented Generation

Hotpot ENKB5 (In-Domain Average)

86.51Language Consistency

15

Question Answering

ADVHOTPOT

82.4Accuracy

12

Selective Question Answering

HOTPOT

92.5Area under Coverage-F1

12

Cross-lingual Retrieval-Augmented Generation

Hotpot-ENKB5 (all)

86.54Language Consistency (ALL-AVG)

11

Retrieval-Augmented Generation

Hotpot-ENKB5 v1 (Indonesian)

69.36Language Consistency

11

Question Answering

HotPot D2 (test)

96.1Macro F1

11

Retrieval Question Answering

HotPot

47.7MRR

6

Information Retrieval

Hotpot BEIR

0.687nDCG

5

Multi-hop Question Answering

Hotpot Kimi

54.07EM

4

Retrieval Question Answering

HotPot (in-domain)

63.8MRR

4

Retrieval-Augmented Generation

Hotpot-ENKB5 (Korean)

99.73Language Consistency

3

Error Detection and Recovery

Hotpot Robot Data (test)

5Recovery Success Ratio

3

Human-Robot Interaction

Hotpot

10Successes

2

Popular tasks

Retrieval-Augmented Generation Question Answering Retrieval Question Answering Multi-hop Question Answering Information Retrieval

Follow for updates

Join SOTA2 Contact