Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Locomo dataset and benchmarks – Page 2 · SOTA2 Research

Research Datasets

Locomo

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Long-term Question Answering

LoCoMo

44.24Multi-Hop F1

27

Long-term dialogue memory

LoCoMo (test)

84.23Accuracy

27

Long-term Dialogue

LoCoMo (test)

70.57Multi-Hop Accuracy

26

Memory-Augmented Question Answering

LoCoMo Multi-hop

49.61Token F1

25

Memory-augmented Question Answering

LoCoMo

92.6Accuracy (Temporal)

25

Long-context Memory

LOCOMO

48.88F1 Score

25

LoCoMo

30.18Accuracy

25

LoCoMo

21.7Execution Time (min)

25

Dialogue-Style Memory Reasoning

LoCoMo

59.98EM

24

Question Answering

LoCoMo (test)

96.08Single-hop Score

24

Membership Inference Attack

LoCoMo

99ROC-AUC

24

Lifelong Memory Question Answering

LoCoMo

40.36MultiHop BLEU

24

LoCoMo

71.99F1 Score

24

Long-context Memory Question Answering

LoCoMo 1.0 (test)

58.11Single Hop F1

24

Question Answering

LoCoMo-10

81.91Multi-hop Accuracy (Cat1)

24

Single-hop Question Answering

LoCoMo Single-Hop

50.45F1 Score

24

Open-domain Question Answering

LoCoMo Open-Domain

32.6F1 Score

24

Open-Domain Question Answering

LoCoMo Open-Domain (test)

15.12F1 Score

24

Temporal Question Answering

LoCoMo Temporal (test)

44.09F1 Score

24

Single-Hop Question Answering

LoCoMo Single-Hop (test)

37.9F1

24

Multi-Hop Question Answering

LoCoMo Multi-Hop (test)

26.55F1 Score

24

Overall Performance

LoCoMo

48.7BLEU

24

Memory-Augmented Question Answering

LoCoMo Average

36.91Mean Token-F1

23

Memory-Augmented Question Answering

LoCoMo Open-domain

44.79Mean Token F1

23

Memory-Augmented Question Answering

LoCoMo Temporal

20.77Token F1

23

Page 2 of 10

Popular tasks

Question Answering Long-context Question Answering Conversational Question Answering Long-context Conversational Question Answering Long-horizon Question Answering

Follow for updates

Join SOTA2 Contact