Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Magpie dataset and benchmarks · SOTA2 Research

Research Datasets

Magpie

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Multi-agent Sequential Communication

MAGPIE

88Privacy Score

10

MAGPIE

98.8AUROC

8

Magpie Out-of-Domain

63.53LPM Score

7

Magpie Out-of-Domain

74.08AUROC

7

Multi-agent latent communication privacy and utility

MAGPIE Graph

80Privacy

5

Multi-agent latent communication privacy and utility

MAGPIE Hierarchical

82Privacy

5

Magnetic Indoor Localization

MagPie Loomis building

1.07MAE

4

Magnetic Indoor Localization

MagPie Talbot building

0.64MAE

4

Magnetic Indoor Localization

MagPie CSL building

0.21MAE

4

Popular tasks

Magnetic Indoor Localization LLM Routing Multi-agent latent communication privacy and utility Idioms Multi-agent Sequential Communication

Follow for updates

Join SOTA2 Contact