Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Real-LLM dataset and benchmarks · SOTA2 Research

Research Datasets

Real-LLM

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

A4 divergence attack defense

Real-LLM 8 targets × 3 phrasings full stack late 2025/2026 (val)

88ISR (Attack-Induced)

14

A1 shortcut attack defense

Real-LLM 8 targets × 3 phrasings full stack late 2025/2026 (val)

0Attack-Induced ISR

14

Specification Revision Conformance

combined real-LLM corpus

-10Mean Difference (Delta)

6

Real-LLM pacing benchmark GPT-4.1 (15 episodes (5 × 3 seeds))

100Success Rate

4

Popular tasks

LLM Pacing Specification Revision Conformance A1 shortcut attack defense A4 divergence attack defense

Follow for updates

Join SOTA2 Contact