Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Open-ended instruction following research benchmarks · SOTA2 Research

Open-ended instruction following

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

Audio-OpenHermes

SEA-LION-v3-8B-IT

4.44EN Score

10

Mar 10, 2026

AlpacaEval Audio

SEA-LION-v3-8B-IT

4.59EN Score

10

Mar 10, 2026

BPO Eval (test)

BPO + Vicuna-v1.3 13B

59.5Win Rate (A)

7

Feb 26, 2026

BPO + Llama-2-chat 13B (Cross-size)

54A Win Rate

7

Feb 26, 2026

Self-instruct Eval

BPO + Llama-2-chat 7B

53.6Win Rate (A)

7

Feb 26, 2026

Vicuna Eval v1.3 (test)

BPO + Vicuna-v1.3 7B

65A Win Rate

7

Feb 26, 2026

48.12Average Accuracy

6

Jun 11, 2026

58.1Win Rate

3

Jun 4, 2026

Arena-Hard-Auto v2.0

51.8Win Rate (Response)

3

Jun 4, 2026

LC AlpacaEval 2.0

59.2Response Win-rate

3

Jun 4, 2026

AlpacaEval GPT-5.2-judged (test)

64.4Win Rate

3

May 27, 2026

Popular datasets

AlpacaEval Dolly Vicuna SuperNI Self-Instruct

Follow for updates

Join SOTA2 Contact