Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Instruction Following research benchmarks – Page 14 · SOTA2 Research

Instruction Following

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

90.9Accuracy

6

Jul 1, 2026

78.3Accuracy

6

Jul 1, 2026

LiveBench IFEval

100Quality

6

Jun 26, 2026

π0.5 SAM (Ours)

56.7Goal Success Rate

6

Jun 23, 2026

π0.5 SAM (Ours)

42.4Object Success Rate

6

Jun 23, 2026

76.5Hard-Prompt Avg Score

6

Jun 4, 2026

89.4IFEval avg@4

6

Jun 4, 2026

36.13IFEVAL Score

6

Jun 2, 2026

92.8Instruct vs. Pretrained Win Rate

6

May 29, 2026

ALFRED unseen (val)

Ours (multiple views)

9.7Task Success Rate

6

May 26, 2026

ALFRED seen (val)

Ours (multiple views)

33.7Task Success Rate

6

May 26, 2026

P2D† + P2D‡

32.89ROUGE-L

6

May 22, 2026

Human Instructions

0.22Accuracy

6

May 14, 2026

Llama 3.1 8B + EAGLE3

3.59Acceptance Length

6

May 12, 2026

27Pass@1

6

Apr 15, 2026

Stanford Alpaca (val)

1.05Validation Loss

6

Apr 10, 2026

Qwen3.5-397B-A17B

9.7Genuine Followup Rate

6

Apr 3, 2026

Konkani-Instruct-100k Kannada 1.0 (test)

4.05LLM-as-a-Judge Score

6

Mar 26, 2026

Konkani-Instruct-100k Devanagari 1.0 (test)

4.4Overall LLM-as-a-Judge Score

6

Mar 26, 2026

Konkani-Instruct-100k Romi 1.0 (test)

4.4Overall LLM-as-a-Judge Score

6

Mar 26, 2026

Unnatural Instructions (test)

38.07ROUGE-L

6

Mar 5, 2026

Instruction-Following Alpaca-V2 Arena-Hard

9.2Alpaca V2 Score

6

Mar 4, 2026

ELI5 prompts Gemma-7B-it 200 tokens (test)

1.778Perplexity

6

Feb 26, 2026

15.04Average Score

6

Feb 26, 2026

5.68MT-Bench (ja) Score

6

Feb 26, 2026

Page 14 of 19

Popular datasets

IFEval AlpacaEval IFBench MT-Bench Alpaca

Follow for updates

Join SOTA2 Contact