Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Function Vector Evaluation research benchmarks · SOTA2 Research

Function Vector Evaluation

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

SemEval Zero-Shot

LLaMa-2 + vz Fine-tuned FV

65.86Avg Accuracy

12

Feb 27, 2026

Complex-Task Zero-Shot

LLaMa-3.1 + vz Fine-tuned FV

79.8Average Accuracy

12

Feb 27, 2026

Simple-Task Zero-Shot

LLaMa-3.1 + vz Fine-tuned FV

89.98Average Accuracy

12

Feb 27, 2026

Simple-Task Shuffled-Label

GPT-J + vz Fine-tuned FV

88.14Average Accuracy

12

Feb 27, 2026

Popular datasets

Simple-Task SemEval Complex-Task

Follow for updates

Join SOTA2 Contact