# Instruction Editing on Qualitative Capability Suite

Source: [Instruction Editing on Qualitative Capability Suite](<https://www.sota2.com/research/sota/instruction-editing-on-qualitative-capability-suite>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:21:51.372Z

Evaluation suite assessing model performance across diverse instruction editing capabilities, including addition, removal, replacement, stylization, attribute manipulation, special effects, video matting, multi-image editing, and subject-driven editing.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Instruction Editing |
| Dataset (including any stated split) | Qualitative Capability Suite |
| Metric | Addition Success |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 0 of 0 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Addition Success](<https://www.sota2.com/research/sota/instruction-editing-on-qualitative-capability-suite.md?metric=Addition%20Success>): Higher is better; unit: SCALAR.

- [Removal Success](<https://www.sota2.com/research/sota/instruction-editing-on-qualitative-capability-suite.md?metric=Removal%20Success>): Higher is better; unit: SCALAR.

- [Replacement Success](<https://www.sota2.com/research/sota/instruction-editing-on-qualitative-capability-suite.md?metric=Replacement%20Success>): Higher is better; unit: SCALAR.

- [Stylization Success](<https://www.sota2.com/research/sota/instruction-editing-on-qualitative-capability-suite.md?metric=Stylization%20Success>): Higher is better; unit: SCALAR.

- [Attribute Manipulation Success](<https://www.sota2.com/research/sota/instruction-editing-on-qualitative-capability-suite.md?metric=Attribute%20Manipulation%20Success>): Higher is better; unit: SCALAR.

- [Special Effects Success](<https://www.sota2.com/research/sota/instruction-editing-on-qualitative-capability-suite.md?metric=Special%20Effects%20Success>): Higher is better; unit: SCALAR.

- [Video Matting Success](<https://www.sota2.com/research/sota/instruction-editing-on-qualitative-capability-suite.md?metric=Video%20Matting%20Success>): Higher is better; unit: SCALAR.

- [Multi-image Editing Success](<https://www.sota2.com/research/sota/instruction-editing-on-qualitative-capability-suite.md?metric=Multi-image%20Editing%20Success>): Higher is better; unit: SCALAR.

- [Subject-driven Editing Success](<https://www.sota2.com/research/sota/instruction-editing-on-qualitative-capability-suite.md?metric=Subject-driven%20Editing%20Success>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Addition Success | Result date | Report paper |
| --- | --- | --- | --- |

Page 1 of 1. This is an index page, not the full collection.
