Multi-turn Editing on InstrEdit-Bench
0.0914Diff-BLEU (Code)FineEdit-Pro
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| FineEdit-ProVersion=Pro2025.12 | 0.0914 | 0.25 | 0.0511 | 0.4446 | 0.2093 | 0.2554 | 0.3729 | 0.1008 | 0.5858 | 0.3287 | |
| FineEdit-XVersion=X2025.12 | 0.0843 | 0.2077 | 0.0515 | 0.3379 | 0.1704 | 0.2077 | 0.3106 | 0.1006 | 0.4704 | 0.2723 | |
| HyperEdit (qwen-2.5-3B)Backbone=Qwen-2.5-3B2025.12 | 0.0809 | 0.3894 | 0.0547 | 0.4665 | 0.2479 | 0.2132 | 0.5182 | 0.1084 | 0.6083 | 0.362 | |
| Llama-3.2-1BModel Size=1B2025.12 | 0.08 | 0.1991 | 0.0836 | 0.3377 | 0.1735 | 0.2093 | 0.3252 | 0.1613 | 0.4711 | 0.2917 | |
| Llama-3.2-3BModel Size=3B2025.12 | 0.0772 | 0.2187 | 0.0898 | 0.3222 | 0.177 | 0.2124 | 0.3493 | 0.1731 | 0.4581 | 0.2982 | |
| Qwen-2.5-3B-InstructModel Size=3B, Variant=Instruct2025.12 | 0.0631 | 0.1934 | 0.0374 | 0.3822 | 0.169 | 0.1677 | 0.3056 | 0.084 | 0.5124 | 0.2674 | |
| Qwen-3-8BModel Size=8B2025.12 | 0.0524 | 0.2022 | 0.0372 | 0.3925 | 0.1711 | 0.1444 | 0.3117 | 0.0753 | 0.528 | 0.2649 | |
| Llama-3.1-8B-InstructModel Size=8B, Variant=Instruct2025.12 | 0.0506 | 0.1869 | 0.0267 | 0.2989 | 0.1408 | 0.1496 | 0.2965 | 0.0602 | 0.4219 | 0.2321 |