# PortraVec: Image-Based Portrait Vectorization with Text-Guided Manipulation

Source: [PortraVec: Image-Based Portrait Vectorization with Text-Guided Manipulation](<https://www.sota2.com/research/paper/68fa75141e209131cea65969>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-30T05:00:12.460Z

Authors: Yiqi Liang, Ying Liu, Dandan Long, Ruihui Li

Published: 2024-10-05T14:55:53.000Z

## Abstract

While portrait sketch generation is a special task in sketch synthesis, most existing methods are pixel-based, limiting their interpretability and editability. With the rise of vector generation techniques, representing sketches using vector elements may provide more flexible manipulation. However, due to the overlapping nature of vector graphics and the coarse detail modeling, existing vectorization methods struggle to capture facial integrity and fine-grained details, and lack semantic control. To address these issues, we propose PortraVec, a framework for converting pixel-based portrait images into vector sketches with text control. Specifically, we propose a two-stage image-guided generation module using Attention-aware Offset Sampling to capture face structure while correcting detail deviations, and a text-guided manipulation module based on Region-based Parameter Freezing to enable local semantic editing while maintaining global consistency. Experiments show that PortraVec achieves superior structural consistency, visual fidelity, and semantic controllability compared to state-of-the-art methods.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Image-guided portrait sketch generation on CelebA-HQ 1024x1024 (randomly sampled 50 images)](<https://www.sota2.com/research/sota/image-guided-portrait-sketch-generation-on-celeba-hq-1024x1024-randomly-sampled-50-images.md>): Image-guided portrait sketch generation; CelebA-HQ 1024x1024 (randomly sampled 50 images); LPIPS: 0.539.

- [Text-guided Portrait Sketch Manipulation on CelebA-HQ Full Image](<https://www.sota2.com/research/sota/text-guided-portrait-sketch-manipulation-on-celeba-hq-full-image.md>): Text-guided portrait sketch manipulation; CelebA-HQ Full Image; Accuracy: 79.8.

- [Text-guided portrait sketch manipulation on CelebA-HQ Region of Interest](<https://www.sota2.com/research/sota/text-guided-portrait-sketch-manipulation-on-celeba-hq-region-of-interest.md>): Text-guided portrait sketch manipulation; CelebA-HQ Region of Interest; Accuracy: 80.8.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2410.04182>)

[PDF](<https://arxiv.org/pdf/2410.04182.pdf>)
