Enhanced vectorization of raster images is described. An image vectorization module converts a raster image with bitmapped data to a vector image with vector elements based on mathematical formulas. In some embodiments, spatially-localized control of a vectorization operation is provided to a user. First, the user can adjust an intensity of a denoising operation differently at different areas of the raster image. Second, the user can adjust an automated segmentation by causing one segment to be split into two segments along a zone marked with an indicator tool, such as a brush. Third, the user can adjust an automated segmentation by causing two segments to be merged into a combined segment. The computation of the vector elements is based on the adjusted segmentation. In other embodiments, semantic information gleaned from the raster image is incorporated into the vector image to facilitate manipulation, such as joint selection of multiple vector elements.