METHOD AND SYSTEM FOR REPLACING SCENE TEXT IN A VIDEO SEQUENCE

    公开(公告)号:US20230005108A1

    公开(公告)日:2023-01-05

    申请号:US17363293

    申请日:2021-06-30

    摘要: To replace text in a digital video image sequence, a system will process frames of the sequence to: define a region of interest (ROI) with original text in each of the frames; use the ROIs to select a reference frame from the sequence; select a target frame from the sequence; determine a transform function between the ROI of the reference frame and the ROI of the target frame; replace the original text in the ROI of the reference frame with replacement text to yield a modified reference frame ROI; and use the transform function to transform the modified reference frame ROI to a modified target frame ROI in which the original text is replaced with the replacement text. The system will then insert the modified target frame ROI into the target frame to produce a modified target frame. This process may repeat for other target frames of the sequence.

    System and method for synthetic image generation with localized editing

    公开(公告)号:US11508169B2

    公开(公告)日:2022-11-22

    申请号:US16737702

    申请日:2020-01-08

    摘要: Embodiments described herein provide a system for generating synthetic images with localized editing. During operation, the system obtains a source image and a target image for image synthesis and selects a semantic element from the source image. The semantic element indicates a semantically meaningful part of an object depicted in the source image. The system then determines the style information associated with the source and target images. Subsequently, the system generates a synthetic image by transferring the style of the semantic element from the source image to the target image based on the feature representations. In this way, the system can facilitate localized editing of the target image.

    Method and system for removing scene text from images

    公开(公告)号:US11423597B2

    公开(公告)日:2022-08-23

    申请号:US17123841

    申请日:2020-12-16

    摘要: Methods of removing text from digital video or still images are disclosed. An image processing system receives an input image set defining a region of interest (ROI) that contains text. The system determines an input background color for the ROI. The system applies a text infilling function to remove text from the ROI to yield a preliminary output image set. The system may determine a residual corrective signal that corresponds to a measurement of background color error between the input set and the preliminary output set. The system may apply the residual corrective signal to the ROI in the preliminary output set to yield a final output set that does not contain the text. Alternatively, the system may remove background from the ROI of the input set before text infilling, then return background to the ROI after the text infilling.

    Image realism predictor
    18.
    发明授权

    公开(公告)号:US11068746B2

    公开(公告)日:2021-07-20

    申请号:US16235697

    申请日:2018-12-28

    IPC分类号: G06K9/62 G06K9/00 G06T7/00

    摘要: A method for predicting the realism of an object within an image includes generating a training image set for a predetermined object type. The training image set comprises one or more training images at least partially generated using a computer. A pixel level training spatial realism map is generated for each training image of the one or more training images. Each training spatial realism map configured to represent a perceptual realism of the corresponding training image. A predictor is trained using the training image set and the corresponding training spatial realism maps. An image of the predetermined object is received. A spatial realism map of the received image is produced using the trained predictor.