System and method for precise image inpainting to remove unwanted content from digital images

    公开(公告)号:US11526967B2

    公开(公告)日:2022-12-13

    申请号:US16950835

    申请日:2020-11-17

    Abstract: An inpainting method includes retrieving image information at an electronic device, where the image information identifies an area within an image. The method also includes retrieving, using the electronic device, semantic information including a plurality of semantic classes and a semantic class distribution for each semantic class of the plurality of semantic classes. The method further includes generating semantic codes associated with different portions of the image based on the image information and the semantic information. In addition, the method includes constructing the area within the image by generating image content based on the semantic information.

    SYSTEM AND METHOD FOR INDOOR IMAGE INPAINTING UNDER MULTIMODAL STRUCTURAL GUIDANCE

    公开(公告)号:US20220301117A1

    公开(公告)日:2022-09-22

    申请号:US17504221

    申请日:2021-10-18

    Abstract: An inpainting method includes obtaining image information at an electronic device, where the image information identifies an area corresponding to a removed object within an image. The method also includes reconstructing the area corresponding to the removed object by (i) applying a semantic mask and a surface normal map to identify and rank neighboring contexts of the area and (ii) sampling, using an attention mechanism, the ranked contexts to generate pixel information for the area. The method further includes rendering the image with the reconstructed area.

    VISUAL OBJECT INSTANCE SEGMENTATION USING FOREGROUND-SPECIALIZED MODEL IMITATION

    公开(公告)号:US20210407090A1

    公开(公告)日:2021-12-30

    申请号:US16946504

    申请日:2020-06-24

    Abstract: A method includes training, using at least one processor, a specialized teacher model to perform visual object instance segmentation in order to segment and classify objects in first training images. The first training images contain foreground objects without backgrounds. The method also includes training, using the at least one processor, a student model to perform visual object instance segmentation in order to segment and classify objects in second training images. The second training images contain the foreground objects and the backgrounds. Training the student model includes using selected outputs of the specialized teacher model. The method further includes deploying the trained student model to perform visual object instance segmentation in an external device.

    SYSTEM AND METHOD FOR PRECISE IMAGE INPAINTING TO REMOVE UNWANTED CONTENT FROM DIGITAL IMAGES

    公开(公告)号:US20210158491A1

    公开(公告)日:2021-05-27

    申请号:US16950835

    申请日:2020-11-17

    Abstract: An inpainting method includes retrieving image information at an electronic device, where the image information identifies an area within an image. The method also includes retrieving, using the electronic device, semantic information including a plurality of semantic classes and a semantic class distribution for each semantic class of the plurality of semantic classes. The method further includes generating semantic codes associated with different portions of the image based on the image information and the semantic information. In addition, the method includes constructing the area within the image by generating image content based on the semantic information.

    SYSTEM AND METHOD FOR IMAGE INPAINTING BASED ON LAYOUT-GUIDED PRE-PROCESSING ATTENTION MECHANISM

    公开(公告)号:US20220156896A1

    公开(公告)日:2022-05-19

    申请号:US17503169

    申请日:2021-10-15

    Abstract: An inpainting method includes obtaining an image including an object having a delicate shape and identifying a target region within the image, where the target region is adjacent to the object. The method also includes using a first mask to separate the image into a number of semantic categories and aggregating neighboring contexts for the target region based on the semantic categories. The method further includes restoring, based on the aggregated contexts, textures in the target region without affecting the delicate shape of the object. In addition, the method includes displaying a refined image including the restored textures in the target region and the object.

Patent Agency Ranking