-
公开(公告)号:US20240386575A1
公开(公告)日:2024-11-21
申请号:US18526875
申请日:2023-12-01
Applicant: SAMSUNG ELECTRONICS CO., LTD.
Inventor: Jing Zhu , Karim Ahmed , Wenbo Li , Yilin Shen , Hongxia Jin
Abstract: Provided is a method and apparatus for obtaining a foreground image from an input image containing the foreground object in a scene. Embodiments use multi-scale convolutional attention values, one or more hamburger heads and one or more multilayer perceptrons to obtain a segmentation map of the input image. In some embodiments, progressive segmentation is applied to obtain the segmentation map.
-
公开(公告)号:US20240080423A1
公开(公告)日:2024-03-07
申请号:US18057126
申请日:2022-11-18
Applicant: Samsung Electronics Co., Ltd.
Inventor: Wenbo Li , Zhipeng Mo , Yi Wei , Burak Uzkent , Qian Lou , Yilin Shen , Hongxia Jin
IPC: H04N9/64
CPC classification number: H04N9/64
Abstract: A method includes obtaining raw image data, where the raw image data includes data values each having most significant bits and least significant bits. The method also includes providing the raw image data to a trained machine learning model and generating processed image data using the trained machine learning model. The method further includes presenting an image based on the processed image data. The trained machine learning model is trained to modulate a feature map associated with the most significant bits of the data values of the raw image data based on the least significant bits of the data values of the raw image data in order to generate a fusion of the most significant bits and the least significant bits of the data values of the raw image data.
-
3.
公开(公告)号:US11526967B2
公开(公告)日:2022-12-13
申请号:US16950835
申请日:2020-11-17
Applicant: Samsung Electronics Co., Ltd.
Inventor: Wenbo Li , Hongxia Jin
Abstract: An inpainting method includes retrieving image information at an electronic device, where the image information identifies an area within an image. The method also includes retrieving, using the electronic device, semantic information including a plurality of semantic classes and a semantic class distribution for each semantic class of the plurality of semantic classes. The method further includes generating semantic codes associated with different portions of the image based on the image information and the semantic information. In addition, the method includes constructing the area within the image by generating image content based on the semantic information.
-
公开(公告)号:US20220301117A1
公开(公告)日:2022-09-22
申请号:US17504221
申请日:2021-10-18
Applicant: Samsung Electronics Co., Ltd.
Inventor: Wenbo Li , Hongxia Jin
Abstract: An inpainting method includes obtaining image information at an electronic device, where the image information identifies an area corresponding to a removed object within an image. The method also includes reconstructing the area corresponding to the removed object by (i) applying a semantic mask and a surface normal map to identify and rank neighboring contexts of the area and (ii) sampling, using an attention mechanism, the ranked contexts to generate pixel information for the area. The method further includes rendering the image with the reconstructed area.
-
公开(公告)号:US20210407090A1
公开(公告)日:2021-12-30
申请号:US16946504
申请日:2020-06-24
Applicant: Samsung Electronics Co., Ltd.
Inventor: Dawei Li , Wenbo Li , Hongxia Jin
Abstract: A method includes training, using at least one processor, a specialized teacher model to perform visual object instance segmentation in order to segment and classify objects in first training images. The first training images contain foreground objects without backgrounds. The method also includes training, using the at least one processor, a student model to perform visual object instance segmentation in order to segment and classify objects in second training images. The second training images contain the foreground objects and the backgrounds. Training the student model includes using selected outputs of the specialized teacher model. The method further includes deploying the trained student model to perform visual object instance segmentation in an external device.
-
6.
公开(公告)号:US20210158491A1
公开(公告)日:2021-05-27
申请号:US16950835
申请日:2020-11-17
Applicant: Samsung Electronics Co., Ltd.
Inventor: Wenbo Li , Hongxia Jin
Abstract: An inpainting method includes retrieving image information at an electronic device, where the image information identifies an area within an image. The method also includes retrieving, using the electronic device, semantic information including a plurality of semantic classes and a semantic class distribution for each semantic class of the plurality of semantic classes. The method further includes generating semantic codes associated with different portions of the image based on the image information and the semantic information. In addition, the method includes constructing the area within the image by generating image content based on the semantic information.
-
公开(公告)号:US12081880B2
公开(公告)日:2024-09-03
申请号:US17493268
申请日:2021-10-04
Applicant: SAMSUNG ELECTRONICS CO., LTD.
Inventor: Jing Zhu , Wenbo Li , Hongxia Jin
IPC: H04N23/951 , G06T5/20 , G06T5/50 , G06T5/75
CPC classification number: H04N23/951 , G06T5/20 , G06T5/50 , G06T5/75 , G06T2207/20016
Abstract: A super resolution is produced using multiple reference images. Reference images are upsampled and blurred as needed for comparison between images of different resolution. Patches in blurred images are searched to find those patches which can be assembled into vectors for improving feature content over multiple resolution levels. The searches are based on similarity maps. The assembled vectors are concatenated with one or more other vectors, up-converted and then passed through convolutional layers to obtain new feature vectors. A final feature vector is passed through a convolutional layer to obtain the super resolution image.
-
公开(公告)号:US11620737B2
公开(公告)日:2023-04-04
申请号:US17504221
申请日:2021-10-18
Applicant: Samsung Electronics Co., Ltd.
Inventor: Wenbo Li , Hongxia Jin
IPC: G06K9/00 , G06T5/00 , G06K9/62 , G06V10/22 , G06V30/262
Abstract: An inpainting method includes obtaining image information at an electronic device, where the image information identifies an area corresponding to a removed object within an image. The method also includes reconstructing the area corresponding to the removed object by (i) applying a semantic mask and a surface normal map to identify and rank neighboring contexts of the area and (ii) sampling, using an attention mechanism, the ranked contexts to generate pixel information for the area. The method further includes rendering the image with the reconstructed area.
-
9.
公开(公告)号:US20220156896A1
公开(公告)日:2022-05-19
申请号:US17503169
申请日:2021-10-15
Applicant: Samsung Electronics Co., Ltd.
Inventor: Wenbo Li , Hongxia Jin
Abstract: An inpainting method includes obtaining an image including an object having a delicate shape and identifying a target region within the image, where the target region is adjacent to the object. The method also includes using a first mask to separate the image into a number of semantic categories and aggregating neighboring contexts for the target region based on the semantic categories. The method further includes restoring, based on the aggregated contexts, textures in the target region without affecting the delicate shape of the object. In addition, the method includes displaying a refined image including the restored textures in the target region and the object.
-
10.
公开(公告)号:US20240070955A1
公开(公告)日:2024-02-29
申请号:US18057117
申请日:2022-11-18
Applicant: Samsung Electronics Co., Ltd.
Inventor: Wenbo Li , Yi Wei , Jing Zhu , Hongxia Jin
CPC classification number: G06T13/80 , G06T7/246 , G06T7/70 , G06V10/82 , G06V40/171 , G06V40/176 , G06T2207/10016 , G06T2207/30201 , G06V2201/10
Abstract: A method includes obtaining a source image of a user and obtaining a driving video in which a face or a head of the user is moving. The method also includes generating metadata identifying animations to be applied to the source image so that the source image mimics at least some movements of the user's face or head in the driving video. The method further includes transmitting the source image and the metadata to an end user device configured to animate the source image based on the metadata. Generating the metadata includes suppressing one or more artifacts associated with one or more objects that temporarily occlude at least a portion of the user's head or body in the driving video or that temporarily appear in the driving video.
-
-
-
-
-
-
-
-
-