公开(公告)号：US20230043464A1

公开(公告)日：2023-02-09

申请号：US17969992

申请日：2022-10-20

Applicant: HUAWEI TECHNOLOGIES CO., LTD.

Inventor： Jifei SONG ,  Benjamin BUSAM ,  Eduardo PEREZ PELLITERO ,  Gregory SLABAUGH ,  Ales LEONARDIS

IPC: G06T7/593 ,  H04N13/15 ,  H04N13/257 ,  H04N13/239 ,  H04N13/271 ,  H04N9/04

Abstract: The present disclosure relates to methods and devices for performing depth estimation on image data. In one example, a device performs depth estimation on first and second images captured using one or more cameras having a color filter array. Each, image of the first and second images comprises multiple color channels. Each color channel of the multiple color channels corresponds to a respective color channel of the color filter array. The, device performs the depth estimation by estimating disparity from the color channels of the first and second images.

公开(公告)号：US20220006998A1

公开(公告)日：2022-01-06

申请号：US17479911

申请日：2021-09-20

Applicant: HUAWEI TECHNOLOGIES CO., LTD.

Inventor： Benjamin BUSAM ,  Matthieu HOG ,  Steven George MCDONAGH ,  Gregory SLABAUGH

IPC: H04N13/128 ,  G06T7/593 ,  G06N20/00

Abstract: An image processing device comprising a processor configured to generate a refocused image from an input image and an map indicating depth information for the image, by the steps of: for each of a plurality of planes associated with respective depths within the image: generating a depth mask having values indicating whether regions of the input image are within a specified range of the plane, wherein an assessment of whether a region is within the specified range of the plane is made through the evaluation of a differentiable function of the range between regions of the input image and the plane as determined from the map; generating a masked image from the input image and the generated depth mask; refocusing the masked image using a blurring kernel to generate a refocused partial image; and generating the refocussed image from the plurality of refocussed partial images.

公开(公告)号：US20220245922A1

公开(公告)日：2022-08-04

申请号：US17726684

申请日：2022-04-22

Applicant: HUAWEI TECHNOLOGIES CO., LTD.

Inventor： Axel BARROSO LAGUNA ,  Yannick VERDIE ,  Benjamin BUSAM ,  Ales LEONARDIS ,  Gregory SLABAUGH

IPC: G06V10/44 ,  G06V10/82 ,  G06V10/25 ,  G06V10/774

Abstract: The technology of this application related to an image processor comprising a plurality of modules, the plurality of modules comprising a first module and a second module, wherein the image processor is configured to receive an input image and output a plurality of mathematical descriptors for characteristic regions of the input image. The first module is configured to implement a first trained artificial intelligence model to detect a set of characteristic regions in the input image; and the second module is configured to implement a second trained artificial intelligence model to determine a mathematical descriptor for each of said set of characteristic regions. The first and second trained artificial intelligence models are collectively trained end to end.

公开(公告)号：US20220245841A1

公开(公告)日：2022-08-04

申请号：US17726668

申请日：2022-04-22

Applicant: HUAWEI TECHNOLOGIES CO., LTD.

Inventor： Adrian LOPEZ RODRIGUEZ ,  Benjamin BUSAM ,  Gregory SLABAUGH ,  Ales LEONARDIS

IPC: G06T7/50 ,  G06N20/00

Abstract: A method for training an environmental analysis system, the method comprising: receiving a data model of an environment; forming, in dependence on the data model, a first training input comprising a visual stream representing the environment as viewed from a plurality of locations; forming, in dependence on the data model, a second training input comprising a depth stream representing depths of objects in the environment relative to the plurality of locations; forming a third training input, the third training input being sparser than the second training input; and estimating, using the analysis system, in dependence on the first and third training inputs, a series of depths at less sparsity than the third training input; and adapting the analysis system in dependence on a comparison between the estimated series of depths and the second training input.

公开(公告)号：US20220222839A1

公开(公告)日：2022-07-14

申请号：US17586034

申请日：2022-01-27

Applicant: HUAWEI TECHNOLOGIES CO., LTD.

Inventor： Benjamin BUSAM ,  Patrick RUHKAMP ,  Matthieu HOG ,  Yannick VERDIE ,  Ales LEONARDIS ,  Gregory SLABAUGH

IPC: G06T7/514

Abstract: An image processing system configured to receive an input time-of-flight depth map representing the distance of objects in an image from a camera at a plurality of locations of pixels in the respective image, and in dependence on that map to generate an improved time-of-flight depth map for the image, the input time-of-flight depth map having been generated from at least one correlation image representing the overlap between emitted and reflected light signals at the plurality of locations of pixels at a given phase shift, the system being configured to generate the improved time-of-flight depth map from the input time-of-flight depth map in dependence on a colour representation of the respective image and at least one correlation image.

公开(公告)号：US20220295030A1

公开(公告)日：2022-09-15

申请号：US17743216

申请日：2022-05-12

Applicant: Huawei Technologies Co., Ltd.

Inventor： Daniel HERNANDEZ ,  Sarah PARISOT ,  Ales LEONARDIS ,  Gregory SLABAUGH ,  Steven George MCDONAGH

IPC: H04N9/73 ,  G06V10/60 ,  G06V10/56 ,  H04N9/64 ,  G06V10/774 ,  G06V10/82 ,  G06V10/762 ,  G06V10/764

Abstract: A device for estimating a scene illumination color for a source image is configured to: determine a set of candidate illuminants and for each of the candidate illuminants, determine a respective correction of the source image; for each of the candidate illuminants, apply the respective correction to the source image to form a corresponding set of corrected images; for each corrected image from the set of corrected images, implement a trained data-driven model to estimate a respective probability of achromaticity of the respective corrected image; and based on the estimated probabilities of achromaticity for the set of corrected images, obtain a final estimate of the scene illumination color for the source image. This approach allows for the evaluation of multiple candidate illuminates to determine an estimate of the scene illumination color.

公开(公告)号：US20220270346A1

公开(公告)日：2022-08-25

申请号：US17742704

申请日：2022-05-12

Applicant: HUAWEI TECHNOLOGIES CO., LTD.

Inventor： Francesca BABILONI ,  Ioannis MARRAS ,  Gregory SLABAUGH ,  Stefanos ZAFEIRIOU

IPC: G06V10/42 ,  G06V40/16 ,  G06V10/77 ,  G06V10/82

Abstract: An image processing device for identifying one or more characteristics of an input image, the device including a processor configured to: receive the input image, the input image extending along a first axis and a second axis; form a series of attribute maps based on the received input image; perform a first correlation operation by identifying regions in respect of which the patterns of multiple ones of the series of attribute maps are correlated, and forming a first output in dependence on that operation; perform a second correlation operation for identifying combinations of (i) attributes and (ii) portions of the image having common location in terms of the first axis, and forming a second output in dependence on that operation; and form a representation of the one or more characteristics of the input image in dependence on at least the first output and the second output.

公开(公告)号：US20220005159A1

公开(公告)日：2022-01-06

申请号：US17480548

申请日：2021-09-21

Applicant: HUAWEI TECHNOLOGIES CO., LTD.

Inventor： Hao GUAN ,  Gregory SLABAUGH ,  Liu LIU ,  Sean MORAN ,  Zhongqian FU

IPC: G06T5/00

Abstract: One example image processing device is provided. The example image processing device can include at least one processor and one or more memories coupled to the at least one processor and storing programming instructions for execution by the at least one processor to estimate noise in an image, the image being represented by a set of pixels and each pixel of the set of pixels having a value associated with it on each of one or more channels, where estimating the noise comprises processing, using a first trained model that detects stochastic noise, data derived from the image to form a first noise estimate, processing, using a second trained model that detects extreme pixel values, data derived from the image to form a second noise estimate, and combining the first and second noise estimates to form an aggregated noise estimate.

公开(公告)号：US20230033458A1

公开(公告)日：2023-02-02

申请号：US17955846

申请日：2022-09-29

Applicant: HUAWEI TECHNOLOGIES CO., LTD.

Inventor： Zeju LI ,  Liang CHEN ,  Gregory SLABAUGH ,  Liu LIU ,  Zhongqian FU

IPC: G06V10/774 ,  G06V10/22 ,  G06V10/776 ,  G06T5/00 ,  G06V10/82 ,  G06T3/40

Abstract: A device comprising an image processor, the image processor being configured to implement: a first machine learning model for performing restoration processing on degraded image data; and a second machine learning model for recognizing areas of an image requiring processing emphasis during the restoration processing; wherein the output of the second machine learning model is an input to the first machine learning model to optimize the restoration processing.

公开(公告)号：US20220301114A1

公开(公告)日：2022-09-22

申请号：US17831578

申请日：2022-06-03

Applicant: HUAWEI TECHNOLOGIES CO., LTD.

Inventor： Ioannis MARRAS ,  Ioannis ALEXIOU ,  Gregory SLABAUGH ,  Stefanos ZAFEIRIOU

IPC: G06T5/00 ,  G06T5/50 ,  G06N3/08

Abstract: An apparatus for denoising an image, the apparatus having a processor configured to receive an input image, implement a trained artificial intelligence model to form an estimate of a noise pattern in the input image and form an output image by subtracting the estimate of the noise pattern from the input image, the model being configured to form the estimate of the noise pattern such that the estimate of the noise pattern is representative of a noise pattern that is characteristic to a specific image sensor type.