公开(公告)号：US20230273357A1

公开(公告)日：2023-08-31

申请号：US18311086

申请日：2023-05-02

Applicant: HUAWEI TECHNOLOGIES CO., LTD.

Inventor： Ales LEONARDIS ,  Yannick VERDIE ,  Benjamin BUSAM ,  Steven George MCDONAGH ,  Barnabé MAS

IPC: G02B5/30 ,  G06T7/50 ,  G06V10/74 ,  G06V10/82

CPC classification number: G02B5/30 ,  G06T7/50 ,  G06V10/761 ,  G06V10/82

Abstract: An image processing apparatus for estimating a depth field over a field of view. The apparatus comprises one or more processors configured to receive a captured polarisation image representing a polarisation of light received at a first set of multiple locations over the field of view; process the captured polarisation image using a first trained neural network to form a first estimate of depths to one or more locations over the field of view; receive ranging data representing environmental distances from a datum to one or more locations over the field of view; and process the ranging data using a second trained neural network to form a second estimate of depths to a second set of multiple locations over the field of view.

公开(公告)号：US20230267678A1

公开(公告)日：2023-08-24

申请号：US18311053

申请日：2023-05-02

Applicant: HUAWEI TECHNOLOGIES CO., LTD.

Inventor： Pedro Vieira de CASTRO ,  Manolis VASILEIADIS ,  Ales LEONARDIS ,  Benjamin BUSAM

IPC: G06T15/50 ,  G06T1/20 ,  G06T7/50

CPC classification number: G06T15/506 ,  G06T1/20 ,  G06T7/50 ,  G06T2207/10024 ,  G06T2207/10028 ,  G06T2207/20084

Abstract: A device comprising an image processor apparatus, the image processor apparatus being configured for implementing an image based computational model as part of an end-to-end processing pipeline. The device is configured to operate by receiving colour-specific image data representing a scene, receiving depth data of the scene, processing the colour-specific image data using the image based computational model to form a feature map of the scene, and forming in dependence on the feature map and the depth data an illumination map representing an estimation of the illumination on a set of three-dimensional locations in the scene.

公开(公告)号：US20230043464A1

公开(公告)日：2023-02-09

申请号：US17969992

申请日：2022-10-20

Applicant: HUAWEI TECHNOLOGIES CO., LTD.

Inventor： Jifei SONG ,  Benjamin BUSAM ,  Eduardo PEREZ PELLITERO ,  Gregory SLABAUGH ,  Ales LEONARDIS

IPC: G06T7/593 ,  H04N13/15 ,  H04N13/257 ,  H04N13/239 ,  H04N13/271 ,  H04N9/04

Abstract: The present disclosure relates to methods and devices for performing depth estimation on image data. In one example, a device performs depth estimation on first and second images captured using one or more cameras having a color filter array. Each, image of the first and second images comprises multiple color channels. Each color channel of the multiple color channels corresponds to a respective color channel of the color filter array. The, device performs the depth estimation by estimating disparity from the color channels of the first and second images.

公开(公告)号：US20220006998A1

公开(公告)日：2022-01-06

申请号：US17479911

申请日：2021-09-20

Applicant: HUAWEI TECHNOLOGIES CO., LTD.

Inventor： Benjamin BUSAM ,  Matthieu HOG ,  Steven George MCDONAGH ,  Gregory SLABAUGH

IPC: H04N13/128 ,  G06T7/593 ,  G06N20/00

Abstract: An image processing device comprising a processor configured to generate a refocused image from an input image and an map indicating depth information for the image, by the steps of: for each of a plurality of planes associated with respective depths within the image: generating a depth mask having values indicating whether regions of the input image are within a specified range of the plane, wherein an assessment of whether a region is within the specified range of the plane is made through the evaluation of a differentiable function of the range between regions of the input image and the plane as determined from the map; generating a masked image from the input image and the generated depth mask; refocusing the masked image using a blurring kernel to generate a refocused partial image; and generating the refocussed image from the plurality of refocussed partial images.

公开(公告)号：US20220245922A1

公开(公告)日：2022-08-04

申请号：US17726684

申请日：2022-04-22

Applicant: HUAWEI TECHNOLOGIES CO., LTD.

Inventor： Axel BARROSO LAGUNA ,  Yannick VERDIE ,  Benjamin BUSAM ,  Ales LEONARDIS ,  Gregory SLABAUGH

IPC: G06V10/44 ,  G06V10/82 ,  G06V10/25 ,  G06V10/774

Abstract: The technology of this application related to an image processor comprising a plurality of modules, the plurality of modules comprising a first module and a second module, wherein the image processor is configured to receive an input image and output a plurality of mathematical descriptors for characteristic regions of the input image. The first module is configured to implement a first trained artificial intelligence model to detect a set of characteristic regions in the input image; and the second module is configured to implement a second trained artificial intelligence model to determine a mathematical descriptor for each of said set of characteristic regions. The first and second trained artificial intelligence models are collectively trained end to end.

公开(公告)号：US20220245841A1

公开(公告)日：2022-08-04

申请号：US17726668

申请日：2022-04-22

Applicant: HUAWEI TECHNOLOGIES CO., LTD.

Inventor： Adrian LOPEZ RODRIGUEZ ,  Benjamin BUSAM ,  Gregory SLABAUGH ,  Ales LEONARDIS

IPC: G06T7/50 ,  G06N20/00

Abstract: A method for training an environmental analysis system, the method comprising: receiving a data model of an environment; forming, in dependence on the data model, a first training input comprising a visual stream representing the environment as viewed from a plurality of locations; forming, in dependence on the data model, a second training input comprising a depth stream representing depths of objects in the environment relative to the plurality of locations; forming a third training input, the third training input being sparser than the second training input; and estimating, using the analysis system, in dependence on the first and third training inputs, a series of depths at less sparsity than the third training input; and adapting the analysis system in dependence on a comparison between the estimated series of depths and the second training input.

公开(公告)号：US20220222839A1

公开(公告)日：2022-07-14

申请号：US17586034

申请日：2022-01-27

Applicant: HUAWEI TECHNOLOGIES CO., LTD.

Inventor： Benjamin BUSAM ,  Patrick RUHKAMP ,  Matthieu HOG ,  Yannick VERDIE ,  Ales LEONARDIS ,  Gregory SLABAUGH

IPC: G06T7/514

Abstract: An image processing system configured to receive an input time-of-flight depth map representing the distance of objects in an image from a camera at a plurality of locations of pixels in the respective image, and in dependence on that map to generate an improved time-of-flight depth map for the image, the input time-of-flight depth map having been generated from at least one correlation image representing the overlap between emitted and reflected light signals at the plurality of locations of pixels at a given phase shift, the system being configured to generate the improved time-of-flight depth map from the input time-of-flight depth map in dependence on a colour representation of the respective image and at least one correlation image.