公开(公告)号：US20230252658A1

公开(公告)日：2023-08-10

申请号：US17650027

申请日：2022-02-04

Applicant: QUALCOMM Incorporated

Inventor： Hong CAI ,  Shichong PENG ,  Janarbek MATAI ,  Jamie Menjay LIN ,  Debasmit DAS ,  Fatih Murat PORIKLI

IPC: G06T7/50 ,  G06T7/10 ,  G06N3/04

CPC classification number: G06T7/50 ,  G06T7/10 ,  G06N3/0454 ,  G06T2207/20084 ,  G06T2207/20212

Abstract: Certain aspects of the present disclosure provide techniques for generating fine depth maps for images of a scene based on semantic segmentation and segment-based refinement neural networks. An example method generally includes generating, through a segmentation neural network, a segmentation map based on an image of a scene. The segmentation map generally comprises a map segmenting the scene into a plurality of regions, and each region of the plurality of regions is generally associated with one of a plurality of categories. A first depth map of the scene is generated through a first depth neural network based on a depth measurement of the scene. A second depth map of the scene is generated through a depth refinement neural network based on the segmentation map and the first depth map. One or more actions are taken based on the second depth map of the scene.