公开(公告)号：WO2023023464A1

公开(公告)日：2023-02-23

申请号：PCT/US2022/074867

申请日：2022-08-11

Applicant: QUALCOMM INCORPORATED

Inventor： DENG, Yan ,  SARKIS, Michel Adib ,  BI, Ning ,  KUO, Chieh-Ming

IPC: G06T17/00

Abstract: Systems and techniques are provided for performing video-based activity recognition. For example, a process can include generating a three-dimensional (3D) model of a first portion of an object based on one or more frames depicting the object. The process can also include generating a mask for the one or more frames, the mask including an indication of one or more regions of the object. The process can further include generating a 3D base model based on the 3D model of the first portion of the object and the mask, the 3D base model representing the first portion of the object and a second portion of the object. The process can include generating, based on the mask and the 3D base model, a 3D model of the second portion of the object.

公开(公告)号：WO2021252145A1

公开(公告)日：2021-12-16

申请号：PCT/US2021/032705

申请日：2021-05-17

Applicant: QUALCOMM INCORPORATED

Inventor： LIU, Peng ,  WANG, Lei ,  WANG, Zhen ,  CHENG, Ke-Li ,  BI, Ning

IPC: G06K9/00 ,  G06K9/46 ,  G06K9/62 ,  G06K9/6256 ,  G06K9/6274 ,  G06T11/001 ,  G06T17/20 ,  G06T19/20 ,  G06T2207/20084 ,  G06T2207/20132 ,  G06T2207/30201 ,  G06T2219/2016 ,  G06T7/50 ,  G06T7/70 ,  G06V10/454 ,  G06V20/64 ,  G06V40/161 ,  G06V40/171

Abstract: Systems and techniques are provided for facial image augmentation. An example method can include obtaining a first image capturing a face. Using the first image, the method can determine, using a prediction model, a UV face position map including a two-dimensional (2D) representation of a three-dimensional (3D) structure of the face. The method can generate, based on the UV face position map, a 3D model of the face. The method can generate an extended 3D model of the face by extending the 3D model to include region(s) beyond a boundary of the 3D model. The region(s) can include a forehead region, a region surrounding at least a portion of the face, and/or other region. The method can generate, based on the extended 3D model, a second image depicting the face in a rotated position relative to a position of the face in the first image.

公开(公告)号：WO2019083738A1

公开(公告)日：2019-05-02

申请号：PCT/US2018/055544

申请日：2018-10-12

Applicant: QUALCOMM INCORPORATED

Inventor： CHEN, Ying ,  ZHOU, Yang ,  NAGARAJAN, Karthik ,  BI, Ning

IPC: G06K9/00

Abstract: Techniques and systems are provided for tracking objects in one or more video frames. For example, a first set of one or more bounding regions are determined for a video frame based on a trained classification network applied to the video frame. The first set of one or more bounding regions are associated with one or more objects in the video frame. One or more blobs can be detected for the video frame. A blob includes pixels of at least a portion of an object in the video frame. A second set of one or more bounding regions are determined for the video frame that are associated with the one or more blobs. A final set of one or more bounding regions is determined for the video frame using the first set of one or more bounding regions and the second set of one or more bounding regions. Object tracking can then be performed for the video frame using the final set of one or more bounding regions.

公开(公告)号：WO2018031098A1

公开(公告)日：2018-02-15

申请号：PCT/US2017/034982

申请日：2017-05-30

Applicant: QUALCOMM INCORPORATED

Inventor： CHEN, Ying ,  BI, Ning ,  WANG, Lei ,  GAO, Jinglun

IPC: G06T7/11 ,  G06T7/254 ,  G06T7/194 ,  G06T7/136

CPC classification number: G06K9/4642 ,  G06K9/00711 ,  G06K9/38 ,  G06T7/11 ,  G06T7/136 ,  G06T7/194 ,  G06T7/254 ,  G06T2207/10016 ,  G06T2207/30232 ,  G06T2207/30242

Abstract: Techniques and systems are provided for processing video data. For example, techniques and systems are provided for determining blob size thresholds. Blob sizes of blobs generated for a video frame can be determined. A lower boundary of a category of blob sizes can then be determined that corresponds to a minimum blob size of the video frame. The lower boundary is determined from a plurality of possible blob sizes including the blob sizes of the blobs and one or more other possible blob sizes. One of the possible blob sizes is determined as the lower boundary when one or more lower boundary conditions are met by characteristics of the possible blob size. A blob size threshold for the video frame is assigned as the minimum blob size corresponding to the lower boundary.

Abstract translation: 提供了用于处理视频数据的技术和系统。 例如，提供了用于确定团块大小阈值的技术和系统。 可以确定为视频帧生成的斑点大小。 然后可以确定对应于视频帧的最小斑点大小的斑点大小类别的下边界。 下边界由多个可能的斑点大小确定，包括斑点的斑点大小和一个或多个其他可能的斑点大小。 当可能的斑点大小的特征符合一个或多个下边界条件时，可能的斑点大小之一被确定为下边界。 视频帧的斑点大小阈值被分配为对应于下边界的最小斑点大小。

公开(公告)号：WO2018026427A1

公开(公告)日：2018-02-08

申请号：PCT/US2017/034574

申请日：2017-05-25

Applicant: QUALCOMM INCORPORATED

Inventor： CHEN, Ying ,  WANG, Lei ,  GAO, Jinglun ,  BI, Ning

IPC: G06T7/155 ,  G06T7/194

CPC classification number: G06K9/00711 ,  G06K9/00771 ,  G06K9/38 ,  G06K2009/00738 ,  G06T5/004 ,  G06T5/30 ,  G06T7/11 ,  G06T7/155 ,  G06T7/194 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/20012 ,  G06T2207/20024 ,  G06T2207/20036 ,  G06T2207/20192

Abstract: Techniques and systems are provided for processing video data. For example, techniques and systems are provided for performing content-adaptive morphology operations. A first erosion function can be performed on a foreground mask of a video frame, including setting one or more foreground pixels of the frame to one or more background pixels. A temporary foreground mask can be generated based on the first erosion function being performed on the foreground mask. One or more connected components can be generated for the frame by performing connected component analysis to connect one or more neighboring foreground pixels. A complexity of the frame (or of the foreground mask of the frame) can be determined by comparing a number of the one or more connected components to a threshold number. A second erosion function can be performed on the temporary foreground mask when the number of the one or more connected components is higher than the threshold number. The one or more connected components can be output for blob processing when the number of the one or more connected components is lower than the threshold number.

Abstract translation: 提供了用于处理视频数据的技术和系统。 例如，提供用于执行内容自适应形态学操作的技术和系统。 可以在视频帧的前景蒙板上执行第一侵蚀函数，包括将该帧的一个或多个前景像素设置为一个或多个背景像素。 可以基于在前景蒙版上执行的第一侵蚀函数来生成临时前景蒙版。 通过执行连接分量分析来连接一个或多个相邻的前景像素，可以为该帧生成一个或多个连接的分量。 可以通过将一个或多个连接组件的数量与阈值数量进行比较来确定帧（或帧的前景掩码）的复杂度。 当一个或多个连通分量的数量高于阈值数量时，可以在临时前景掩模上执行第二侵蚀函数。 当一个或多个连接组件的数量低于阈值数量时，可以输出一个或多个连接的组件用于斑点处理。

公开(公告)号：WO2017200721A1

公开(公告)日：2017-11-23

申请号：PCT/US2017/029417

申请日：2017-04-25

Applicant: QUALCOMM INCORPORATED

Inventor： FORUTANPOUR, Bijan ,  WANG, Ye-Kui ,  NGUYEN, Phi Hung ,  BI, Ning

IPC: H04N19/597 ,  H04N5/225 ,  H04N5/262 ,  H04N5/232

Abstract: Provided are systems, methods, and computer-readable medium for including parameters that describe fisheye images in a 360-degree video with the 360-degree video. The 360-degree video can then be stored and/or transmitted as captured by the omnidirectional camera, without transforming the fisheye images into some other format. The parameters can later be used to map the fisheye images to an intermediate format, such as an equirectangular format. The intermediate format can be used to store, transmit, and/or display the 360-degree video. The parameters can alternatively or additionally be used to map the fisheye images directly to a format that can be displayed in a 360-degree video presentation, such as a spherical format.

Abstract translation: 提供用于包括用360度视频描述360度视频中的鱼眼图像的参数的系统，方法和计算机可读介质。 然后360度视频可以被全方位摄像机捕获和/或传输，而无需将鱼眼图像转换为其他格式。 这些参数稍后可用于将鱼眼图像映射为中间格式，例如等矩形格式。 中间格式可用于存储，传输和/或显示360度视频。 这些参数可以替代地或附加地用于将鱼眼图像直接映射到可以以360度视频呈现（诸如球形格式）显示的格式。

公开(公告)号：WO2016073102A1

公开(公告)日：2016-05-12

申请号：PCT/US2015/054009

申请日：2015-10-05

Applicant: QUALCOMM INCORPORATED

Inventor： YANG, Ruiduo ,  WU, Xinzhou ,  GUO, Feng ,  BI, Ning

IPC: H04N5/232

CPC classification number: G03B13/36 ,  H04N5/23206 ,  H04N5/23212 ,  H04W64/003

Abstract: Methods and apparatus for capturing an image using an automatic focus are disclosed herein. In one aspect, a method is disclosed which includes communicating, using a camera, with a wireless device via a wireless communication network. The method further includes determining a distance between the camera and the wireless device using the wireless communication network and adjusting a focus of the camera based upon the determined distance. Finally, the method includes capturing an image using the adjusted focus of the camera. In some aspects, this method may be done on a smartphone or digital camera which includes Wi-Fi capabilities.

Abstract translation: 本文公开了使用自动对焦来拍摄图像的方法和装置。 在一个方面，公开了一种方法，其包括使用相机经由无线通信网络与无线设备进行通信。 该方法还包括使用无线通信网络确定摄像机和无线设备之间的距离，并且基于所确定的距离来调整摄像机的焦点。 最后，该方法包括使用相机的调整焦点拍摄图像。 在某些方面，该方法可以在包括Wi-Fi功能的智能电话或数码相机上完成。

公开(公告)号：WO2015199969A2

公开(公告)日：2015-12-30

申请号：PCT/US2015/034860

申请日：2015-06-09

Applicant: QUALCOMM INCORPORATED

Inventor： YANG, Ruiduo ,  QUAN, Shuxue ,  BI, Ning

IPC: A61K8/31

CPC classification number: G06T11/001 ,  G06T5/008 ,  G06T5/50 ,  G06T7/11 ,  G06T7/194 ,  G06T2207/10024 ,  H04N5/2351 ,  H04N5/2353 ,  H04N5/243

Abstract: The disclosed technology relates to image-capturing methods. In one aspect, a method includes receiving an image frame comprising a plurality of pixels and subtracting foreground pixels from the image frame to obtain background pixels. The method additionally includes determining an exposure condition for a next image frame based on at least a subset of the background pixels. The method further includes adjusting the foreground pixels such that a difference between a background luma value and a foreground luma value of the next image frame is within a predetermined range. Aspects are also directed to apparatuses configured for the methods.

Abstract translation: 所公开的技术涉及图像捕获方法。 一方面，一种方法包括接收包括多个像素的图像帧并从图像帧中减去前景像素以获得背景像素。 该方法还包括基于背景像素的至少一个子集确定下一图像帧的曝光条件。 该方法还包括调整前景像素，使得背景亮度值与下一图像帧的前景亮度值之间的差在预定范围内。 方面还涉及为方法配置的装置。

公开(公告)号：WO2014178975A1

公开(公告)日：2014-11-06

申请号：PCT/US2014/032355

申请日：2014-03-31

Applicant: QUALCOMM INCORPORATED

Inventor： CHAO, Hui ,  CHEN, Jiajian ,  BI, Ning

IPC: G06T7/20 ,  G06T7/00

CPC classification number: G06K9/00624 ,  G06T7/20 ,  G06T7/80

Abstract: Methods, systems, computer-readable media, and apparatuses for image-based status determination are presented. In some embodiments, a method includes capturing at least one image of a moving path. At least one feature within the at least one image is analyzed and based on the analysis of the at least one feature, a direction of movement of the moving path is determined. In some embodiments, a method includes capturing an image of an inclined path. At least one feature within the image is analyzed and based on analysis of the at least one feature, a determination is made whether the image was captured from a top position relative to the inclined path or a bottom position relative to the inclined path.

Abstract translation: 提出了用于基于图像的状态确定的方法，系统，计算机可读介质和装置。 在一些实施例中，一种方法包括捕获移动路径的至少一个图像。 分析至少一个图像内的至少一个特征，并且基于至少一个特征的分析，确定移动路径的移动方向。 在一些实施例中，一种方法包括捕获倾斜路径的图像。 分析图像内的至少一个特征，并且基于对至少一个特征的分析，确定图像是从相对于倾斜路径的顶部位置或相对于倾斜路径的底部位置被捕获的。

公开(公告)号：WO2012173821A1

公开(公告)日：2012-12-20

申请号：PCT/US2012/040922

申请日：2012-06-05

Applicant: QUALCOMM INCORPORATED ,  QI, Yingyong ,  BI, Ning ,  ZHANG, Xuerui

Inventor： QI, Yingyong ,  BI, Ning ,  ZHANG, Xuerui

IPC: G06T7/20

CPC classification number: G06K9/00536 ,  G06T7/20 ,  G06T2207/20012

Abstract: Embodiments include methods and systems which determine pixel displacement between frames based on a respective weighting-value for each pixel or a group of pixels. The weighting-values provide an indication as to which pixels are more pertinent to optical flow computations. Computational resources and effort can be focused on pixels with higher weights, which are generally more pertinent to optical flow determinations.

Abstract translation: 实施例包括基于每个像素或一组像素的相应加权值来确定帧之间的像素位移的方法和系统。 加权值提供关于哪些像素与光流计算更相关的指示。 计算资源和努力可以集中在具有较高权重的像素上，这通常与光流测定更相关。