公开(公告)号：US20110262001A1

公开(公告)日：2011-10-27

申请号：US12765292

申请日：2010-04-22

申请人： Ning Bi ,  Yingyong Qi ,  Qing Zhou

发明人： Ning Bi ,  Yingyong Qi ,  Qing Zhou

IPC分类号： G06K9/62 ,  H04N5/228 ,  G06K9/00

CPC分类号： G06K9/00234

摘要： In a particular illustrative embodiment, a method of determining a viewpoint of a person based on skin color area and face area is disclosed. The method includes receiving image data corresponding to an image captured by a camera, the image including at least one object to be displayed at a device coupled to the camera. The method further includes determining a viewpoint of the person relative to a display of the device coupled to the camera. The viewpoint of the person may be determined by determining a face area of the person based on a determined skin color area of the person and tracking a face location of the person based on the face area. One or more objects displayed at the display may be moved in response to the determined viewpoint of the person.

摘要翻译： 在具体的说明性实施例中，公开了一种基于皮肤颜色区域和面部区域来确定人的视点的方法。 该方法包括接收与由相机拍摄的图像相对应的图像数据，所述图像包括要耦合到相机的设备中要显示的至少一个对象。 该方法还包括确定人相对于耦合到相机的设备的显示的视点。 可以通过基于人的确定的皮肤颜色区域来确定人的脸部区域并且基于面部区域来跟踪人的面部位置来确定人的观点。 可以响应于所确定的人的观点而移动在显示器处显示的一个或多个对象。

公开(公告)号：US08553943B2

公开(公告)日：2013-10-08

申请号：US13160457

申请日：2011-06-14

申请人： Yingyong Qi ,  Ning Bi ,  Xuerui Zhang

发明人： Yingyong Qi ,  Ning Bi ,  Xuerui Zhang

IPC分类号： G06K9/00 ,  H04N7/18

CPC分类号： G06K9/00536 ,  G06T7/20 ,  G06T2207/20012

摘要： Embodiments include methods and systems which determine pixel displacement between frames based on a respective weighting-value for each pixel or a group of pixels. The weighting-values provide an indication as to which pixels are more pertinent to optical flow computations. Computational resources and effort can be focused on pixels with higher weights, which are generally more pertinent to optical flow determinations.

摘要翻译： 实施例包括基于每个像素或一组像素的相应加权值来确定帧之间的像素位移的方法和系统。 加权值提供关于哪些像素与光流计算更相关的指示。 计算资源和努力可以集中在具有较高权重的像素上，这通常与光流测定更相关。

公开(公告)号：US20120139906A1

公开(公告)日：2012-06-07

申请号：US13234028

申请日：2011-09-15

申请人： Xuerui Zhang ,  Ning Bi ,  Yingyong Qi

发明人： Xuerui Zhang ,  Ning Bi ,  Yingyong Qi

IPC分类号： G06T15/00

CPC分类号： G06T19/006 ,  H04N13/156

摘要： A three dimensional (3D) mixed reality system combines a real 3D image or video, captured by a 3D camera for example, with a virtual 3D image rendered by a computer or other machine to render a 3D mixed-reality image or video. A 3D camera can acquire two separate images (a left and a right) of a common scene, and superimpose the two separate images to create a real image with a 3D depth effect. The 3D mixed-reality system can determine a distance to a zero disparity plane for the real 3D image, determine one or more parameters for a projection matrix based on the distance to the zero disparity plane, render a virtual 3D object based on the projection matrix, combine the real image and the virtual 3D object to generate a mixed-reality 3D image.

摘要翻译： 三维（3D）混合现实系统将由3D摄像机捕获的真实3D图像或视频与由计算机或其他机器呈现的虚拟3D图像组合以渲染3D混合现实图像或视频。 3D摄像机可以获取公共场景的两个单独的图像（左和右），并且叠加两个分离的图像以创建具有3D深度效果的实际图像。 3D混合现实系统可以确定实际3D图像到零视差平面的距离，基于到零视差平面的距离确定用于投影矩阵的一个或多个参数，基于投影矩阵渲染虚拟3D对象 ，组合真实图像和虚拟3D对象以产生混合现实的3D图像。

公开(公告)号：US20120321139A1

公开(公告)日：2012-12-20

申请号：US13160457

申请日：2011-06-14

申请人： Yingyong Qi ,  Ning Bi ,  Xuerui Zhang

发明人： Yingyong Qi ,  Ning Bi ,  Xuerui Zhang

IPC分类号： G06K9/00

CPC分类号： G06K9/00536 ,  G06T7/20 ,  G06T2207/20012

摘要： Embodiments include methods and systems which determine pixel displacement between frames based on a respective weighting-value for each pixel or a group of pixels. The weighting-values provide an indication as to which pixels are more pertinent to optical flow computations. Computational resources and effort can be focused on pixels with higher weights, which are generally more pertinent to optical flow determinations.

摘要翻译： 实施例包括基于每个像素或一组像素的相应加权值来确定帧之间的像素位移的方法和系统。 加权值提供关于哪些像素与光流计算更相关的指示。 计算资源和努力可以集中在具有较高权重的像素上，这通常与光流测定更相关。

公开(公告)号：US20120113241A1

公开(公告)日：2012-05-10

申请号：US13082295

申请日：2011-04-07

申请人： Sairam Sundaresan ,  Ning Bi ,  Milivoje Aleksic ,  Yingyong Qi ,  Xuerui Zhang

发明人： Sairam Sundaresan ,  Ning Bi ,  Milivoje Aleksic ,  Yingyong Qi ,  Xuerui Zhang

IPC分类号： H04N7/18 ,  G06K9/00

CPC分类号： G06K9/00375 ,  G06F3/017 ,  G06K9/00006 ,  G06K9/00355 ,  G06T7/251 ,  G06T2207/30196

摘要： In general, this disclosure describes techniques for providing a gesture-based user interface. For example, according to some aspects of the disclosure, a user interface generally includes a camera and a computing device that identifies and tracks the motion of one or more fingertips of a user. In some examples, the user interface is configured to identify predefined gestures (e.g., patterns of motion) associated with certain motions of the user's fingertips. In another example, the user interface is configured to identify hand postures (e.g., patterns of showing up of fingertips). Accordingly, the user can interact with the computing device by performing the gestures.

摘要翻译： 通常，本公开描述了用于提供基于手势的用户界面的技术。 例如，根据本公开的一些方面，用户界面通常包括识别和跟踪用户的一个或多个指尖的运动的照相机和计算设备。 在一些示例中，用户界面被配置为识别与用户的指尖的某些运动相关联的预定手势（例如，运动模式）。 在另一示例中，用户界面被配置为识别手势（例如，指尖的显示图案）。 因此，用户可以通过执行手势与计算设备交互。

公开(公告)号：US07800632B2

公开(公告)日：2010-09-21

申请号：US11472965

申请日：2006-06-21

申请人： Yingyong Qi ,  Yushi Tian ,  Ning Bi

发明人： Yingyong Qi ,  Yushi Tian ,  Ning Bi

IPC分类号： G06T11/40 ,  G09G5/00

CPC分类号： G06T11/40 ,  G06T15/005 ,  G06T2210/12

摘要： This disclosure describes an apparatus, such as a wireless communication device, that applies a direct evaluation technique to render triangles for the 3D graphical environment. The apparatus includes a rendering engine that defines a rectangular area of pixels, referred to as a bounding box, that bounds the area to be rendered. The rendering engine evaluates coordinates associated with the pixels of the rectangular area to selectively render those pixels that fall within the triangular area. The direct evaluation triangle rendering algorithm may require fewer complex operations than the more computationally intensive interpolation process employed by other systems. As a result, the apparatus may present a 3D graphical environment while preserving as much as possible the available power.

公开(公告)号：US20060250410A1

公开(公告)日：2006-11-09

申请号：US11472965

申请日：2006-06-21

申请人： Yingyong Qi ,  Yushi Tian ,  Ning Bi

发明人： Yingyong Qi ,  Yushi Tian ,  Ning Bi

IPC分类号： G09G5/00

CPC分类号： G06T11/40 ,  G06T15/005 ,  G06T2210/12

摘要： This disclosure describes an apparatus, such as a wireless communication device, that applies a direct evaluation technique to render triangles for the 3D graphical environment. The apparatus includes a rendering engine that defines a rectangular area of pixels, referred to as a bounding box, that bounds the area to be rendered. The rendering engine evaluates coordinates associated with the pixels of the rectangular area to selectively render those pixels that fall within the triangular area. The direct evaluation triangle rendering algorithm may require fewer complex operations than the more computationally intensive interpolation process employed by other systems. As a result, the apparatus may present a 3D graphical environment while preserving as much as possible the available power.

摘要翻译： 本公开描述了一种诸如无线通信设备的装置，其应用直接评估技术来渲染3D图形环境的三角形。 该装置包括描绘引擎，该引擎定义了限定要渲染的区域的被称为边界框的像素的矩形区域。 渲染引擎评估与矩形区域的像素相关联的坐标，以选择性地渲染落在三角形区域内的像素。 直接评估三角形渲染算法可能需要比其他系统使用的计算密集型插值过程更少的复杂操作。 结果，该装置可以呈现3D图形环境，同时尽可能多地保留可用功率。

公开(公告)号：US06671669B1

公开(公告)日：2003-12-30

申请号：US09618177

申请日：2000-07-18

申请人： Harinath Garudadri ,  David Puig Oses ,  Ning Bi ,  Yingyong Qi

发明人： Harinath Garudadri ,  David Puig Oses ,  Ning Bi ,  Yingyong Qi

IPC分类号： G10L1528

CPC分类号： G10L15/32

摘要： A method and system that combines voice recognition engines and resolves any differences between the results of individual voice recognition engines. A speaker independent (SI) Hidden Markov Model (HMM) engine, a speaker independent Dynamic Time Warping (DTW-SI) engine and a speaker dependent Dynamic Time Warping (DTW-SD) engine are combined. Combining and resolving the results of these engines results in a system with better recognition accuracy and lower rejection rates than using the results of only one engine.

摘要翻译： 一种组合语音识别引擎并解决各个语音识别引擎结果之间差异的方法和系统。 独立于扬声器（SI）隐马尔可夫模型（HMM）引擎，独立于扬声器的动态时间扭曲（DTW-SI）引擎和与扬声器相关的动态时间扭曲（DTW-SD）引擎。 结合和解决这些发动机的结果导致与使用仅一个发动机的结果相比，具有更好的识别精度和更低的排除率的系统。

公开(公告)号：US09049423B2

公开(公告)日：2015-06-02

申请号：US12958107

申请日：2010-12-01

申请人： Ning Bi ,  Xuerui Zhang ,  Yingyong Qi ,  Chienchung Chang

发明人： Ning Bi ,  Xuerui Zhang ,  Yingyong Qi ,  Chienchung Chang

IPC分类号： H04N13/02 ,  H04N13/00 ,  G06T7/40 ,  G06T5/40 ,  G06K9/46 ,  G06K9/62

CPC分类号： H04N13/128 ,  G06K9/4642 ,  G06K9/6212 ,  G06T5/40 ,  G06T2207/20228 ,  H04N13/271 ,  H04N2013/0081

摘要： The techniques of this disclosure are directed to the feedback-based stereoscopic display of three-dimensional images, such as may be used for video telephony (VT) and human-machine interface (HMI) application. According to one example, a region of interest (ROI) of stereoscopically captured images may be automatically determined based on determining disparity for at least one pixel of the captured images are described herein. According to another example, a zero disparity plane (ZDP) for the presentation of a 3D representation of stereoscopically captured images may be determined based on an identified ROI. According to this example, the ROI may be automatically identified, or identified based on receipt of user input identifying the ROI.

摘要翻译： 本公开的技术涉及三维图像的基于反馈的立体显示，诸如可用于视频电话（VT）和人机界面（HMI）应用。 根据一个示例，可以基于确定捕获图像的至少一个像素的视差来自动确定立体拍摄图像的感兴趣区域（ROI）。 根据另一示例，可以基于所识别的ROI来确定用于呈现立体摄影图像的3D表示的零视差平面（ZDP）。 根据该示例，可以基于接收到识别ROI的用户输入来自动识别或识别ROI。

公开(公告)号：US20120140038A1

公开(公告)日：2012-06-07

申请号：US12958107

申请日：2010-12-01

申请人： Ning Bi ,  Xuerui Zhang ,  Yingyong Qi ,  Chienchung Chang

发明人： Ning Bi ,  Xuerui Zhang ,  Yingyong Qi ,  Chienchung Chang

IPC分类号： H04N13/02 ,  G06K9/00

CPC分类号： H04N13/128 ,  G06K9/4642 ,  G06K9/6212 ,  G06T5/40 ,  G06T2207/20228 ,  H04N13/271 ,  H04N2013/0081

摘要： The techniques of this disclosure are directed to the feedback-based stereoscopic display of three-dimensional images, such as may be used for video telephony (VT) and human-machine interface (HMI) application. According to one example, a region of interest (ROI) of stereoscopically captured images may be automatically determined based on determining disparity for at least one pixel of the captured images are described herein. According to another example, a zero disparity plane (ZDP) for the presentation of a 3D representation of stereoscopically captured images may be determined based on an identified ROI. According to this example, the ROI may be automatically identified, or identified based on receipt of user input identifying the ROI.

摘要翻译： 本公开的技术涉及三维图像的基于反馈的立体显示，诸如可用于视频电话（VT）和人机界面（HMI）应用。 根据一个示例，可以基于确定捕获图像的至少一个像素的视差来自动确定立体拍摄图像的感兴趣区域（ROI）。 根据另一示例，可以基于所识别的ROI来确定用于呈现立体摄影图像的3D表示的零视差平面（ZDP）。 根据该示例，可以基于接收到识别ROI的用户输入来自动识别或识别ROI。