公开(公告)号：US09285883B2

公开(公告)日：2016-03-15

申请号：US13038166

申请日：2011-03-01

Applicant: Ning Bi ,  Milivoje Aleksic

Inventor： Ning Bi ,  Milivoje Aleksic

IPC: G09G5/00 ,  G06F3/01 ,  G06F1/16 ,  G06F3/0481 ,  G06F3/0483 ,  G06F3/0485

CPC classification number: G06F3/017 ,  G06F1/1694 ,  G06F3/011 ,  G06F3/012 ,  G06F3/04815 ,  G06F3/0483 ,  G06F3/0485

Abstract: An apparatus and method for displaying content is disclosed. A particular method includes determining a viewing orientation of a user relative to a display and providing a portion of content to the display based on the viewing orientation. The portion includes at least a first viewable element of the content and does not include at least one second viewable element of the content. The method also includes determining an updated viewing orientation of the user and updating the portion of the content based on the updated viewing orientation. The updated portion includes at least the second viewable element. A display difference between the portion and the updated portion is non-linearly related to an orientation difference between the viewing orientation and the updated viewing orientation.

Abstract translation: 公开了一种用于显示内容的装置和方法。 一种特定的方法包括基于观看方向来确定用户相对于显示器的观看方向并且向显示器提供内容的一部分。 该部分至少包括内容的第一可见元素，并且不包括内容的至少一个第二可见元素。 该方法还包括确定用户的更新的观看方向并基于更新的观看方向来更新内容的部分。 更新部分至少包括第二可见元素。 该部分和更新部分之间的显示差异与观看方向和更新的观看方向之间的取向差异非线性相关。

公开(公告)号：US09219902B2

公开(公告)日：2015-12-22

申请号：US13418206

申请日：2012-03-12

Applicant: Ning Bi ,  Xuerui Zhang ,  Jaimin Rohitkumar Bhise ,  Jianfeng Ren ,  Manish Madhukar Sirdeshmukh ,  Qing Zhou

Inventor： Ning Bi ,  Xuerui Zhang ,  Jaimin Rohitkumar Bhise ,  Jianfeng Ren ,  Manish Madhukar Sirdeshmukh ,  Qing Zhou

IPC: H04N13/02 ,  H04N13/00 ,  G06T15/00 ,  G06T15/10 ,  G06T15/30

CPC classification number: H04N13/122 ,  G06T15/005 ,  G06T15/06 ,  G06T15/10 ,  G06T15/30 ,  G06T15/50 ,  G06T15/506 ,  G06T15/60 ,  G06T15/80 ,  H04N13/275 ,  H04N13/286

Abstract: This disclosure describes techniques for modifying application program interface (API) calls in a manner that can cause a device to render native three dimensional (3D) graphics content in stereoscopic 3D. The techniques of this disclosure can be implemented in a manner where API calls themselves are modified, but the API itself and the GPU hardware are not modified. The techniques of the present disclosure include using the same viewing frustum defined by the original content to generate a left-eye image and a right-eye image and shifting the viewport offset of the left-eye image and the right-eye image.

Abstract translation: 本公开描述了以可能导致设备在立体3D中渲染本机三维（3D）图形内容的方式来修改应用程序接口（API）调用的技术。 本公开的技术可以以API调用自身被修改的方式来实现，但是API本身和GPU硬件不被修改。 本公开的技术包括使用由原始内容定义的相同观看平截头体来生成左眼图像和右眼图像，并移动左眼图像和右眼图像的视口偏移。

公开(公告)号：US08928589B2

公开(公告)日：2015-01-06

申请号：US13090497

申请日：2011-04-20

Applicant: Ning Bi

Inventor： Ning Bi

IPC: G06F3/02 ,  G06F3/048 ,  G06F3/042 ,  G06F3/00 ,  G06F3/01 ,  G06F3/023 ,  G06F3/03

CPC classification number: G06F3/0425 ,  G06F3/005 ,  G06F3/017 ,  G06F3/0233 ,  G06F3/0304 ,  G06F3/0426

Abstract: The present disclosure provides systems, methods and apparatus, including computer programs encoded on computer storage media, for providing virtual keyboards. In one aspect, a system includes a camera, a display, a video feature extraction module and a gesture pattern matching module. The camera captures a sequence of images containing a finger of a user, and the display displays each image combined with a virtual keyboard having a plurality of virtual keys. The video feature extraction module detects motion of the finger in the sequence of images relative to virtual sensors of the virtual keys, and determines sensor actuation data based on the detected motion relative to the virtual sensors. The gesture pattern matching module uses the sensor actuation data to recognize a gesture.

Abstract translation: 本公开提供了系统，方法和装置，包括在计算机存储介质上编码的用于提供虚拟键盘的计算机程序。 一方面，系统包括相机，显示器，视频特征提取模块和手势模式匹配模块。 相机拍摄包含用户手指的一系列图像，并且显示器显示与具有多个虚拟键的虚拟键盘组合的每个图像。 视频特征提取模块相对于虚拟键的虚拟传感器检测图像序列中的手指的运动，并且基于相对于虚拟传感器的检测到的运动来确定传感器致动数据。 手势模式匹配模块使用传感器致动数据来识别手势。

公开(公告)号：US20120268484A1

公开(公告)日：2012-10-25

申请号：US13538445

申请日：2012-06-29

Applicant: Ning Bi ,  Lin Chen ,  Lingjun Chen

Inventor： Ning Bi ,  Lin Chen ,  Lingjun Chen

IPC: G09G5/00

CPC classification number: G06T15/30

Abstract: A method and device for performing and processing user-defined clipping in object space to reduce the number of computations needed for the clipping operation. The method and device also combine the modelview transformation of the vertex coordinates with projection transform. The user-defined clipping in object space provides a higher performance and less power consumption by avoiding generation of eye coordinates if there is no lighting. The device includes a driver for the user-defined clipping in the object space to perform dual mode user-defined clipping in object space when a lighting function is disabled and in eye space when the lighting function is enabled.

Abstract translation: 一种用于在对象空间中执行和处理用户定义的限幅以减少剪切操作所需的计算次数的方法和装置。 该方法和装置还将顶点坐标的modelview变换与投影变换相结合。 对象空间中的用户定义的剪辑通过避免在没有照明的情况下产生眼睛坐标来提供更高的性能和更低的功耗。 该设备包括用于在对象空间中的用户定义的剪切的驱动器，以在禁用照明功能时在对象空间中执行双模式用户定义的剪辑，并且在启用照明功能时在眼睛空间中执行双模式用户定义的剪辑。

公开(公告)号：US20120235999A1

公开(公告)日：2012-09-20

申请号：US13350467

申请日：2012-01-13

Applicant: Ning Bi ,  Xuerui Zhang ,  Jian Wei

Inventor： Ning Bi ,  Xuerui Zhang ,  Jian Wei

IPC: G06T15/80

CPC classification number: H04N13/122 ,  G06T15/005 ,  G06T15/06 ,  G06T15/10 ,  G06T15/30 ,  G06T15/50 ,  G06T15/506 ,  G06T15/60 ,  G06T15/80 ,  H04N13/275 ,  H04N13/286

Abstract: The example techniques of this disclosure are directed to generating a stereoscopic view from an application designed to generate a mono view. For example, the techniques may modify source code of a vertex shader to cause the modified vertex shader, when executed, to generate graphics content for the images of the stereoscopic view. As another example, the techniques may modify a command that defines a viewport for the mono view to commands that define the viewports for the images of the stereoscopic view.

Abstract translation: 本公开的示例性技术涉及从被设计成生成单视图的应用产生立体视图。 例如，这些技术可以修改顶点着色器的源代码，以便在被执行时使经修改的顶点着色器生成立体视图的图像的图形内容。 作为另一示例，这些技术可以修改将单声道视图的视口定义为定义立体视图的图像的视口的命令的命令。

公开(公告)号：US20110262001A1

公开(公告)日：2011-10-27

申请号：US12765292

申请日：2010-04-22

Applicant: Ning Bi ,  Yingyong Qi ,  Qing Zhou

Inventor： Ning Bi ,  Yingyong Qi ,  Qing Zhou

IPC: G06K9/62 ,  H04N5/228 ,  G06K9/00

CPC classification number: G06K9/00234

Abstract: In a particular illustrative embodiment, a method of determining a viewpoint of a person based on skin color area and face area is disclosed. The method includes receiving image data corresponding to an image captured by a camera, the image including at least one object to be displayed at a device coupled to the camera. The method further includes determining a viewpoint of the person relative to a display of the device coupled to the camera. The viewpoint of the person may be determined by determining a face area of the person based on a determined skin color area of the person and tracking a face location of the person based on the face area. One or more objects displayed at the display may be moved in response to the determined viewpoint of the person.

Abstract translation: 在具体的说明性实施例中，公开了一种基于皮肤颜色区域和面部区域来确定人的视点的方法。 该方法包括接收与由相机拍摄的图像相对应的图像数据，所述图像包括要耦合到相机的设备中要显示的至少一个对象。 该方法还包括确定人相对于耦合到相机的设备的显示的视点。 可以通过基于人的确定的皮肤颜色区域来确定人的脸部区域并且基于面部区域来跟踪人的面部位置来确定人的观点。 可以响应于所确定的人的观点而移动在显示器处显示的一个或多个对象。

公开(公告)号：US06671669B1

公开(公告)日：2003-12-30

申请号：US09618177

申请日：2000-07-18

Applicant: Harinath Garudadri ,  David Puig Oses ,  Ning Bi ,  Yingyong Qi

Inventor： Harinath Garudadri ,  David Puig Oses ,  Ning Bi ,  Yingyong Qi

IPC: G10L1528

CPC classification number: G10L15/32

Abstract: A method and system that combines voice recognition engines and resolves any differences between the results of individual voice recognition engines. A speaker independent (SI) Hidden Markov Model (HMM) engine, a speaker independent Dynamic Time Warping (DTW-SI) engine and a speaker dependent Dynamic Time Warping (DTW-SD) engine are combined. Combining and resolving the results of these engines results in a system with better recognition accuracy and lower rejection rates than using the results of only one engine.

Abstract translation: 一种组合语音识别引擎并解决各个语音识别引擎结果之间差异的方法和系统。 独立于扬声器（SI）隐马尔可夫模型（HMM）引擎，独立于扬声器的动态时间扭曲（DTW-SI）引擎和与扬声器相关的动态时间扭曲（DTW-SD）引擎。 结合和解决这些发动机的结果导致与使用仅一个发动机的结果相比，具有更好的识别精度和更低的排除率的系统。

公开(公告)号：US09049423B2

公开(公告)日：2015-06-02

申请号：US12958107

申请日：2010-12-01

Applicant: Ning Bi ,  Xuerui Zhang ,  Yingyong Qi ,  Chienchung Chang

Inventor： Ning Bi ,  Xuerui Zhang ,  Yingyong Qi ,  Chienchung Chang

IPC: H04N13/02 ,  H04N13/00 ,  G06T7/40 ,  G06T5/40 ,  G06K9/46 ,  G06K9/62

CPC classification number: H04N13/128 ,  G06K9/4642 ,  G06K9/6212 ,  G06T5/40 ,  G06T2207/20228 ,  H04N13/271 ,  H04N2013/0081

Abstract: The techniques of this disclosure are directed to the feedback-based stereoscopic display of three-dimensional images, such as may be used for video telephony (VT) and human-machine interface (HMI) application. According to one example, a region of interest (ROI) of stereoscopically captured images may be automatically determined based on determining disparity for at least one pixel of the captured images are described herein. According to another example, a zero disparity plane (ZDP) for the presentation of a 3D representation of stereoscopically captured images may be determined based on an identified ROI. According to this example, the ROI may be automatically identified, or identified based on receipt of user input identifying the ROI.

Abstract translation: 本公开的技术涉及三维图像的基于反馈的立体显示，诸如可用于视频电话（VT）和人机界面（HMI）应用。 根据一个示例，可以基于确定捕获图像的至少一个像素的视差来自动确定立体拍摄图像的感兴趣区域（ROI）。 根据另一示例，可以基于所识别的ROI来确定用于呈现立体摄影图像的3D表示的零视差平面（ZDP）。 根据该示例，可以基于接收到识别ROI的用户输入来自动识别或识别ROI。

公开(公告)号：US20120268376A1

公开(公告)日：2012-10-25

申请号：US13090497

申请日：2011-04-20

Applicant: Ning Bi

Inventor： Ning Bi

IPC: G06F3/00

CPC classification number: G06F3/0425 ,  G06F3/005 ,  G06F3/017 ,  G06F3/0233 ,  G06F3/0304 ,  G06F3/0426

Abstract: The present disclosure provides systems, methods and apparatus, including computer programs encoded on computer storage media, for providing virtual keyboards. In one aspect, a system includes a camera, a display, a video feature extraction module and a gesture pattern matching module. The camera captures a sequence of images containing a finger of a user, and the display displays each image combined with a virtual keyboard having a plurality of virtual keys. The video feature extraction module detects motion of the finger in the sequence of images relative to virtual sensors of the virtual keys, and determines sensor actuation data based on the detected motion relative to the virtual sensors. The gesture pattern matching module uses the sensor actuation data to recognize a gesture.

Abstract translation: 本公开提供了系统，方法和装置，包括在计算机存储介质上编码的用于提供虚拟键盘的计算机程序。 一方面，系统包括相机，显示器，视频特征提取模块和手势模式匹配模块。 相机拍摄包含用户手指的一系列图像，并且显示器显示与具有多个虚拟键的虚拟键盘组合的每个图像。 视频特征提取模块相对于虚拟键的虚拟传感器检测图像序列中的手指的运动，并且基于相对于虚拟传感器的检测到的运动来确定传感器致动数据。 手势模式匹配模块使用传感器致动数据来识别手势。

公开(公告)号：US20120236002A1

公开(公告)日：2012-09-20

申请号：US13418206

申请日：2012-03-12

Applicant: Ning Bi ,  Xuerui Zhang ,  Jaimin Rohitkumar Bhise ,  Jianfeng Ren ,  Manish Madhukar Sirdeshmukh ,  Qing Zhou

Inventor： Ning Bi ,  Xuerui Zhang ,  Jaimin Rohitkumar Bhise ,  Jianfeng Ren ,  Manish Madhukar Sirdeshmukh ,  Qing Zhou

IPC: G06T15/20

CPC classification number: H04N13/122 ,  G06T15/005 ,  G06T15/06 ,  G06T15/10 ,  G06T15/30 ,  G06T15/50 ,  G06T15/506 ,  G06T15/60 ,  G06T15/80 ,  H04N13/275 ,  H04N13/286

Abstract: This disclosure describes techniques for modifying application program interface (API) calls in a manner that can cause a device to render native three dimensional (3D) graphics content in stereoscopic 3D. The techniques of this disclosure can be implemented in a manner where API calls themselves are modified, but the API itself and the GPU hardware are not modified. The techniques of the present disclosure include using the same viewing frustum defined by the original content to generate a left-eye image and a right-eye image and shifting the viewport offset of the left-eye image and the right-eye image.

Abstract translation: 本公开描述了以可能导致设备在立体3D中呈现本机三维（3D）图形内容的方式来修改应用程序接口（API）调用的技术。 本公开的技术可以以API调用自身被修改的方式来实现，但是API本身和GPU硬件不被修改。 本公开的技术包括使用由原始内容定义的相同观看平截头体来生成左眼图像和右眼图像，并移动左眼图像和右眼图像的视口偏移。