Method and apparatus for natural hand visualization

    公开(公告)号:US10559119B2

    公开(公告)日:2020-02-11

    申请号:US15692856

    申请日:2017-08-31

    Abstract: An apparatus and method for natural hand processing for virtual reality. For example, one embodiment of an apparatus comprises: graphics processing circuitry to render left and right scenes responsive to a virtual reality application, the left and right scenes to be displayed on left and right displays, respectively, of a virtual reality device; and a natural hand processing pipeline to project a representation of a user's hands into the left and right scenes to allow the user to interact with one or more objects in the scenes, the natural hand processing pipeline comprising: a depth/mask data smoothing and reconstruction module to receive noisy depth and mask data associated with images of the user's hands and to enhance the noisy depth data and mask data to generate enhanced depth and mask data; a hand mesh generator to generate a hand mesh using the enhanced depth and mask data; and a mesh data projector to project the hand mesh into the left and right scenes.

    Target object classification using three-dimensional geometric filtering

    公开(公告)号:US10242294B2

    公开(公告)日:2019-03-26

    申请号:US15582864

    申请日:2017-05-01

    Abstract: An example apparatus for classifying target objects using three-dimensional geometric filtering includes a patch receiver to receive patches with objects to be classified. The apparatus also includes a geometric filter to filter out patches including objects with sizes outside a target range using three dimensional geometry to generate filtered patches. The apparatus further includes a background remover to remove background pixels from the filtered patches to generate preprocessed patches. The apparatus includes a classification score calculator to calculate a classification score for each of the preprocessed patches.

    HAND SEGMENTATION IN A 3-DIMENSIONAL IMAGE
    6.
    发明申请

    公开(公告)号:US20190066300A1

    公开(公告)日:2019-02-28

    申请号:US15687823

    申请日:2017-08-28

    Abstract: Techniques are provided for segmentation of a hand from a forearm in an image frame. A methodology implementing the techniques according to an embodiment includes estimating a wrist line within an image shape that includes a forearm and a hand. The wrist line estimation is based on a search for a minimum width region of the shape that is surrounded by adjacent regions of greater width on each side of the minimum width region. The method also includes determining a forearm segment, and a hand segment that is separated from the forearm segment by the wrist line. The method further includes labeling the forearm segment and the hand segment. The labeling is based on a connected component analysis of the forearm segment and the hand segment. The method further includes removing the labeled forearm segment from the image frame to generate the image segmentation of the hand.

    PHYSICAL-SURFACE TOUCH CONTROL IN VIRTUAL ENVIRONMENT

    公开(公告)号:US20180284914A1

    公开(公告)日:2018-10-04

    申请号:US15474216

    申请日:2017-03-30

    Abstract: A head-mounted display (HMD) device to be worn by a user in a physical environment (PE) is controlled. A 3D virtual environment (VE) is modeled to include a virtual controllable object subject to virtual control input. Motion of the position, head, and hands of the user is monitored in the PE, and a physical surface in the PE is detected. A virtual user interface (vUI) is placed in the VE relative to a virtual perspective of the user. The vUI includes an information display and at least one virtual touch control to produce the virtual control input in response to virtual manipulation of the virtual touch control. The vUI's placement is determined to coincide with the physical surface in the PE relative to the position of the user in the PE.

    Hand gesture recognition for virtual reality and augmented reality devices

    公开(公告)号:US10354129B2

    公开(公告)日:2019-07-16

    申请号:US15397148

    申请日:2017-01-03

    Abstract: A system for hand gesture recognition includes a display, camera, memory, and processor. When the processor is to execute instructions, the processor is to estimate one or more motion vectors of an object using a pair of consecutive frames and estimate an average motion vector of the object. The processor may also estimate an average motion vector of the object, determine a first histogram of optical flow (HOOF) based on the one or more motion vectors and the average motion vector, determine depth values based on motion vectors from the first HOOF, and determine a second histogram of optical flow (HOOF) based on the depth values. The processor is also to obtain a descriptor based on histogram values from a histogram of optical flow (HOOF) of the one or more motion vectors, a shape descriptor, and the average motion vector and classify the descriptor as a gesture.

    Hand gesture recognition for cursor control

    公开(公告)号:US10254845B2

    公开(公告)日:2019-04-09

    申请号:US15197288

    申请日:2016-06-29

    Abstract: A system for hand gesture recognition is described herein. The system includes a display, camera, memory, and processor. The memory that is to store instructions and is communicatively coupled to the camera and the display. The processor is communicatively coupled to the camera, the display, and the memory. When the processor is to execute the instructions, the processor is to estimate one or more motion vectors of an object using a pair of consecutive frames and estimate an average motion vector of the object. The processor is also to obtain a descriptor based on histogram values from a histogram of optical flow (HOOF) of the one or more motion vectors and the average motion vector and classify the descriptor as a gesture.

Patent Agency Ranking