公开(公告)号：US20140232631A1

公开(公告)日：2014-08-21

申请号：US13768835

申请日：2013-02-15

Applicant: Intel Corporation ,  OMEK INTERACTIVE, LTD.

Inventor： Shahar Fleischmann ,  Yotam Livny ,  Gideon Kleimer ,  Gershom Kutliroff

IPC: G06F3/01

CPC classification number: G06F3/017 ,  G06F3/011 ,  G06F3/0304 ,  G06K9/00335 ,  G06K9/6255 ,  G06T7/251 ,  G06T2207/10028 ,  G06T2207/30196

Abstract: The present disclosure describes a target tracker that evaluates frames of data of one or more targets, such as a body part, body, and/or object, acquired by a depth camera. Positions of the joints of the target(s) in the previous frame and the data from a current frame are used to determine the positions of the joints of the target(s) in the current frame. To perform this task, the tracker proposes several hypotheses and then evaluates the data to validate the respective hypotheses. The hypothesis that best fits the data generated by the depth camera is selected, and the joints of the target(s) are mapped accordingly.

Abstract translation: 本公开描述了评估由深度相机获取的一个或多个目标（诸如身体部位，身体和/或物体）的数据帧的目标跟踪器。 使用前一帧中的目标的关节的位置和来自当前帧的数据来确定当前帧中的目标的关节的位置。 为了执行这个任务，跟踪器提出几个假设，然后评估数据以验证相应的假设。 选择最适合深度摄像机生成的数据的假设，并且相应地映射目标的关节。

公开(公告)号：US08994652B2

公开(公告)日：2015-03-31

申请号：US13768835

申请日：2013-02-15

Applicant: Omek Interactive, Ltd. ,  Intel Corporation

Inventor： Shahar Fleischmann ,  Yotam Livny ,  Gideon Kleimer ,  Gershom Kutliroff

IPC: G09G5/00 ,  G06F3/01

CPC classification number: G06F3/017 ,  G06F3/011 ,  G06F3/0304 ,  G06K9/00335 ,  G06K9/6255 ,  G06T7/251 ,  G06T2207/10028 ,  G06T2207/30196

Abstract: The present disclosure describes a target tracker that evaluates frames of data of one or more targets, such as a body part, body, and/or object, acquired by a depth camera. Positions of the joints of the target(s) in the previous frame and the data from a current frame are used to determine the positions of the joints of the target(s) in the current frame. To perform this task, the tracker proposes several hypotheses and then evaluates the data to validate the respective hypotheses. The hypothesis that best fits the data generated by the depth camera is selected, and the joints of the target(s) are mapped accordingly.

Abstract translation: 本公开描述了评估由深度相机获取的一个或多个目标（诸如身体部位，身体和/或物体）的数据帧的目标跟踪器。 使用前一帧中的目标的关节的位置和来自当前帧的数据来确定当前帧中的目标的关节的位置。 为了执行这个任务，跟踪器提出几个假设，然后评估数据以验证相应的假设。 选择最适合深度摄像机生成的数据的假设，并且相应地映射目标的关节。

公开(公告)号：US20140258942A1

公开(公告)日：2014-09-11

申请号：US13785669

申请日：2013-03-05

Applicant: Intel Corporation ,  OMEK INTERACTIVE, LTD.

Inventor： Gershom Kutliroff ,  Yaron Yanai

IPC: G06F3/0488

CPC classification number: G06F3/017 ,  G06F3/013 ,  G06F3/0304 ,  G06F3/0488 ,  G06F2203/0381

Abstract: A system and method for using multiple perceptual sensing technologies to capture information about a user's actions and for synergistically processing the information is described. Non-limiting examples of perceptual sensing technologies include gesture recognition using depth sensors, two-dimensional cameras, gaze detection, and/or speech recognition. The information captured about a user's gestures using one type of sensing technology is often not able to be captured with another type of technology. Thus, using multiple perceptual sensing technologies allows more information to be captured about the user's gestures. Further, by synergistically leveraging the information acquired using multiple perceptual sensing technologies, a more natural user interface can be created for a user to interact with an electronic device.

Abstract translation: 描述了使用多种感知感知技术捕获关于用户动作的信息并协同处理信息的系统和方法。 感知感知技术的非限制性实例包括使用深度传感器，二维摄像机，凝视检测和/或语音识别的手势识别。 使用一种感测技术拍摄的关于用户手势的信息通常不能用另一种类型的技术来捕获。 因此，使用多种感知感知技术可以获得关于用户手势的更多信息。 此外，通过协同地利用使用多种感知感知技术获得的信息，可以创建更自然的用户界面以供用户与电子设备交互。

公开(公告)号：US09477303B2

公开(公告)日：2016-10-25

申请号：US13857009

申请日：2013-04-04

Applicant: Omek Interactive, Ltd.

Inventor： Shahar Fleischmann ,  Gershom Kutliroff ,  Yaron Yanai

IPC: G06F3/01

CPC classification number: G06F3/017 ,  G06F3/005 ,  G06F3/011 ,  G06F3/04815 ,  G06F3/04842 ,  G06F3/04883 ,  G06K9/00355 ,  G06T13/40 ,  G06T17/00 ,  G06T19/006

Abstract: Systems and methods for combining three-dimensional tracking of a user's movements with a three-dimensional user interface display is described. A tracking module processes depth data of a user performing movements, for example, movements of the user's hand and fingers. The tracked movements are used to animate a representation of the hand and fingers, and the animated representation is displayed to the user using a three-dimensional display. Also displayed are one or more virtual objects with which the user can interact. In some embodiments, the interaction of the user with the virtual objects controls an electronic device.

Abstract translation: 描述用于将用户运动的三维跟踪与三维用户界面显示组合的系统和方法。 跟踪模块处理用户执行移动的深度数据，例如用户的手和手指的移动。 跟踪的动作用于对手和手指的表示进行动画处理，并且使用三维显示向用户显示动画表示。 还显示一个或多个虚拟对象，用户可以与之交互。 在一些实施例中，用户与虚拟对象的交互控制电子设备。

公开(公告)号：US20130265220A1

公开(公告)日：2013-10-10

申请号：US13857009

申请日：2013-04-04

Applicant: OMEK INTERACTIVE, LTD.

Inventor： Shahar Fleischmann ,  Gershom Kutliroff ,  Yaron Yanai

IPC: G06F3/01

CPC classification number: G06F3/017 ,  G06F3/005 ,  G06F3/011 ,  G06F3/04815 ,  G06F3/04842 ,  G06F3/04883 ,  G06K9/00355 ,  G06T13/40 ,  G06T17/00 ,  G06T19/006

Abstract: Systems and methods for combining three-dimensional tracking of a user's movements with a three-dimensional user interface display is described. A tracking module processes depth data of a user performing movements, for example, movements of the user's hand and fingers. The tracked movements are used to animate a representation of the hand and fingers, and the animated representation is displayed to the user using a three-dimensional display. Also displayed are one or more virtual objects with which the user can interact. In some embodiments, the interaction of the user with the virtual objects controls an electronic device.

Abstract translation: 描述用于将用户运动的三维跟踪与三维用户界面显示组合的系统和方法。 跟踪模块处理用户执行移动的深度数据，例如用户的手和手指的移动。 跟踪的动作用于对手和手指的表示进行动画处理，并且使用三维显示向用户显示动画表示。 还显示一个或多个虚拟对象，用户可以与之交互。 在一些实施例中，用户与虚拟对象的交互控制电子设备。

公开(公告)号：US20200225756A9

公开(公告)日：2020-07-16

申请号：US15913728

申请日：2018-03-06

Applicant: Intel Corporation

Inventor： Gershom Kutliroff ,  Yaron Yanai ,  Amit Bleiweiss ,  Shahar Fleishman ,  Yotam Livny ,  Jonathan Epstein

IPC: G06F3/01 ,  G06F3/0484

Abstract: A system and method for close range object tracking are described. Close range depth images of a user's hands and fingers or other objects are acquired using a depth sensor. Using depth image data obtained from the depth sensor, movements of the user's hands and fingers or other objects are identified and tracked, thus permitting the user to interact with an object displayed on a screen, by using the positions and movements of his hands and fingers or other objects.

公开(公告)号：US10482681B2

公开(公告)日：2019-11-19

申请号：US15019011

申请日：2016-02-09

Applicant: INTEL CORPORATION

Inventor： Gershom Kutliroff

IPC: G06K9/00 ,  G06T19/20 ,  G06T7/12

Abstract: Techniques are provided for segmentation of objects in a 3D image of a scene. An example method may include receiving, 3D image frames of a scene. Each of the frames is associated with a pose of a depth camera that generated the 3D image frames. The method may also include detecting the objects in each of the frames based on object recognition; associating a label with the detected object; calculating a 2D bounding box around the object; and calculating a 3D location of the center of the bounding box. The method may further include matching the detected object to an existing object boundary set, created from a previously received image frame, based on the label and the location of the center of the bounding box, or, if the match fails, creating a new object boundary set associated with the detected object.

公开(公告)号：US20190057299A1

公开(公告)日：2019-02-21

申请号：US16110212

申请日：2018-08-23

Applicant: INTEL CORPORATION

Inventor： Gershom Kutliroff

IPC: G06N3/04 ,  G06K9/62 ,  G05D1/02 ,  G06T7/73 ,  G06N3/08 ,  G06K9/00

CPC classification number: G06N3/04 ,  G05D1/0246 ,  G06K9/00664 ,  G06K9/6223 ,  G06K9/6262 ,  G06K9/6272 ,  G06N3/0454 ,  G06N3/08 ,  G06N3/084 ,  G06T7/73 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/30244

Abstract: SLAM systems are provided that utilize an artificial neural network to both map environments and locate positions within the environments. In some example embodiments, a sensor arrangement is used to map an environment. The sensor arrangement acquires sensor data from the various sensors and associates the sensor data, or data derived from the sensor data, with spatial regions in the environment. The sensor data may include image data and inertial measurement data that effectively describes the visual appearance of a spatial region at a particular location and orientation. This diverse sensor data may be fused into camera poses. The map of the environment includes camera poses organized by spatial region within the environment. Further, in these examples, an artificial neural network is adapted to the features of the environment by a transfer learning process using image data associated with camera poses.

公开(公告)号：US20170243352A1

公开(公告)日：2017-08-24

申请号：US15046614

申请日：2016-02-18

Applicant: INTEL CORPORATION

Inventor： Gershom Kutliroff ,  Yaron Yanai ,  Shahar Fleishman ,  Mark Kliger

IPC: G06T7/00

CPC classification number: G06T19/006 ,  G06T7/10 ,  G06T2207/10021 ,  G06T2207/10024 ,  G06T2207/10028 ,  G06T2207/30244

Abstract: Techniques are provided for 3D analysis of a scene including detection, segmentation and registration of objects within the scene. The analysis results may be used to implement augmented reality operations including removal and insertion of objects and the generation of blueprints. An example method may include receiving 3D image frames of the scene, each frame associated with a pose of a depth camera, and creating a 3D reconstruction of the scene based on depth pixels that are projected and accumulated into a global coordinate system. The method may also include detecting objects, and associated locations within the scene, based on the 3D reconstruction, the camera pose and the image frames. The method may further include segmenting the detected objects into points of the 3D reconstruction corresponding to contours of the object and registering the segmented objects to 3D models of the objects to determine their alignment.

公开(公告)号：US20140123077A1

公开(公告)日：2014-05-01

申请号：US13676017

申请日：2012-11-13

Applicant: Intel Corporation

Inventor： Gershom Kutliroff ,  Yaron Yanai ,  Eli Elhadad

IPC: G06F3/01

CPC classification number: G06F3/017 ,  G06F3/0304 ,  G06F3/04842

Abstract: A system and method for close range object tracking are described. Close range depth images of a user's hands and fingers are acquired using a depth sensor. Movements of the user's hands and fingers are identified and tracked. This information is used to permit the user to interact with a virtual object, such as an icon or other object displayed on a screen, or the screen itself.

Abstract translation: 描述了用于近距离对象跟踪的系统和方法。 使用深度传感器获取用户手和手指的近距离深度图像。 识别和跟踪用户手指的移动。 该信息用于允许用户与虚拟对象（诸如屏幕上显示的图标或其他对象）或屏幕本身进行交互。