公开(公告)号：US11693482B2

公开(公告)日：2023-07-04

申请号：US17334324

申请日：2021-05-28

申请人： Mona Hosseinkhani Loorak ,  Wei Zhou ,  Gaganpreet Singh ,  Xiu Yi ,  Wei Li

发明人： Mona Hosseinkhani Loorak ,  Wei Zhou ,  Gaganpreet Singh ,  Xiu Yi ,  Wei Li

IPC分类号： G06F3/01 ,  G06F3/0482 ,  G06F3/04815 ,  G06V20/40 ,  G06V40/20 ,  G06V40/10

CPC分类号： G06F3/017 ,  G06F3/0482 ,  G06F3/04815 ,  G06V20/46 ,  G06V40/107 ,  G06V40/28

摘要： A gesture-controlled device and a method thereon are provided. The method includes capturing a plurality of video frames of a user's body and processing the plurality of video frames to allow detecting a portion of the user's body and to allow recognizing hand gestures. In response to detecting the portion of the user's body, the method includes generating at least one widget interaction region corresponding to the portion of the user's body. The method further includes recognizing, a mid-air hand gesture in the at least one widget interaction region, mapping the mid-air hand gesture to at least one virtual widget on the gesture-controlled device, and manipulating the at least one virtual widget based on the mid-air hand gesture. The method and device allow manipulation of virtual widgets using mid-air gestures on a gesture-controlled device.

公开(公告)号：US11249557B2

公开(公告)日：2022-02-15

申请号：US17308408

申请日：2021-05-05

申请人： Wei Zhou ,  Mona Hosseinkhani Loorak ,  Gaganpreet Singh ,  Xiu Yi ,  Juwei Lu ,  Wei Li

发明人： Wei Zhou ,  Mona Hosseinkhani Loorak ,  Gaganpreet Singh ,  Xiu Yi ,  Juwei Lu ,  Wei Li

IPC分类号： G06F3/01

摘要： Methods and apparatus for gesture-based control of a device in a multi-user environment are described. The methods prioritize users or gestures based on a predetermined priority ruleset. A first-user-in-time ruleset prioritizes gestures based on when in time they were begun by a user in the camera FOV. An action-hierarchy ruleset prioritizes gestures based on the actions they correspond to, and the relative positions of those actions within an action hierarchy. A designated-master-user ruleset prioritizes gestures performed by an explicitly designated master user. Methods for designating a new master user and for providing gesture-control-related user feedback in a multi-user environment are also described.

公开(公告)号：US11112875B1

公开(公告)日：2021-09-07

申请号：US16842717

申请日：2020-04-07

申请人： Wei Zhou ,  Mona Hosseinkhani Loorak ,  Gaganpreet Singh ,  Xiu Yi ,  Juwei Lu ,  Wei Li

发明人： Wei Zhou ,  Mona Hosseinkhani Loorak ,  Gaganpreet Singh ,  Xiu Yi ,  Juwei Lu ,  Wei Li

IPC分类号： G06F3/01

摘要： Methods and apparatus for gesture-based control of a device in a multi-user environment are described. The methods prioritize users or gestures based on a predetermined priority ruleset. A first-user-in-time ruleset prioritizes gestures based on when in time they were begun by a user in the camera FOV. An action-hierarchy ruleset prioritizes gestures based on the actions they correspond to, and the relative positions of those actions within an action hierarchy. A designated-master-user ruleset prioritizes gestures performed by an explicitly designated master user. Methods for designating a new master user and for providing gesture-control-related user feedback in a multi-user environment are also described.

公开(公告)号：US11797081B2

公开(公告)日：2023-10-24

申请号：US17408201

申请日：2021-08-20

申请人： Wei Zhou ,  Mona Hosseinkhani Loorak ,  Ghazaleh Saniee-Monfared ,  Sachi Mizobuchi ,  Xiu Yi ,  Pourang Polad Irani ,  Jian Zhao ,  Wei Li

发明人： Wei Zhou ,  Mona Hosseinkhani Loorak ,  Ghazaleh Saniee-Monfared ,  Sachi Mizobuchi ,  Xiu Yi ,  Pourang Polad Irani ,  Jian Zhao ,  Wei Li

IPC分类号： G06F3/01 ,  G06F3/04847 ,  G06F3/03 ,  G06F3/04842

CPC分类号： G06F3/012 ,  G06F3/013 ,  G06F3/017 ,  G06F3/03 ,  G06F3/04842 ,  G06F3/04847

摘要： Methods, devices, and media are disclosed for mapping of input and output spaces in head-based human-computer interactions. In some embodiments, an end-to-end method is described for designing a head-based user interface, calibrating the interface to individual users, and interacting with a user in real time by mapping head-based user inputs to an output space in a way that optimizes the target selection efficiency of the interaction. Head orientation may be leveraged to define the mapping between the user input and the output space.

公开(公告)号：US10885322B2

公开(公告)日：2021-01-05

申请号：US16535908

申请日：2019-08-08

申请人： Mona Hosseinkhani Loorak ,  Wei Zhou ,  Wei Li

发明人： Mona Hosseinkhani Loorak ,  Wei Zhou ,  Wei Li

IPC分类号： G06K9/00 ,  G06T11/00

摘要： A system including neural network that use deep learning for object detection allows users to interact with images of their face and, in particular, interact with different face landmarks as an input channel for interaction with smart devices. That is, the face is employed as a touch surface for interactions with a device.