公开(公告)号：US20210081052A1

公开(公告)日：2021-03-18

申请号：US17024633

申请日：2020-09-17

申请人： Gaganpreet SINGH ,  Rafael VERAS GUIMARAES ,  Wei ZHOU ,  Pourang Polad IRANI ,  Farzin FARHADI-NIAKI ,  Wei LI

发明人： Gaganpreet SINGH ,  Rafael VERAS GUIMARAES ,  Wei ZHOU ,  Pourang Polad IRANI ,  Farzin FARHADI-NIAKI ,  Wei LI

IPC分类号： G06F3/01 ,  G06K9/00

摘要： User interface control based on elbow-anchored arm gestures is disclosed. In one aspect, there is provided a method of user interface control on a computing device based on elbow-anchored arm gestures. A visual user interface (VUI) screen is displayed on a display of a computing device. The VUI screen comprises a plurality of VUI elements arranged in a plurality of VUI element levels. Each VUI element level comprising one or more VUI elements. A spatial location of an elbow of an arm of a user and a spatial location of a wrist of the arm of the user are determined. A three-dimensional (3D) arm vector extending from the spatial location of the elbow to the spatial location of the wrist is then determined. A VUI element in the VUI screen corresponding to the 3D arm vector is then determined based on a predetermined 3D spatial mapping between 3D arm vectors and VUI elements for the VUI screen.

公开(公告)号：US20230145592A1

公开(公告)日：2023-05-11

申请号：US17523267

申请日：2021-11-10

申请人： Gaganpreet SINGH ,  Wei ZHOU ,  Pourang Polad IRANI ,  Wei LI

发明人： Gaganpreet SINGH ,  Wei ZHOU ,  Pourang Polad IRANI ,  Wei LI

IPC分类号： G06F3/01 ,  G06F3/03 ,  G06K9/00 ,  H04N21/422 ,  H04N21/472

CPC分类号： G06F3/017 ,  G06F3/0304 ,  G06K9/00355 ,  G06K9/00375 ,  G06K9/00744 ,  H04N21/42204 ,  H04N21/47205

摘要： Method and systems for controlling a display device, including detecting a mid-air gesture using a sensing device; mapping the detected mid-air gesture to locations of an interaction region, the interaction region including an on-screen region of the display device and an off-screen region that is located outside an edge of the on-screen region; and performing a display device control action upon detecting an edge interaction based on the mapping of the detected mid-air gesture to locations that interact with the edge of the on-screen region.

公开(公告)号：US20230059153A1

公开(公告)日：2023-02-23

申请号：US17408201

申请日：2021-08-20

申请人： Wei ZHOU ,  Mona HOSSEINKHANI LOORAK ,  Ghazaleh SANIEE-MONFARED ,  Sachi MIZOBUCHI ,  Xiu YI ,  Pourang Polad IRANI ,  Jian ZHAO ,  Wei LI

发明人： Wei ZHOU ,  Mona HOSSEINKHANI LOORAK ,  Ghazaleh SANIEE-MONFARED ,  Sachi MIZOBUCHI ,  Xiu YI ,  Pourang Polad IRANI ,  Jian ZHAO ,  Wei LI

IPC分类号： G06F3/01 ,  G06F3/03 ,  G06F3/0484

摘要： Methods, devices, and media are disclosed for mapping of input and output spaces in head-based human-computer interactions. In some embodiments, an end-to-end method is described for designing a head-based user interface, calibrating the interface to individual users, and interacting with a user in real time by mapping head-based user inputs to an output space in a way that optimizes the target selection efficiency of the interaction. Head orientation may be leveraged to define the mapping between the user input and the output space.

公开(公告)号：US20230116341A1

公开(公告)日：2023-04-13

申请号：US17958177

申请日：2022-09-30

申请人： Futian ZHANG ,  Edward LANK ,  Sachi MIZOBUCHI ,  Gaganpreet SINGH ,  Wei ZHOU ,  Wei LI

发明人： Futian ZHANG ,  Edward LANK ,  Sachi MIZOBUCHI ,  Gaganpreet SINGH ,  Wei ZHOU ,  Wei LI

IPC分类号： G06F3/01 ,  G06F3/0485 ,  G06V40/20

摘要： Methods and apparatuses for controlling a selection focus of a user interface using gestures, in particular mid-air hand gestures, are described. A hand is detected within a defined activation region in a first frame of video data. The detected hand is tracked to determine a tracked location of the detected hand in at least a second frame of video data. A control signal is outputted to control the selection focus to focus on a target in the user interface, where movement of the selection focus is controlled based on a displacement between the tracked location and a reference location in the activation region.

公开(公告)号：US20220374138A1

公开(公告)日：2022-11-24

申请号：US17326579

申请日：2021-05-21

申请人： Wei ZHOU ,  Sachi MIZOBUCHI ,  Gaganpreet SINGH ,  Ghazaleh SANIEE-MONFARED ,  Sitao WANG ,  Futian ZHANG ,  Wei LI

发明人： Wei ZHOU ,  Sachi MIZOBUCHI ,  Gaganpreet SINGH ,  Ghazaleh SANIEE-MONFARED ,  Sitao WANG ,  Futian ZHANG ,  Wei LI

IPC分类号： G06F3/0484 ,  G06F3/01 ,  G06F3/16

摘要： Devices and methods for providing feedback for a control display (CD) gain of a slider control on a gesture-controlled device are described. The method includes detecting a speed of a dynamic dragging gesture, determining the CD gain for the slider control based on the speed, and generating an auditory feedback or a visual feedback for the CD gain. A gesture-controlled device, which carries out the method, may have an image-capturing device, a processor, and a memory coupled to the processor, the memory storing machine-executable instructions for carrying out the method. Advantageously, providing feedback for CD gain of a slider control facilitates accurate adjustment of a system parameter associated with the slider control. The devices and methods may be used in industrial applications, vehicle control among other applications.

公开(公告)号：US20210294427A1

公开(公告)日：2021-09-23

申请号：US17308408

申请日：2021-05-05

申请人： Wei ZHOU ,  Mona HOSSEINKHANI LOORAK ,  Gaganpreet SINGH ,  Xiu YI ,  Juwei LU ,  Wei LI

发明人： Wei ZHOU ,  Mona HOSSEINKHANI LOORAK ,  Gaganpreet SINGH ,  Xiu YI ,  Juwei LU ,  Wei LI

IPC分类号： G06F3/01

摘要： Methods and apparatus for gesture-based control of a device in a multi-user environment are described. The methods prioritize users or gestures based on a predetermined priority ruleset. A first-user-in-time ruleset prioritizes gestures based on when in time they were begun by a user in the camera FOV. An action-hierarchy ruleset prioritizes gestures based on the actions they correspond to, and the relative positions of those actions within an action hierarchy. A designated-master-user ruleset prioritizes gestures performed by an explicitly designated master user. Methods for designating a new master user and for providing gesture-control-related user feedback in a multi-user environment are also described.

公开(公告)号：US20220382377A1

公开(公告)日：2022-12-01

申请号：US17334324

申请日：2021-05-28

申请人： Mona HOSSEINKHANI LOORAK ,  Wei ZHOU ,  Gaganpreet SINGH ,  Xiu YI ,  Wei LI

发明人： Mona HOSSEINKHANI LOORAK ,  Wei ZHOU ,  Gaganpreet SINGH ,  Xiu YI ,  Wei LI

IPC分类号： G06F3/01 ,  G06K9/00 ,  G06F3/0481 ,  G06F3/0482

摘要： A gesture-controlled device and a method thereon are provided. The method includes capturing a plurality of video frames of a user's body and processing the plurality of video frames to allow detecting a portion of the user's body and to allow recognizing hand gestures. In response to detecting the portion of the user's body, the method includes generating at least one widget interaction region corresponding to the portion of the user's body. The method further includes recognizing, a mid-air hand gesture in the at least one widget interaction region, mapping the mid-air hand gesture to at least one virtual widget on the gesture-controlled device, and manipulating the at least one virtual widget based on the mid-air hand gesture. The method and device allow manipulation of virtual widgets using mid-air gestures on a gesture-controlled device.

公开(公告)号：US20210294423A1

公开(公告)日：2021-09-23

申请号：US16842717

申请日：2020-04-07

申请人： Wei ZHOU ,  Mona HOSSEINKHANI LOORAK ,  Gaganpreet SINGH ,  Xiu YI ,  Juwei LU ,  Wei LI

发明人： Wei ZHOU ,  Mona HOSSEINKHANI LOORAK ,  Gaganpreet SINGH ,  Xiu YI ,  Juwei LU ,  Wei LI

IPC分类号： G06F3/01

摘要： Methods and apparatus for gesture-based control of a device in a multi-user environment are described. The methods prioritize users or gestures based on a predetermined priority ruleset. A first-user-in-time ruleset prioritizes gestures based on when in time they were begun by a user in the camera FOV. An action-hierarchy ruleset prioritizes gestures based on the actions they correspond to, and the relative positions of those actions within an action hierarchy. A designated-master-user ruleset prioritizes gestures performed by an explicitly designated master user. Methods for designating a new master user and for providing gesture-control-related user feedback in a multi-user environment are also described.

公开(公告)号：US20230078074A1

公开(公告)日：2023-03-16

申请号：US17991279

申请日：2022-11-21

申请人： Wenshu LUO ,  Sachi MIZOBUCHI ,  Wei ZHOU ,  Wei LI

发明人： Wenshu LUO ,  Sachi MIZOBUCHI ,  Wei ZHOU ,  Wei LI

IPC分类号： G06F3/01 ,  G06T7/70 ,  G06T7/20 ,  B60R16/023 ,  G06F3/16 ,  G06V20/59 ,  G06V40/10

摘要： Methods, devices, and processor-readable media for hand-on-wheel gesture controls are described. A steering wheel is virtually segmented into a plurality of radial segments. Each segment is assigned a semantic meaning. Control commands related to control functions are mapped to different virtual segments of the steering wheel. When a user performs a gesture on the steering wheel, the system recognizes the gesture and selects a control function based on the location of the hand relative to the steering wheel. In various embodiments, on-wheel hand gestures, on-wheel hand location, and voice commands may be used in various combinations to enable a user to perform a wide selection of functions using a small number of unique commands.

公开(公告)号：US20230013169A1

公开(公告)日：2023-01-19

申请号：US17943841

申请日：2022-09-13

申请人： Wei LI ,  Wei ZHOU ,  Sachi MIZOBUCHI ,  Ghazaleh SANIEE-MONFARED ,  Juwei LU ,  Taslim Arefin KHAN ,  Rafael VERAS GUIMARAES

发明人： Wei LI ,  Wei ZHOU ,  Sachi MIZOBUCHI ,  Ghazaleh SANIEE-MONFARED ,  Juwei LU ,  Taslim Arefin KHAN ,  Rafael VERAS GUIMARAES

IPC分类号： G06F3/01 ,  G06V40/20 ,  G06T7/70 ,  G06T7/50 ,  G06T7/20 ,  G06V10/25

摘要： Methods, devices, and processor-readable media for adjusting the control-display gain of a gesture-controlled device are described. Adjusting the control-display gain may facilitate user interaction with content or UI elements rendered on a display screen of the gesture-controlled device. The control-display gain may be adjusted based on a property of how a mid-air dragging gesture is being performed by a user's hand. The property may be the location of the gesture, the orientation of the hand performing the gesture, or the velocity of the gesture. A hand that becomes stationary for a threshold time period while performing the dragging gesture may adjust the control-display gain to a different level. Control-display gain may be set to a different value based on the current velocity of the hand performing the gesture. The control-display gain levels may be selected from a continuous range of values or a set of discrete values. Devices for performing the methods are described.