-
1.
公开(公告)号:US11797081B2
公开(公告)日:2023-10-24
申请号:US17408201
申请日:2021-08-20
申请人: Wei Zhou , Mona Hosseinkhani Loorak , Ghazaleh Saniee-Monfared , Sachi Mizobuchi , Xiu Yi , Pourang Polad Irani , Jian Zhao , Wei Li
发明人: Wei Zhou , Mona Hosseinkhani Loorak , Ghazaleh Saniee-Monfared , Sachi Mizobuchi , Xiu Yi , Pourang Polad Irani , Jian Zhao , Wei Li
IPC分类号: G06F3/01 , G06F3/04847 , G06F3/03 , G06F3/04842
CPC分类号: G06F3/012 , G06F3/013 , G06F3/017 , G06F3/03 , G06F3/04842 , G06F3/04847
摘要: Methods, devices, and media are disclosed for mapping of input and output spaces in head-based human-computer interactions. In some embodiments, an end-to-end method is described for designing a head-based user interface, calibrating the interface to individual users, and interacting with a user in real time by mapping head-based user inputs to an output space in a way that optimizes the target selection efficiency of the interaction. Head orientation may be leveraged to define the mapping between the user input and the output space.
-
公开(公告)号:US10885322B2
公开(公告)日:2021-01-05
申请号:US16535908
申请日:2019-08-08
申请人: Mona Hosseinkhani Loorak , Wei Zhou , Wei Li
发明人: Mona Hosseinkhani Loorak , Wei Zhou , Wei Li
摘要: A system including neural network that use deep learning for object detection allows users to interact with images of their face and, in particular, interact with different face landmarks as an input channel for interaction with smart devices. That is, the face is employed as a touch surface for interactions with a device.
-
公开(公告)号:US11693482B2
公开(公告)日:2023-07-04
申请号:US17334324
申请日:2021-05-28
申请人: Mona Hosseinkhani Loorak , Wei Zhou , Gaganpreet Singh , Xiu Yi , Wei Li
发明人: Mona Hosseinkhani Loorak , Wei Zhou , Gaganpreet Singh , Xiu Yi , Wei Li
IPC分类号: G06F3/01 , G06F3/0482 , G06F3/04815 , G06V20/40 , G06V40/20 , G06V40/10
CPC分类号: G06F3/017 , G06F3/0482 , G06F3/04815 , G06V20/46 , G06V40/107 , G06V40/28
摘要: A gesture-controlled device and a method thereon are provided. The method includes capturing a plurality of video frames of a user's body and processing the plurality of video frames to allow detecting a portion of the user's body and to allow recognizing hand gestures. In response to detecting the portion of the user's body, the method includes generating at least one widget interaction region corresponding to the portion of the user's body. The method further includes recognizing, a mid-air hand gesture in the at least one widget interaction region, mapping the mid-air hand gesture to at least one virtual widget on the gesture-controlled device, and manipulating the at least one virtual widget based on the mid-air hand gesture. The method and device allow manipulation of virtual widgets using mid-air gestures on a gesture-controlled device.
-
4.
公开(公告)号:US11249557B2
公开(公告)日:2022-02-15
申请号:US17308408
申请日:2021-05-05
申请人: Wei Zhou , Mona Hosseinkhani Loorak , Gaganpreet Singh , Xiu Yi , Juwei Lu , Wei Li
发明人: Wei Zhou , Mona Hosseinkhani Loorak , Gaganpreet Singh , Xiu Yi , Juwei Lu , Wei Li
IPC分类号: G06F3/01
摘要: Methods and apparatus for gesture-based control of a device in a multi-user environment are described. The methods prioritize users or gestures based on a predetermined priority ruleset. A first-user-in-time ruleset prioritizes gestures based on when in time they were begun by a user in the camera FOV. An action-hierarchy ruleset prioritizes gestures based on the actions they correspond to, and the relative positions of those actions within an action hierarchy. A designated-master-user ruleset prioritizes gestures performed by an explicitly designated master user. Methods for designating a new master user and for providing gesture-control-related user feedback in a multi-user environment are also described.
-
5.
公开(公告)号:US11112875B1
公开(公告)日:2021-09-07
申请号:US16842717
申请日:2020-04-07
申请人: Wei Zhou , Mona Hosseinkhani Loorak , Gaganpreet Singh , Xiu Yi , Juwei Lu , Wei Li
发明人: Wei Zhou , Mona Hosseinkhani Loorak , Gaganpreet Singh , Xiu Yi , Juwei Lu , Wei Li
IPC分类号: G06F3/01
摘要: Methods and apparatus for gesture-based control of a device in a multi-user environment are described. The methods prioritize users or gestures based on a predetermined priority ruleset. A first-user-in-time ruleset prioritizes gestures based on when in time they were begun by a user in the camera FOV. An action-hierarchy ruleset prioritizes gestures based on the actions they correspond to, and the relative positions of those actions within an action hierarchy. A designated-master-user ruleset prioritizes gestures performed by an explicitly designated master user. Methods for designating a new master user and for providing gesture-control-related user feedback in a multi-user environment are also described.
-
公开(公告)号:US11921931B2
公开(公告)日:2024-03-05
申请号:US17125462
申请日:2020-12-17
IPC分类号: G06F3/01 , G06F3/04815 , G06F3/04845 , G06F3/04847 , G06V20/40 , G06V40/10 , G06V40/20
CPC分类号: G06F3/017 , G06F3/04815 , G06F3/04845 , G06F3/04847 , G06V20/46 , G06V40/107 , G06V40/28
摘要: Methods and systems for discrete control of user interface elements such as graphical widgets are described. A first plurality of video frames are captured and processed to recognize hand gestures therein. A dragging mode is activated in response to a dragging mode activation hand gesture in the first plurality of frames. A second plurality of video frames are captured and processed to allow recognition of hand gestures therein. Dragging, an element of a user interface control, in response to recognition of a discrete control hand gesture in the second plurality of frames. The discrete control of a user interface control using mid-air hand gestures allows precise setting of system parameters associated with the user interface control.
-
公开(公告)号:US11693551B2
公开(公告)日:2023-07-04
申请号:US17326579
申请日:2021-05-21
申请人: Wei Zhou , Sachi Mizobuchi , Gaganpreet Singh , Ghazaleh Saniee-Monfared , Sitao Wang , Futian Zhang , Wei Li
发明人: Wei Zhou , Sachi Mizobuchi , Gaganpreet Singh , Ghazaleh Saniee-Monfared , Sitao Wang , Futian Zhang , Wei Li
IPC分类号: G06F3/01 , G06F3/04847 , G06F3/16
CPC分类号: G06F3/04847 , G06F3/017 , G06F3/167
摘要: Devices and methods for providing feedback for a control display (CD) gain of a slider control on a gesture-controlled device are described. The method includes detecting a speed of a dynamic dragging gesture, determining the CD gain for the slider control based on the speed, and generating an auditory feedback or a visual feedback for the CD gain. A gesture-controlled device, which carries out the method, may have an image-capturing device, a processor, and a memory coupled to the processor, the memory storing machine-executable instructions for carrying out the method. Advantageously, providing feedback for CD gain of a slider control facilitates accurate adjustment of a system parameter associated with the slider control. The devices and methods may be used in industrial applications, vehicle control among other applications.
-
公开(公告)号:US11693483B2
公开(公告)日:2023-07-04
申请号:US17523267
申请日:2021-11-10
申请人: Gaganpreet Singh , Wei Zhou , Pourang Polad Irani , Wei Li
发明人: Gaganpreet Singh , Wei Zhou , Pourang Polad Irani , Wei Li
IPC分类号: G06F3/01 , G06F3/03 , H04N21/472 , H04N21/422 , G06V20/40 , G06V40/20 , G06V40/10
CPC分类号: G06F3/017 , G06F3/0304 , G06V20/46 , G06V40/107 , G06V40/28 , H04N21/42204 , H04N21/47205
摘要: Method and systems for controlling a display device, including detecting a mid-air gesture using a sensing device; mapping the detected mid-air gesture to locations of an interaction region, the interaction region including an on-screen region of the display device and an off-screen region that is located outside an edge of the on-screen region; and performing a display device control action upon detecting an edge interaction based on the mapping of the detected mid-air gesture to locations that interact with the edge of the on-screen region.
-
公开(公告)号:US11301049B2
公开(公告)日:2022-04-12
申请号:US17024633
申请日:2020-09-17
申请人: Gaganpreet Singh , Rafael Veras Guimaraes , Wei Zhou , Pourang Polad Irani , Farzin Farhadi-Niaki , Wei Li
发明人: Gaganpreet Singh , Rafael Veras Guimaraes , Wei Zhou , Pourang Polad Irani , Farzin Farhadi-Niaki , Wei Li
摘要: User interface control based on elbow-anchored arm gestures is disclosed. In one aspect, there is provided a method of user interface control on a computing device based on elbow-anchored arm gestures. A visual user interface (VUI) screen is displayed on a display of a computing device. The VUI screen comprises a plurality of VUI elements arranged in a plurality of VUI element levels. Each VUI element level comprising one or more VUI elements. A spatial location of an elbow of an arm of a user and a spatial location of a wrist of the arm of the user are determined. A three-dimensional (3D) arm vector extending from the spatial location of the elbow to the spatial location of the wrist is then determined. A VUI element in the VUI screen corresponding to the 3D arm vector is then determined based on a predetermined 3D spatial mapping between 3D arm vectors and VUI elements for the VUI screen.
-
10.
公开(公告)号:US11474614B2
公开(公告)日:2022-10-18
申请号:US17085866
申请日:2020-10-30
申请人: Wei Li , Wei Zhou , Sachi Mizobuchi , Ghazaleh Saniee-Monfared , Juwei Lu , Taslim Arefin Khan , Rafael Veras Guimaraes
发明人: Wei Li , Wei Zhou , Sachi Mizobuchi , Ghazaleh Saniee-Monfared , Juwei Lu , Taslim Arefin Khan , Rafael Veras Guimaraes
摘要: Methods, devices, and processor-readable media for adjusting the control-display gain of a gesture-controlled device are described. Adjusting the control-display gain may facilitate user interaction with content or UI elements rendered on a display screen of the gesture-controlled device. The control-display gain may be adjusted based on a property of how a mid-air dragging gesture is being performed by a user's hand. The property may be the location of the gesture, the orientation of the hand performing the gesture, or the velocity of the gesture. A hand that becomes stationary for a threshold time period while performing the dragging gesture may adjust the control-display gain to a different level. Control-display gain may be set to a different value based on the current velocity of the hand performing the gesture. The control-display gain levels may be selected from a continuous range of values or a set of discrete values. Devices for performing the methods are described.
-
-
-
-
-
-
-
-
-