-
公开(公告)号:US11693483B2
公开(公告)日:2023-07-04
申请号:US17523267
申请日:2021-11-10
申请人: Gaganpreet Singh , Wei Zhou , Pourang Polad Irani , Wei Li
发明人: Gaganpreet Singh , Wei Zhou , Pourang Polad Irani , Wei Li
IPC分类号: G06F3/01 , G06F3/03 , H04N21/472 , H04N21/422 , G06V20/40 , G06V40/20 , G06V40/10
CPC分类号: G06F3/017 , G06F3/0304 , G06V20/46 , G06V40/107 , G06V40/28 , H04N21/42204 , H04N21/47205
摘要: Method and systems for controlling a display device, including detecting a mid-air gesture using a sensing device; mapping the detected mid-air gesture to locations of an interaction region, the interaction region including an on-screen region of the display device and an off-screen region that is located outside an edge of the on-screen region; and performing a display device control action upon detecting an edge interaction based on the mapping of the detected mid-air gesture to locations that interact with the edge of the on-screen region.
-
公开(公告)号:US11301049B2
公开(公告)日:2022-04-12
申请号:US17024633
申请日:2020-09-17
申请人: Gaganpreet Singh , Rafael Veras Guimaraes , Wei Zhou , Pourang Polad Irani , Farzin Farhadi-Niaki , Wei Li
发明人: Gaganpreet Singh , Rafael Veras Guimaraes , Wei Zhou , Pourang Polad Irani , Farzin Farhadi-Niaki , Wei Li
摘要: User interface control based on elbow-anchored arm gestures is disclosed. In one aspect, there is provided a method of user interface control on a computing device based on elbow-anchored arm gestures. A visual user interface (VUI) screen is displayed on a display of a computing device. The VUI screen comprises a plurality of VUI elements arranged in a plurality of VUI element levels. Each VUI element level comprising one or more VUI elements. A spatial location of an elbow of an arm of a user and a spatial location of a wrist of the arm of the user are determined. A three-dimensional (3D) arm vector extending from the spatial location of the elbow to the spatial location of the wrist is then determined. A VUI element in the VUI screen corresponding to the 3D arm vector is then determined based on a predetermined 3D spatial mapping between 3D arm vectors and VUI elements for the VUI screen.
-
公开(公告)号:US20210349625A1
公开(公告)日:2021-11-11
申请号:US16867247
申请日:2020-05-05
申请人: Wei LI , Jun LI , Qiang XU , Chenhe LI , Junwei SUN , Gaganpreet SINGH
发明人: Wei LI , Jun LI , Qiang XU , Chenhe LI , Junwei SUN , Gaganpreet SINGH
IPC分类号: G06F3/0488 , G06T11/40 , G06F3/0485
摘要: A method is provided including generating touch coordinate information corresponding to touch interactions with a touchscreen display of an electronic device and updating information rendered on the touchscreen display in response to determining that the touch coordinate information matches a tool shaft movement gesture corresponding to movement of a touch tool shaft over an area of the touchscreen display. A device is provided, including a touchscreen display comprising a display and a touch sensing system configured to generate signals corresponding to screen touches of the display, a processing device operatively coupled to the touchscreen display, and a non-transitory memory coupled to the processing device and storing software instructions that when executed by the processing device configure the processing device to carry out the provided method. The ability to process tool shaft gestures may improve one or both of the operation of the device and the user experience with the device.
-
公开(公告)号:US11693551B2
公开(公告)日:2023-07-04
申请号:US17326579
申请日:2021-05-21
申请人: Wei Zhou , Sachi Mizobuchi , Gaganpreet Singh , Ghazaleh Saniee-Monfared , Sitao Wang , Futian Zhang , Wei Li
发明人: Wei Zhou , Sachi Mizobuchi , Gaganpreet Singh , Ghazaleh Saniee-Monfared , Sitao Wang , Futian Zhang , Wei Li
IPC分类号: G06F3/01 , G06F3/04847 , G06F3/16
CPC分类号: G06F3/04847 , G06F3/017 , G06F3/167
摘要: Devices and methods for providing feedback for a control display (CD) gain of a slider control on a gesture-controlled device are described. The method includes detecting a speed of a dynamic dragging gesture, determining the CD gain for the slider control based on the speed, and generating an auditory feedback or a visual feedback for the CD gain. A gesture-controlled device, which carries out the method, may have an image-capturing device, a processor, and a memory coupled to the processor, the memory storing machine-executable instructions for carrying out the method. Advantageously, providing feedback for CD gain of a slider control facilitates accurate adjustment of a system parameter associated with the slider control. The devices and methods may be used in industrial applications, vehicle control among other applications.
-
公开(公告)号:US20220382377A1
公开(公告)日:2022-12-01
申请号:US17334324
申请日:2021-05-28
申请人: Mona HOSSEINKHANI LOORAK , Wei ZHOU , Gaganpreet SINGH , Xiu YI , Wei LI
发明人: Mona HOSSEINKHANI LOORAK , Wei ZHOU , Gaganpreet SINGH , Xiu YI , Wei LI
IPC分类号: G06F3/01 , G06K9/00 , G06F3/0481 , G06F3/0482
摘要: A gesture-controlled device and a method thereon are provided. The method includes capturing a plurality of video frames of a user's body and processing the plurality of video frames to allow detecting a portion of the user's body and to allow recognizing hand gestures. In response to detecting the portion of the user's body, the method includes generating at least one widget interaction region corresponding to the portion of the user's body. The method further includes recognizing, a mid-air hand gesture in the at least one widget interaction region, mapping the mid-air hand gesture to at least one virtual widget on the gesture-controlled device, and manipulating the at least one virtual widget based on the mid-air hand gesture. The method and device allow manipulation of virtual widgets using mid-air gestures on a gesture-controlled device.
-
6.
公开(公告)号:US20210294423A1
公开(公告)日:2021-09-23
申请号:US16842717
申请日:2020-04-07
申请人: Wei ZHOU , Mona HOSSEINKHANI LOORAK , Gaganpreet SINGH , Xiu YI , Juwei LU , Wei LI
发明人: Wei ZHOU , Mona HOSSEINKHANI LOORAK , Gaganpreet SINGH , Xiu YI , Juwei LU , Wei LI
IPC分类号: G06F3/01
摘要: Methods and apparatus for gesture-based control of a device in a multi-user environment are described. The methods prioritize users or gestures based on a predetermined priority ruleset. A first-user-in-time ruleset prioritizes gestures based on when in time they were begun by a user in the camera FOV. An action-hierarchy ruleset prioritizes gestures based on the actions they correspond to, and the relative positions of those actions within an action hierarchy. A designated-master-user ruleset prioritizes gestures performed by an explicitly designated master user. Methods for designating a new master user and for providing gesture-control-related user feedback in a multi-user environment are also described.
-
公开(公告)号:US20210081052A1
公开(公告)日:2021-03-18
申请号:US17024633
申请日:2020-09-17
申请人: Gaganpreet SINGH , Rafael VERAS GUIMARAES , Wei ZHOU , Pourang Polad IRANI , Farzin FARHADI-NIAKI , Wei LI
发明人: Gaganpreet SINGH , Rafael VERAS GUIMARAES , Wei ZHOU , Pourang Polad IRANI , Farzin FARHADI-NIAKI , Wei LI
摘要: User interface control based on elbow-anchored arm gestures is disclosed. In one aspect, there is provided a method of user interface control on a computing device based on elbow-anchored arm gestures. A visual user interface (VUI) screen is displayed on a display of a computing device. The VUI screen comprises a plurality of VUI elements arranged in a plurality of VUI element levels. Each VUI element level comprising one or more VUI elements. A spatial location of an elbow of an arm of a user and a spatial location of a wrist of the arm of the user are determined. A three-dimensional (3D) arm vector extending from the spatial location of the elbow to the spatial location of the wrist is then determined. A VUI element in the VUI screen corresponding to the 3D arm vector is then determined based on a predetermined 3D spatial mapping between 3D arm vectors and VUI elements for the VUI screen.
-
公开(公告)号:US11693482B2
公开(公告)日:2023-07-04
申请号:US17334324
申请日:2021-05-28
申请人: Mona Hosseinkhani Loorak , Wei Zhou , Gaganpreet Singh , Xiu Yi , Wei Li
发明人: Mona Hosseinkhani Loorak , Wei Zhou , Gaganpreet Singh , Xiu Yi , Wei Li
IPC分类号: G06F3/01 , G06F3/0482 , G06F3/04815 , G06V20/40 , G06V40/20 , G06V40/10
CPC分类号: G06F3/017 , G06F3/0482 , G06F3/04815 , G06V20/46 , G06V40/107 , G06V40/28
摘要: A gesture-controlled device and a method thereon are provided. The method includes capturing a plurality of video frames of a user's body and processing the plurality of video frames to allow detecting a portion of the user's body and to allow recognizing hand gestures. In response to detecting the portion of the user's body, the method includes generating at least one widget interaction region corresponding to the portion of the user's body. The method further includes recognizing, a mid-air hand gesture in the at least one widget interaction region, mapping the mid-air hand gesture to at least one virtual widget on the gesture-controlled device, and manipulating the at least one virtual widget based on the mid-air hand gesture. The method and device allow manipulation of virtual widgets using mid-air gestures on a gesture-controlled device.
-
公开(公告)号:US20230145592A1
公开(公告)日:2023-05-11
申请号:US17523267
申请日:2021-11-10
申请人: Gaganpreet SINGH , Wei ZHOU , Pourang Polad IRANI , Wei LI
发明人: Gaganpreet SINGH , Wei ZHOU , Pourang Polad IRANI , Wei LI
IPC分类号: G06F3/01 , G06F3/03 , G06K9/00 , H04N21/422 , H04N21/472
CPC分类号: G06F3/017 , G06F3/0304 , G06K9/00355 , G06K9/00375 , G06K9/00744 , H04N21/42204 , H04N21/47205
摘要: Method and systems for controlling a display device, including detecting a mid-air gesture using a sensing device; mapping the detected mid-air gesture to locations of an interaction region, the interaction region including an on-screen region of the display device and an off-screen region that is located outside an edge of the on-screen region; and performing a display device control action upon detecting an edge interaction based on the mapping of the detected mid-air gesture to locations that interact with the edge of the on-screen region.
-
10.
公开(公告)号:US20220187983A1
公开(公告)日:2022-06-16
申请号:US17119853
申请日:2020-12-11
申请人: Gaganpreet SINGH , Qiang XU , Wei LI
发明人: Gaganpreet SINGH , Qiang XU , Wei LI
IPC分类号: G06F3/0488 , G06F3/0485 , G06F3/0482
摘要: Methods of detection of swipe gestures and filtering and locating desired information in a multi-attributed search space in response to detection of swipe gestures and devices for performing the same are provided. The method includes activating an attribute associated with at least one element of a list of elements having a visible list portion rendered on the viewing area, in response to receiving an activation input for the attribute and displaying a plurality of attribute field controls associated with the attribute, in response to its activation. The method further includes receiving a manipulation action of at least one attribute field control, updating an attribute value in response to the manipulation action, and updating the visible list portion based on the attribute value. The method may be used with touchscreen displays, and with virtual or augmented reality displays.
-
-
-
-
-
-
-
-
-