-
1.
公开(公告)号:US11474614B2
公开(公告)日:2022-10-18
申请号:US17085866
申请日:2020-10-30
申请人: Wei Li , Wei Zhou , Sachi Mizobuchi , Ghazaleh Saniee-Monfared , Juwei Lu , Taslim Arefin Khan , Rafael Veras Guimaraes
发明人: Wei Li , Wei Zhou , Sachi Mizobuchi , Ghazaleh Saniee-Monfared , Juwei Lu , Taslim Arefin Khan , Rafael Veras Guimaraes
摘要: Methods, devices, and processor-readable media for adjusting the control-display gain of a gesture-controlled device are described. Adjusting the control-display gain may facilitate user interaction with content or UI elements rendered on a display screen of the gesture-controlled device. The control-display gain may be adjusted based on a property of how a mid-air dragging gesture is being performed by a user's hand. The property may be the location of the gesture, the orientation of the hand performing the gesture, or the velocity of the gesture. A hand that becomes stationary for a threshold time period while performing the dragging gesture may adjust the control-display gain to a different level. Control-display gain may be set to a different value based on the current velocity of the hand performing the gesture. The control-display gain levels may be selected from a continuous range of values or a set of discrete values. Devices for performing the methods are described.
-
2.
公开(公告)号:US20230013169A1
公开(公告)日:2023-01-19
申请号:US17943841
申请日:2022-09-13
申请人: Wei LI , Wei ZHOU , Sachi MIZOBUCHI , Ghazaleh SANIEE-MONFARED , Juwei LU , Taslim Arefin KHAN , Rafael VERAS GUIMARAES
发明人: Wei LI , Wei ZHOU , Sachi MIZOBUCHI , Ghazaleh SANIEE-MONFARED , Juwei LU , Taslim Arefin KHAN , Rafael VERAS GUIMARAES
摘要: Methods, devices, and processor-readable media for adjusting the control-display gain of a gesture-controlled device are described. Adjusting the control-display gain may facilitate user interaction with content or UI elements rendered on a display screen of the gesture-controlled device. The control-display gain may be adjusted based on a property of how a mid-air dragging gesture is being performed by a user's hand. The property may be the location of the gesture, the orientation of the hand performing the gesture, or the velocity of the gesture. A hand that becomes stationary for a threshold time period while performing the dragging gesture may adjust the control-display gain to a different level. Control-display gain may be set to a different value based on the current velocity of the hand performing the gesture. The control-display gain levels may be selected from a continuous range of values or a set of discrete values. Devices for performing the methods are described.
-
公开(公告)号:US11301049B2
公开(公告)日:2022-04-12
申请号:US17024633
申请日:2020-09-17
申请人: Gaganpreet Singh , Rafael Veras Guimaraes , Wei Zhou , Pourang Polad Irani , Farzin Farhadi-Niaki , Wei Li
发明人: Gaganpreet Singh , Rafael Veras Guimaraes , Wei Zhou , Pourang Polad Irani , Farzin Farhadi-Niaki , Wei Li
摘要: User interface control based on elbow-anchored arm gestures is disclosed. In one aspect, there is provided a method of user interface control on a computing device based on elbow-anchored arm gestures. A visual user interface (VUI) screen is displayed on a display of a computing device. The VUI screen comprises a plurality of VUI elements arranged in a plurality of VUI element levels. Each VUI element level comprising one or more VUI elements. A spatial location of an elbow of an arm of a user and a spatial location of a wrist of the arm of the user are determined. A three-dimensional (3D) arm vector extending from the spatial location of the elbow to the spatial location of the wrist is then determined. A VUI element in the VUI screen corresponding to the 3D arm vector is then determined based on a predetermined 3D spatial mapping between 3D arm vectors and VUI elements for the VUI screen.
-
公开(公告)号:US11921931B2
公开(公告)日:2024-03-05
申请号:US17125462
申请日:2020-12-17
IPC分类号: G06F3/01 , G06F3/04815 , G06F3/04845 , G06F3/04847 , G06V20/40 , G06V40/10 , G06V40/20
CPC分类号: G06F3/017 , G06F3/04815 , G06F3/04845 , G06F3/04847 , G06V20/46 , G06V40/107 , G06V40/28
摘要: Methods and systems for discrete control of user interface elements such as graphical widgets are described. A first plurality of video frames are captured and processed to recognize hand gestures therein. A dragging mode is activated in response to a dragging mode activation hand gesture in the first plurality of frames. A second plurality of video frames are captured and processed to allow recognition of hand gestures therein. Dragging, an element of a user interface control, in response to recognition of a discrete control hand gesture in the second plurality of frames. The discrete control of a user interface control using mid-air hand gestures allows precise setting of system parameters associated with the user interface control.
-
公开(公告)号:US20210081052A1
公开(公告)日:2021-03-18
申请号:US17024633
申请日:2020-09-17
申请人: Gaganpreet SINGH , Rafael VERAS GUIMARAES , Wei ZHOU , Pourang Polad IRANI , Farzin FARHADI-NIAKI , Wei LI
发明人: Gaganpreet SINGH , Rafael VERAS GUIMARAES , Wei ZHOU , Pourang Polad IRANI , Farzin FARHADI-NIAKI , Wei LI
摘要: User interface control based on elbow-anchored arm gestures is disclosed. In one aspect, there is provided a method of user interface control on a computing device based on elbow-anchored arm gestures. A visual user interface (VUI) screen is displayed on a display of a computing device. The VUI screen comprises a plurality of VUI elements arranged in a plurality of VUI element levels. Each VUI element level comprising one or more VUI elements. A spatial location of an elbow of an arm of a user and a spatial location of a wrist of the arm of the user are determined. A three-dimensional (3D) arm vector extending from the spatial location of the elbow to the spatial location of the wrist is then determined. A VUI element in the VUI screen corresponding to the 3D arm vector is then determined based on a predetermined 3D spatial mapping between 3D arm vectors and VUI elements for the VUI screen.
-
6.
公开(公告)号:US11809637B2
公开(公告)日:2023-11-07
申请号:US17943841
申请日:2022-09-13
申请人: Wei Li , Wei Zhou , Sachi Mizobuchi , Ghazaleh Saniee-Monfared , Juwei Lu , Taslim Arefin Khan , Rafael Veras Guimaraes
发明人: Wei Li , Wei Zhou , Sachi Mizobuchi , Ghazaleh Saniee-Monfared , Juwei Lu , Taslim Arefin Khan , Rafael Veras Guimaraes
CPC分类号: G06F3/017 , G06F3/011 , G06F3/013 , G06T7/20 , G06T7/50 , G06T7/70 , G06V10/25 , G06V40/28 , G06F3/04815 , G06T2200/24 , G06T2207/30196
摘要: Methods, devices, and processor-readable media for adjusting the control-display gain of a gesture-controlled device are described. Adjusting the control-display gain may facilitate user interaction with content or UI elements rendered on a display screen of the gesture-controlled device. The control-display gain may be adjusted based on a property of how a mid-air dragging gesture is being performed by a user's hand. The property may be the location of the gesture, the orientation of the hand performing the gesture, or the velocity of the gesture. A hand that becomes stationary for a threshold time period while performing the dragging gesture may adjust the control-display gain to a different level. Control-display gain may be set to a different value based on the current velocity of the hand performing the gesture. The control-display gain levels may be selected from a continuous range of values or a set of discrete values. Devices for performing the methods are described.
-
公开(公告)号:US20220197392A1
公开(公告)日:2022-06-23
申请号:US17125462
申请日:2020-12-17
IPC分类号: G06F3/01 , G06F3/0484 , G06F3/0481 , G06K9/00
摘要: Methods and systems for discrete control of user interface elements such as graphical widgets are described. A first plurality of video frames are captured and processed to recognize hand gestures therein. A dragging mode is activated in response to a dragging mode activation hand gesture in the first plurality of frames. A second plurality of video frames are captured and processed to allow recognition of hand gestures therein. Dragging, an element of a user interface control, in response to recognition of a discrete control hand gesture in the second plurality of frames. The discrete control of a user interface control using mid-air hand gestures allows precise setting of system parameters associated with the user interface control.
-
8.
公开(公告)号:US20210333884A1
公开(公告)日:2021-10-28
申请号:US17085866
申请日:2020-10-30
申请人: Wei LI , Wei ZHOU , Sachi MIZOBUCHI , Ghazaleh SANIEE-MONFARED , Juwei LU , Taslim Arefin KHAN , Rafael VERAS GUIMARAES
发明人: Wei LI , Wei ZHOU , Sachi MIZOBUCHI , Ghazaleh SANIEE-MONFARED , Juwei LU , Taslim Arefin KHAN , Rafael VERAS GUIMARAES
摘要: Methods, devices, and processor-readable media for adjusting the control-display gain of a gesture-controlled device are described. Adjusting the control-display gain may facilitate user interaction with content or UI elements rendered on a display screen of the gesture-controlled device. The control-display gain may be adjusted based on a property of how a mid-air dragging gesture is being performed by a user's hand. The property may be the location of the gesture, the orientation of the hand performing the gesture, or the velocity of the gesture. A hand that becomes stationary for a threshold time period while performing the dragging gesture may adjust the control-display gain to a different level. Control-display gain may be set to a different value based on the current velocity of the hand performing the gesture. The control-display gain levels may be selected from a continuous range of values or a set of discrete values. Devices for performing the methods are described.
-
-
-
-
-
-
-