公开(公告)号：US12093704B2

公开(公告)日：2024-09-17

申请号：US17228087

申请日：2021-04-12

申请人： Taslim Arefin Khan ,  Szu Wen Fan ,  Changqing Zou ,  Jianpeng Xu ,  Wei Li

发明人： Taslim Arefin Khan ,  Szu Wen Fan ,  Changqing Zou ,  Jianpeng Xu ,  Wei Li

IPC分类号： G06F9/451 ,  G06F3/04815 ,  G06F3/14 ,  G06T19/00 ,  G06F16/90

CPC分类号： G06F9/451 ,  G06F3/04815 ,  G06F3/1423 ,  G06T19/006 ,  G06F16/90

摘要： Devices, methods, systems, and media are described for providing an extended screen distributed user interface in an augmented reality environment. GUI layout information for laying out a conventional 2D GUI is processed in order to generate an extended screen DUI for display partially on a 2D display device and partially on one or more virtual screens of an AR environment viewed using an AR display device, such as a head mounted display. GUI elements are laid out in the DUI based on a primary modality of the GUI element (input or output), and/or based on spatial dependencies between GUI elements encoded in the GUI layout information. Methods for switching focus between two software application instances displayed in the DUI are also disclosed.

公开(公告)号：US20230121388A1

公开(公告)日：2023-04-20

申请号：US17501915

申请日：2021-10-14

申请人： Taslim Arefin KHAN ,  Szu Wen FAN ,  Wei LI

发明人： Taslim Arefin KHAN ,  Szu Wen FAN ,  Wei LI

IPC分类号： B60W50/14 ,  B60W50/00 ,  B60W30/095 ,  B60W40/105 ,  B60K35/00

摘要： The present disclosure describes systems and methods for providing driver assistance. A current vehicle state of a vehicle at a current timestep and an environment map representing an environment of the vehicle at least at the current timestep are obtained. Augmented reality feedback is generated including a virtual vehicle representing a predicted future vehicle state, where the predicted future vehicle state is predicted for a given future timestep based on at least one of the current vehicle state or the current environment. The generated augmented reality feedback including the virtual vehicle is outputted to be displayed by a display device.

公开(公告)号：US11475642B2

公开(公告)日：2022-10-18

申请号：US17127022

申请日：2020-12-18

申请人： Szu Wen Fan ,  Taslim Arefin Khan ,  Wei Li

发明人： Szu Wen Fan ,  Taslim Arefin Khan ,  Wei Li

IPC分类号： G06T19/00 ,  G06F17/16 ,  G06T15/06 ,  G06F3/04842

摘要： Methods and systems for selecting an object or location in an extended reality (XR) environment or physical environment are described. A first origin, including a first position and a first direction, and a second origin, including a second position and a second direction, are obtained by at least one sensor. An intersection of a first ray, casted from the first origin, and a second ray, casted from the second origin, is determined. A selected object or selected location is identified, based on the determined intersection. An identification of the selected object or the selected location is outputted.

公开(公告)号：US20220326967A1

公开(公告)日：2022-10-13

申请号：US17228087

申请日：2021-04-12

申请人： Taslim Arefin KHAN ,  Szu Wen FAN ,  Changqing ZOU ,  Jianpeng XU ,  Wei LI

发明人： Taslim Arefin KHAN ,  Szu Wen FAN ,  Changqing ZOU ,  Jianpeng XU ,  Wei LI

IPC分类号： G06F9/451 ,  G06F3/0481 ,  G06F3/14 ,  G06T19/00

摘要： Devices, methods, systems, and media are described for providing an extended screen distributed user interface in an augmented reality environment. GUI layout information for laying out a conventional 2D GUI is processed in order to generate an extended screen DUI for display partially on a 2D display device and partially on one or more virtual screens of an AR environment viewed using an AR display device, such as a head mounted display. GUI elements are laid out in the DUI based on a primary modality of the GUI element (input or output), and/or based on spatial dependencies between GUI elements encoded in the GUI layout information. Methods for switching focus between two software application instances displayed in the DUI are also disclosed.

公开(公告)号：US20230013169A1

公开(公告)日：2023-01-19

申请号：US17943841

申请日：2022-09-13

申请人： Wei LI ,  Wei ZHOU ,  Sachi MIZOBUCHI ,  Ghazaleh SANIEE-MONFARED ,  Juwei LU ,  Taslim Arefin KHAN ,  Rafael VERAS GUIMARAES

发明人： Wei LI ,  Wei ZHOU ,  Sachi MIZOBUCHI ,  Ghazaleh SANIEE-MONFARED ,  Juwei LU ,  Taslim Arefin KHAN ,  Rafael VERAS GUIMARAES

IPC分类号： G06F3/01 ,  G06V40/20 ,  G06T7/70 ,  G06T7/50 ,  G06T7/20 ,  G06V10/25

摘要： Methods, devices, and processor-readable media for adjusting the control-display gain of a gesture-controlled device are described. Adjusting the control-display gain may facilitate user interaction with content or UI elements rendered on a display screen of the gesture-controlled device. The control-display gain may be adjusted based on a property of how a mid-air dragging gesture is being performed by a user's hand. The property may be the location of the gesture, the orientation of the hand performing the gesture, or the velocity of the gesture. A hand that becomes stationary for a threshold time period while performing the dragging gesture may adjust the control-display gain to a different level. Control-display gain may be set to a different value based on the current velocity of the hand performing the gesture. The control-display gain levels may be selected from a continuous range of values or a set of discrete values. Devices for performing the methods are described.

公开(公告)号：US20220198756A1

公开(公告)日：2022-06-23

申请号：US17127022

申请日：2020-12-18

申请人： Szu Wen FAN ,  Taslim Arefin KHAN ,  Wei LI

发明人： Szu Wen FAN ,  Taslim Arefin KHAN ,  Wei LI

IPC分类号： G06T19/00 ,  G06F3/0484 ,  G06T15/06 ,  G06F17/16

摘要： Methods and systems for selecting an object or location in an extended reality (XR) environment or physical environment are described. A first origin, including a first position and a first direction, and a second origin, including a second position and a second direction, are obtained by at least one sensor. An intersection of a first ray, casted from the first origin, and a second ray, casted from the second origin, is determined. A selected object or selected location is identified, based on the determined intersection. An identification of the selected object or the selected location is outputted.

公开(公告)号：US20170278426A1

公开(公告)日：2017-09-28

申请号：US15079316

申请日：2016-03-24

申请人： Tusher Chakraborty ,  Taslim Arefin Khan ,  A. B. M. Alim Al Islam

发明人： Tusher Chakraborty ,  Taslim Arefin Khan ,  A. B. M. Alim Al Islam

IPC分类号： G09B21/00

CPC分类号： G09B21/008

摘要： The subject matter disclosed herein relates to a method and design of a system that helps visually-impaired persons to identify Braille characters or geometric shapes such as rectangle, triangle, circle, etc. A Braille character is any combination of six dots that represents an alphanumeric character. The dot of Braille character is represented using a small colored region over a surface, which can be a paper. The color of dot is distinct from the color of surface. The system contains a coupling comprising a pair of light source and light sensor. The system enables recognizing printed Braille characters through identifying distinct colored dots of Braille characters, by sensing real-time deviation in illuminance of light reflected off the surface containing the printed Braille characters. The output of the system encompasses perceivable signal.

公开(公告)号：US11809637B2

公开(公告)日：2023-11-07

申请号：US17943841

申请日：2022-09-13

申请人： Wei Li ,  Wei Zhou ,  Sachi Mizobuchi ,  Ghazaleh Saniee-Monfared ,  Juwei Lu ,  Taslim Arefin Khan ,  Rafael Veras Guimaraes

发明人： Wei Li ,  Wei Zhou ,  Sachi Mizobuchi ,  Ghazaleh Saniee-Monfared ,  Juwei Lu ,  Taslim Arefin Khan ,  Rafael Veras Guimaraes

IPC分类号： G06F3/01 ,  G06F3/04815 ,  G06T7/70 ,  G06T7/20 ,  G06T7/50 ,  G06V40/20 ,  G06V10/25

CPC分类号： G06F3/017 ,  G06F3/011 ,  G06F3/013 ,  G06T7/20 ,  G06T7/50 ,  G06T7/70 ,  G06V10/25 ,  G06V40/28 ,  G06F3/04815 ,  G06T2200/24 ,  G06T2207/30196

摘要： Methods, devices, and processor-readable media for adjusting the control-display gain of a gesture-controlled device are described. Adjusting the control-display gain may facilitate user interaction with content or UI elements rendered on a display screen of the gesture-controlled device. The control-display gain may be adjusted based on a property of how a mid-air dragging gesture is being performed by a user's hand. The property may be the location of the gesture, the orientation of the hand performing the gesture, or the velocity of the gesture. A hand that becomes stationary for a threshold time period while performing the dragging gesture may adjust the control-display gain to a different level. Control-display gain may be set to a different value based on the current velocity of the hand performing the gesture. The control-display gain levels may be selected from a continuous range of values or a set of discrete values. Devices for performing the methods are described.

公开(公告)号：US20230013860A1

公开(公告)日：2023-01-19

申请号：US17940435

申请日：2022-09-08

申请人： Szu Wen FAN ,  Taslim Arefin KHAN ,  Wei LI

发明人： Szu Wen FAN ,  Taslim Arefin KHAN ,  Wei LI

IPC分类号： G06T19/00 ,  G06F17/16 ,  G06T15/06 ,  G06F3/04842

摘要： Methods and systems for selecting an object or location in an extended reality (XR) environment or physical environment are described. A first origin, including a first position and a first direction, and a second origin, including a second position and a second direction, are obtained by at least one sensor. An intersection of a first ray, casted from the first origin, and a second ray, casted from the second origin, is determined. A selected object or selected location is identified, based on the determined intersection. An identification of the selected object or the selected location is outputted.

公开(公告)号：US20210333884A1

公开(公告)日：2021-10-28

申请号：US17085866

申请日：2020-10-30

申请人： Wei LI ,  Wei ZHOU ,  Sachi MIZOBUCHI ,  Ghazaleh SANIEE-MONFARED ,  Juwei LU ,  Taslim Arefin KHAN ,  Rafael VERAS GUIMARAES

发明人： Wei LI ,  Wei ZHOU ,  Sachi MIZOBUCHI ,  Ghazaleh SANIEE-MONFARED ,  Juwei LU ,  Taslim Arefin KHAN ,  Rafael VERAS GUIMARAES

IPC分类号： G06F3/01 ,  G06T7/70 ,  G06T7/50 ,  G06T7/20

摘要： Methods, devices, and processor-readable media for adjusting the control-display gain of a gesture-controlled device are described. Adjusting the control-display gain may facilitate user interaction with content or UI elements rendered on a display screen of the gesture-controlled device. The control-display gain may be adjusted based on a property of how a mid-air dragging gesture is being performed by a user's hand. The property may be the location of the gesture, the orientation of the hand performing the gesture, or the velocity of the gesture. A hand that becomes stationary for a threshold time period while performing the dragging gesture may adjust the control-display gain to a different level. Control-display gain may be set to a different value based on the current velocity of the hand performing the gesture. The control-display gain levels may be selected from a continuous range of values or a set of discrete values. Devices for performing the methods are described.