公开(公告)号：US20230059153A1

公开(公告)日：2023-02-23

申请号：US17408201

申请日：2021-08-20

申请人： Wei ZHOU ,  Mona HOSSEINKHANI LOORAK ,  Ghazaleh SANIEE-MONFARED ,  Sachi MIZOBUCHI ,  Xiu YI ,  Pourang Polad IRANI ,  Jian ZHAO ,  Wei LI

发明人： Wei ZHOU ,  Mona HOSSEINKHANI LOORAK ,  Ghazaleh SANIEE-MONFARED ,  Sachi MIZOBUCHI ,  Xiu YI ,  Pourang Polad IRANI ,  Jian ZHAO ,  Wei LI

IPC分类号： G06F3/01 ,  G06F3/03 ,  G06F3/0484

摘要： Methods, devices, and media are disclosed for mapping of input and output spaces in head-based human-computer interactions. In some embodiments, an end-to-end method is described for designing a head-based user interface, calibrating the interface to individual users, and interacting with a user in real time by mapping head-based user inputs to an output space in a way that optimizes the target selection efficiency of the interaction. Head orientation may be leveraged to define the mapping between the user input and the output space.

公开(公告)号：US20220197494A1

公开(公告)日：2022-06-23

申请号：US17127825

申请日：2020-12-18

申请人： Wei LI ,  Sachi MIZOBUCHI

发明人： Wei LI ,  Sachi MIZOBUCHI

IPC分类号： G06F3/0488 ,  G06F3/0485 ,  G06F3/041 ,  G06F3/0484

摘要： Devices and methods for controlling an electronic device are provided. The methods include recognizing a two finger input gesture on at least two touch sensitive surfaces of the electronic device and manipulating a slider control rendered on a display in response to recognizing the two finger input gesture. Recognizing the two finger input gesture includes detecting a first input gesture, including a swipe gesture on a first touch sensitive surface and detecting a second input gesture, including a static touch at a location on a second touch sensitive surface. The first input gesture and the second input gesture happen in a same time period. The static touch location may be a soft button of a plurality of buttons and the slider control may be rendered in response to the static touch on the soft button. The method may be used in an electronic device having multiple touchscreen displays.

公开(公告)号：US07142231B2

公开(公告)日：2006-11-28

申请号：US10748100

申请日：2003-12-29

申请人： Jan Chipchase ,  Sachi Mizobuchi ,  Makoto Sugano ,  Heikki Waris

发明人： Jan Chipchase ,  Sachi Mizobuchi ,  Makoto Sugano ,  Heikki Waris

IPC分类号： H04N7/14

CPC分类号： H04M1/72522 ,  H04M2250/12 ,  H04M2250/52

摘要： This invention provides a handset (10) and a method of operating a handset. The handset includes a user interface that contains a data entry device (20) and a visual display device (14), a camera (16) and a controller (12) coupled to the visual display device and to the camera. The controller operates under the control of a stored program (22A) for displaying to a user an image representative of at least a portion of an environment of the user as seen through the camera during a time that the user is interacting with the user interface. The controller may further operate under control of the stored program to process images generated by the camera to detect a potential for a collision with an object that is present in the environment of the user, and to warn the user of the potential for a collision.

摘要翻译： 本发明提供了一种手机（10）和操作手机的方法。 手机包括用户界面，其包含耦合到可视显示装置和相机的数据输入装置（20）和视觉显示装置（14），相机（16）和控制器（12）。 控制器在存储的程序（22A）的控制下操作，以在用户与用户界面交互的时间期间向用户显示代表用户的环境的至少一部分的图像 。 控制器还可以在所存储的程序的控制下进行操作，以处理由相机生成的图像，以检测与存在于用户环境中的对象发生碰撞的可能性，并且向用户警告潜在的冲突。

公开(公告)号：US11921931B2

公开(公告)日：2024-03-05

申请号：US17125462

申请日：2020-12-17

申请人： Wei Zhou ,  Sachi Mizobuchi ,  Rafael Veras Guimaraes ,  Ghazaleh Saniee-Monfared ,  Wei Li

发明人： Wei Zhou ,  Sachi Mizobuchi ,  Rafael Veras Guimaraes ,  Ghazaleh Saniee-Monfared ,  Wei Li

IPC分类号： G06F3/01 ,  G06F3/04815 ,  G06F3/04845 ,  G06F3/04847 ,  G06V20/40 ,  G06V40/10 ,  G06V40/20

CPC分类号： G06F3/017 ,  G06F3/04815 ,  G06F3/04845 ,  G06F3/04847 ,  G06V20/46 ,  G06V40/107 ,  G06V40/28

摘要： Methods and systems for discrete control of user interface elements such as graphical widgets are described. A first plurality of video frames are captured and processed to recognize hand gestures therein. A dragging mode is activated in response to a dragging mode activation hand gesture in the first plurality of frames. A second plurality of video frames are captured and processed to allow recognition of hand gestures therein. Dragging, an element of a user interface control, in response to recognition of a discrete control hand gesture in the second plurality of frames. The discrete control of a user interface control using mid-air hand gestures allows precise setting of system parameters associated with the user interface control.

公开(公告)号：US11693551B2

公开(公告)日：2023-07-04

申请号：US17326579

申请日：2021-05-21

申请人： Wei Zhou ,  Sachi Mizobuchi ,  Gaganpreet Singh ,  Ghazaleh Saniee-Monfared ,  Sitao Wang ,  Futian Zhang ,  Wei Li

发明人： Wei Zhou ,  Sachi Mizobuchi ,  Gaganpreet Singh ,  Ghazaleh Saniee-Monfared ,  Sitao Wang ,  Futian Zhang ,  Wei Li

IPC分类号： G06F3/01 ,  G06F3/04847 ,  G06F3/16

CPC分类号： G06F3/04847 ,  G06F3/017 ,  G06F3/167

摘要： Devices and methods for providing feedback for a control display (CD) gain of a slider control on a gesture-controlled device are described. The method includes detecting a speed of a dynamic dragging gesture, determining the CD gain for the slider control based on the speed, and generating an auditory feedback or a visual feedback for the CD gain. A gesture-controlled device, which carries out the method, may have an image-capturing device, a processor, and a memory coupled to the processor, the memory storing machine-executable instructions for carrying out the method. Advantageously, providing feedback for CD gain of a slider control facilitates accurate adjustment of a system parameter associated with the slider control. The devices and methods may be used in industrial applications, vehicle control among other applications.

公开(公告)号：US07554530B2

公开(公告)日：2009-06-30

申请号：US10328193

申请日：2002-12-23

申请人： Sachi Mizobuchi ,  Eigo Mori

发明人： Sachi Mizobuchi ,  Eigo Mori

IPC分类号： G09G5/00

CPC分类号： G06F3/04883

摘要： A method is disclosed to operate a touch screen user interface. The method includes forming a stroke that encloses an area that contains at least a portion of at least one displayed object; and selecting the at least one displayed object. Forming the stroke may further include extending the stroke to a functional object, and activating the functional object with the at least one selected displayed object. If the stroke does not define an area that is totally enclosed by the stroke, the method may further include automatically continuing the stroke such that the area is totally enclosed by the stroke. In this case the stroke may be automatically continued by drawing a line that connects a stroke starting point to a stroke ending point, and by adding touch screen coordinates covered by the line to a list of touch screen coordinates that describe the stroke. If the stroke encloses an area that contains at least a portion of a plurality of displayed objects, each of the displayed objects is simultaneously selected.

摘要翻译： 公开了一种操作触摸屏用户界面的方法。 该方法包括形成包围包含至少一个显示对象的至少一部分的区域的笔划; 以及选择所述至少一个所显示的对象。 形成笔划还可以包括将笔划延伸到功能对象，以及利用至少一个所选择的显示对象激活功能对象。 如果行程没有限定由行程完全包围的区域，则该方法还可以包括自动地继续行程，使得区域被行程完全包围。 在这种情况下，可以通过绘制将笔划起始点连接到笔画结束点的线并通过将线所覆盖的触摸屏坐标添加到描述笔画的触摸屏坐标的列表来自动继续笔划。 如果行程包围包含多个显示对象的至少一部分的区域，则同时选择每个所显示的对象。

公开(公告)号：US11797081B2

公开(公告)日：2023-10-24

申请号：US17408201

申请日：2021-08-20

申请人： Wei Zhou ,  Mona Hosseinkhani Loorak ,  Ghazaleh Saniee-Monfared ,  Sachi Mizobuchi ,  Xiu Yi ,  Pourang Polad Irani ,  Jian Zhao ,  Wei Li

发明人： Wei Zhou ,  Mona Hosseinkhani Loorak ,  Ghazaleh Saniee-Monfared ,  Sachi Mizobuchi ,  Xiu Yi ,  Pourang Polad Irani ,  Jian Zhao ,  Wei Li

IPC分类号： G06F3/01 ,  G06F3/04847 ,  G06F3/03 ,  G06F3/04842

CPC分类号： G06F3/012 ,  G06F3/013 ,  G06F3/017 ,  G06F3/03 ,  G06F3/04842 ,  G06F3/04847

摘要： Methods, devices, and media are disclosed for mapping of input and output spaces in head-based human-computer interactions. In some embodiments, an end-to-end method is described for designing a head-based user interface, calibrating the interface to individual users, and interacting with a user in real time by mapping head-based user inputs to an output space in a way that optimizes the target selection efficiency of the interaction. Head orientation may be leveraged to define the mapping between the user input and the output space.

公开(公告)号：US20230116341A1

公开(公告)日：2023-04-13

申请号：US17958177

申请日：2022-09-30

申请人： Futian ZHANG ,  Edward LANK ,  Sachi MIZOBUCHI ,  Gaganpreet SINGH ,  Wei ZHOU ,  Wei LI

发明人： Futian ZHANG ,  Edward LANK ,  Sachi MIZOBUCHI ,  Gaganpreet SINGH ,  Wei ZHOU ,  Wei LI

IPC分类号： G06F3/01 ,  G06F3/0485 ,  G06V40/20

摘要： Methods and apparatuses for controlling a selection focus of a user interface using gestures, in particular mid-air hand gestures, are described. A hand is detected within a defined activation region in a first frame of video data. The detected hand is tracked to determine a tracked location of the detected hand in at least a second frame of video data. A control signal is outputted to control the selection focus to focus on a target in the user interface, where movement of the selection focus is controlled based on a displacement between the tracked location and a reference location in the activation region.

公开(公告)号：US20230078074A1

公开(公告)日：2023-03-16

申请号：US17991279

申请日：2022-11-21

申请人： Wenshu LUO ,  Sachi MIZOBUCHI ,  Wei ZHOU ,  Wei LI

发明人： Wenshu LUO ,  Sachi MIZOBUCHI ,  Wei ZHOU ,  Wei LI

IPC分类号： G06F3/01 ,  G06T7/70 ,  G06T7/20 ,  B60R16/023 ,  G06F3/16 ,  G06V20/59 ,  G06V40/10

摘要： Methods, devices, and processor-readable media for hand-on-wheel gesture controls are described. A steering wheel is virtually segmented into a plurality of radial segments. Each segment is assigned a semantic meaning. Control commands related to control functions are mapped to different virtual segments of the steering wheel. When a user performs a gesture on the steering wheel, the system recognizes the gesture and selects a control function based on the location of the hand relative to the steering wheel. In various embodiments, on-wheel hand gestures, on-wheel hand location, and voice commands may be used in various combinations to enable a user to perform a wide selection of functions using a small number of unique commands.

公开(公告)号：US20220374138A1

公开(公告)日：2022-11-24

申请号：US17326579

申请日：2021-05-21

申请人： Wei ZHOU ,  Sachi MIZOBUCHI ,  Gaganpreet SINGH ,  Ghazaleh SANIEE-MONFARED ,  Sitao WANG ,  Futian ZHANG ,  Wei LI

发明人： Wei ZHOU ,  Sachi MIZOBUCHI ,  Gaganpreet SINGH ,  Ghazaleh SANIEE-MONFARED ,  Sitao WANG ,  Futian ZHANG ,  Wei LI

IPC分类号： G06F3/0484 ,  G06F3/01 ,  G06F3/16

摘要： Devices and methods for providing feedback for a control display (CD) gain of a slider control on a gesture-controlled device are described. The method includes detecting a speed of a dynamic dragging gesture, determining the CD gain for the slider control based on the speed, and generating an auditory feedback or a visual feedback for the CD gain. A gesture-controlled device, which carries out the method, may have an image-capturing device, a processor, and a memory coupled to the processor, the memory storing machine-executable instructions for carrying out the method. Advantageously, providing feedback for CD gain of a slider control facilitates accurate adjustment of a system parameter associated with the slider control. The devices and methods may be used in industrial applications, vehicle control among other applications.