公开(公告)号：US20210192135A1

公开(公告)日：2021-06-24

申请号：US17192105

申请日：2021-03-04

Applicant: Google LLC

Inventor： Yu Ouyang ,  Shumin Zhai ,  Xiaojun Bi

IPC: G06F40/274 ,  G06F3/023 ,  G06F3/0484 ,  G06F3/0488 ,  G06F3/01

Abstract: A computing device outputs a keyboard for display, receives an indication of a first gesture to select a first sequence of one or more keys, determines a set of candidate strings based in part on the first sequence of keys, and outputs for display at least one of the set of candidate strings. The computing device receives an indication of a second gesture to select a second sequence of one or more keys, and determines that characters associated with the second sequence of keys are included in a first candidate word based at least in part on the set of candidate strings, or are included in a second candidate word not based on the first sequence of keys. The computing device modifies the set of candidate strings based at least in part on the determination and outputs for display at least one of the modified candidate strings.

公开(公告)号：US20200257391A1

公开(公告)日：2020-08-13

申请号：US16859457

申请日：2020-04-27

Applicant: Google LLC

Inventor： Tyler Reed Kugler ,  Alexey Polyudov ,  Seungyon Lee ,  Yun-Ling Lee ,  Philip Quinn ,  Kishore Sundara-Rajan ,  Shumin Zhai ,  Debanjan Mukherjee ,  James B. Miller ,  Isaac William Reynolds

IPC: G06F3/045 ,  G06F3/01 ,  G06F3/0482 ,  G06F3/041 ,  G06F21/32 ,  G06F3/0346 ,  G06F3/0484 ,  G06F3/0485 ,  G06F1/16 ,  G06F3/0488

Abstract: A method includes a processor of an electronic device receiving first input signals from a first sensor in response to user contact at a first edge of the device and second input signals from a second sensor in response to user contact at a second edge of the electronic device. The first and second sensors are covered by a housing of the device. The processor determines an external context of the device based on analysis of the first input signals and the second input signals. The determined external context indicates at least a position of the device relative to a user or an orientation of the device relative to a user. Responsive to determining the external context, the electronic device executes a particular user input action.

公开(公告)号：US20190033970A1

公开(公告)日：2019-01-31

申请号：US15660773

申请日：2017-07-26

Applicant: Google LLC

Inventor： Madeleine Mellor ,  Shumin Zhai ,  Seungyon (Claire) Lee

IPC: G06F3/01 ,  G06F3/0485

CPC classification number: G06F3/016 ,  G06F3/0482 ,  G06F3/0485 ,  G06F3/0488 ,  G06F3/04886 ,  G06T13/80 ,  H04L51/10

Abstract: Apparatus and methods related to visual and haptic feedback on mobile devices are provided. A computing device can present a symbol queue that includes a particular symbol on a screen. The computing device can receive user input to move through the symbol queue. In response to the user input, the computing device can: animate the particular symbol on the screen by at least presenting an expanded item display that includes at least the particular symbol and a particular informational item associated with the particular symbol, and generate haptic feedback that is synchronized with animating the particular symbol on the screen.

公开(公告)号：US20240192779A1

公开(公告)日：2024-06-13

申请号：US18553033

申请日：2021-03-31

Applicant: Google LLC

Inventor： Shumin Zhai ,  Scott Jenson ,  Hong Z. Tan

IPC: G06F3/01

CPC classification number: G06F3/016

Abstract: A computing device may determine a haptic effect to be produced by a haptic device of the computing device. The computing device may select, based at least in part on the haptic effect, a modulation frequency. The computing device may determine a combination of a carrier frequency and the modulation frequency to produce the haptic effect. The computing device may drive the haptic device according to the combination of the carrier frequency and the modulation frequency to output a vibration pattern associated with the haptic effect.

公开(公告)号：US20220229988A1

公开(公告)日：2022-07-21

申请号：US17658227

申请日：2022-04-06

Applicant: Google LLC

Inventor： Shumin Zhai ,  Ciprian Ioan Chelba

IPC: G06F40/284 ,  G06F3/04886 ,  G06F3/023 ,  G06F3/04883 ,  H04L51/02 ,  G06F40/242 ,  G06F40/263

Abstract: A computing device outputs for display at a presence-sensitive display, a graphical keyboard comprising a plurality of keys, receives an indication of at least one gesture to select a group of keys of the plurality of keys, and determines at least one characteristic associated with the at least one gesture to select the group of keys of the plurality of keys. The computing device modifies a spatial model based at least in part on the at least one characteristic and determines a candidate word based at least in part on data provided by the spatial model and a language model, wherein the spatial model provides data based at least in part on the indication of the at least one gesture and wherein the language model provides data based at least in part on a lexicon. The computing device outputs for display at the presence-sensitive display, the candidate word.

公开(公告)号：US11237660B2

公开(公告)日：2022-02-01

申请号：US16859457

申请日：2020-04-27

Applicant: Google LLC

Inventor： Tyler Reed Kugler ,  Alexey Polyudov ,  Seungyon Lee ,  Yun-Ling Lee ,  Philip Quinn ,  Kishore Sundara-Rajan ,  Shumin Zhai ,  Debanjan Mukherjee ,  James B. Miller ,  Isaac William Reynolds

IPC: G06F3/041 ,  G06F3/045 ,  G06F1/16 ,  G06F3/0488 ,  G06F3/01 ,  G06F3/0485 ,  G06F3/0484 ,  G06F3/0346 ,  G06F21/32 ,  G06F3/0482 ,  G06F3/16

Abstract: A method includes a processor of an electronic device receiving first input signals from a first sensor in response to user contact at a first edge of the device and second input signals from a second sensor in response to user contact at a second edge of the electronic device. The first and second sensors are covered by a housing of the device. The processor determines an external context of the device based on analysis of the first input signals and the second input signals. The determined external context indicates at least a position of the device relative to a user or an orientation of the device relative to a user. Responsive to determining the external context, the electronic device executes a particular user input action.

公开(公告)号：US20210405868A1

公开(公告)日：2021-12-30

申请号：US17469622

申请日：2021-09-08

Applicant: Google LLC

Inventor： Shumin Zhai ,  Thomas Breuel ,  Ouais Alsharif ,  Yu Ouyang ,  Francoise Beaufays ,  Johan Schalkwyk

IPC: G06F3/0488 ,  G06N3/04 ,  G06F40/232 ,  G06F40/274 ,  G06F40/279 ,  G06F3/02 ,  G06F3/023 ,  G06F3/0489 ,  G06F3/0482 ,  G06N3/08

Abstract: In some examples, a computing device includes at least one processor; and at least one module, operable by the at least one processor to: output, for display at an output device, a graphical keyboard; receive an indication of a gesture detected at a location of a presence-sensitive input device, wherein the location of the presence-sensitive input device corresponds to a location of the output device that outputs the graphical keyboard; determine, based on at least one spatial feature of the gesture that is processed by the computing device using a neural network, at least one character string, wherein the at least one spatial feature indicates at least one physical property of the gesture; and output, for display at the output device, based at least in part on the processing of the at least one spatial feature of the gesture using the neural network, the at least one character string.

公开(公告)号：US10528663B2

公开(公告)日：2020-01-07

申请号：US15795955

申请日：2017-10-27

Applicant: Google LLC

Inventor： Shumin Zhai ,  Ciprian Ioan Chelba

IPC: G06F3/048 ,  G06F17/27 ,  G06F3/0488 ,  G06F3/023

Abstract: A computing device outputs for display at a presence-sensitive display, a graphical keyboard comprising a plurality of keys, receives an indication of at least one gesture to select a group of keys of the plurality of keys, and determines at least one characteristic associated with the at least one gesture to select the group of keys of the plurality of keys. The computing device modifies a spatial model based at least in part on the at least one characteristic and determines a candidate word based at least in part on data provided by the spatial model and a language model, wherein the spatial model provides data based at least in part on the indication of the at least one gesture and wherein the language model provides data based at least in part on a lexicon. The computing device outputs for display at the presence-sensitive display, the candidate word.

公开(公告)号：US10241673B2

公开(公告)日：2019-03-26

申请号：US15808233

申请日：2017-11-09

Applicant: Google LLC

Inventor： Yu Ouyang ,  Shumin Zhai

IPC: G06F3/041 ,  G06F3/0488 ,  G06F17/27 ,  G06F3/0489 ,  G06F3/023

Abstract: In one example, a method may include outputting, by a computing device and for display, a graphical keyboard comprising a plurality of keys, and receiving an indication of a gesture. The method may include determining an alignment score that is based at least in part on a word prefix and an alignment point traversed by the gesture. The method may include determining at least one alternative character that is based at least in part on a misspelling that includes at least a portion of the word prefix. The method may include determining an alternative alignment score based at least in part on the alternative character; and outputting, by the computing device and for display, based at least in part on the alternative alignment score, a candidate word based at least in part on the alternative character.