公开(公告)号：US20240029728A1

公开(公告)日：2024-01-25

申请号：US17902560

申请日：2022-09-02

Applicant: GOOGLE LLC

Inventor： Nicolo D'Ercole ,  Shumin Zhai ,  Swante Scholz ,  Mehek Sharma ,  Adrien Olczak ,  Akshay Kannan ,  Alvin Abdagic ,  Julia Proskurnia ,  Viesturs Zarins

IPC: G10L15/22 ,  G10L15/08 ,  G06F16/683

CPC classification number: G10L15/22 ,  G10L15/08 ,  G06F16/685

Abstract: Implementations described herein generally relate to generating a modification selectable element that may be provided for presentation to a user in a smart dictation session with an automated assistant. The modification selectable element may, when selected, cause a transcription, that includes textual data generated based on processing audio data that captures a spoken utterance and that is automatically arranged, to be modified. The transcription may be automatically arranged to include spacing, punctuation, capitalization, indentations, paragraph breaks, and/or other arrangement operations that are not specified by the user in providing the spoken utterance. Accordingly, a subsequent selection of the modification selectable element may cause these automatic arrangement operation(s), and/or the textual data locationally proximate to these automatic arrangement operation(s), to be modified. Implementations described herein also relate to generating the transcription and/or the modification selectable element on behalf of a third-party software application.

公开(公告)号：US20230360444A1

公开(公告)日：2023-11-09

申请号：US18245454

申请日：2020-09-22

Applicant: Google LLC

Inventor： Scott Jenson ,  Jianxun Wang ,  Debanjan Mukherjee ,  Shumin Zhai

IPC: G06V40/60 ,  G06V40/13 ,  G06V40/12 ,  G06F3/01 ,  G06F21/32

CPC classification number: G06V40/67 ,  G06V40/13 ,  G06V40/1365 ,  G06F3/016 ,  G06F21/32

Abstract: An example method includes initiating, by a computing device, a fingerprint sensing operation that is associated with a fingerprint sensor, outputting, by the computing device and over a defined period of time, a sequence of haptic signals with varying intensity, wherein each haptic signal in the sequence has an intensity that is different than a respective intensity of any haptic signal that was previously output in the sequence, obtaining, by the computing device and from the fingerprint sensor, fingerprint data associated with a fingerprint of the finger of the user, and responsive to determining that the finger of the user is still positioned at the fingerprint sensor upon completion of the fingerprint sensing operation, outputting, by the computing device, a discrete haptic signal indicating a successful completion of the fingerprint sensing operation.

公开(公告)号：US11573698B2

公开(公告)日：2023-02-07

申请号：US17469622

申请日：2021-09-08

Applicant: Google LLC

Inventor： Shumin Zhai ,  Thomas Breuel ,  Ouais Alsharif ,  Yu Ouyang ,  Francoise Beaufays ,  Johan Schalkwyk

IPC: G06F3/02 ,  G06F3/04886 ,  G06N3/04 ,  G06F40/232 ,  G06F40/274 ,  G06F40/279 ,  G06F3/023 ,  G06F3/04895 ,  G06F3/0482 ,  G06F3/04883 ,  G06N3/08

Abstract: In some examples, a computing device includes at least one processor; and at least one module, operable by the at least one processor to: output, for display at an output device, a graphical keyboard; receive an indication of a gesture detected at a location of a presence-sensitive input device, wherein the location of the presence-sensitive input device corresponds to a location of the output device that outputs the graphical keyboard; determine, based on at least one spatial feature of the gesture that is processed by the computing device using a neural network, at least one character string, wherein the at least one spatial feature indicates at least one physical property of the gesture; and output, for display at the output device, based at least in part on the processing of the at least one spatial feature of the gesture using the neural network, the at least one character string.

公开(公告)号：US10671281B2

公开(公告)日：2020-06-02

申请号：US16261640

申请日：2019-01-30

Applicant: Google LLC

Inventor： Shumin Zhai ,  Thomas Breuel ,  Ouais Alsharif ,  Yu Ouyang ,  Francoise Beaufays ,  Johan Schalkwyk

IPC: G06F3/02 ,  G06F3/0488 ,  G06N3/04 ,  G06F40/232 ,  G06F40/274 ,  G06F40/279 ,  G06F3/023 ,  G06F3/0489 ,  G06F3/0482 ,  G06N3/08

Abstract: In some examples, a computing device includes at least one processor; and at least one module, operable by the at least one processor to: output, for display at an output device, a graphical keyboard; receive an indication of a gesture detected at a location of a presence-sensitive input device, wherein the location of the presence-sensitive input device corresponds to a location of the output device that outputs the graphical keyboard; determine, based on at least one spatial feature of the gesture that is processed by the computing device using a neural network, at least one character string, wherein the at least one spatial feature indicates at least one physical property of the gesture; and output, for display at the output device, based at least in part on the processing of the at least one spatial feature of the gesture using the neural network, the at least one character string.

公开(公告)号：US10372328B2

公开(公告)日：2019-08-06

申请号：US15268928

申请日：2016-09-19

Applicant: Google LLC

Inventor： Shumin Zhai

IPC: G06F3/0488 ,  G06F3/041 ,  G06F3/02

Abstract: Implementations of the present disclosure include actions of displaying a plurality of keys on a touchscreen of a computing device, receiving user input to the touchscreen, the user input including a contact with the touchscreen, in response to receiving the user input, determining spatial information associated with the contact and generating an image of the contact, determining an output based on the image and the spatial information, and executing the output.

公开(公告)号：US10365719B2

公开(公告)日：2019-07-30

申请号：US15660773

申请日：2017-07-26

Applicant: Google LLC

Inventor： Madeleine Mellor ,  Shumin Zhai ,  Seungyon (Claire) Lee

IPC: G06F3/01 ,  G06F3/0485 ,  G06F3/0482 ,  G06F3/0488 ,  H04L12/58 ,  G06T13/80

Abstract: Apparatus and methods related to visual and haptic feedback on mobile devices are provided. A computing device can present a symbol queue that includes a particular symbol on a screen. The computing device can receive user input to move through the symbol queue. In response to the user input, the computing device can: animate the particular symbol on the screen by at least presenting an expanded item display that includes at least the particular symbol and a particular informational item associated with the particular symbol, and generate haptic feedback that is synchronized with animating the particular symbol on the screen.

公开(公告)号：US20180074698A1

公开(公告)日：2018-03-15

申请号：US15808233

申请日：2017-11-09

Applicant: Google LLC

Inventor： Yu Ouyang ,  Shumin Zhai

IPC: G06F3/0488 ,  G06F17/27

CPC classification number: G06F3/04886 ,  G06F3/0236 ,  G06F3/0237 ,  G06F3/04883 ,  G06F3/04897 ,  G06F17/273 ,  G06F17/276 ,  Y10S707/99935 ,  Y10S707/99936

Abstract: In one example, a method may include outputting, by a computing device and for display, a graphical keyboard comprising a plurality of keys, and receiving an indication of a gesture. The method may include determining an alignment score that is based at least in part on a word prefix and an alignment point traversed by the gesture. The method may include determining at least one alternative character that is based at least in part on a misspelling that includes at least a portion of the word prefix. The method may include determining an alternative alignment score based at least in part on the alternative character; and outputting, by the computing device and for display, based at least in part on the alternative alignment score, a candidate word based at least in part on the alternative character.

公开(公告)号：US20200081974A1

公开(公告)日：2020-03-12

申请号：US16683895

申请日：2019-11-14

Applicant: Google LLC

Inventor： Shumin Zhai ,  Ciprian Ioan Chelba

IPC: G06F17/27 ,  G06F3/0488 ,  G06F3/023 ,  H04L12/58

Abstract: A computing device outputs for display at a presence-sensitive display, a graphical keyboard comprising a plurality of keys, receives an indication of at least one gesture to select a group of keys of the plurality of keys, and determines at least one characteristic associated with the at least one gesture to select the group of keys of the plurality of keys. The computing device modifies a spatial model based at least in part on the at least one characteristic and determines a candidate word based at least in part on data provided by the spatial model and a language model, wherein the spatial model provides data based at least in part on the indication of the at least one gesture and wherein the language model provides data based at least in part on a lexicon. The computing device outputs for display at the presence-sensitive display, the candidate word.

公开(公告)号：US20200050661A1

公开(公告)日：2020-02-13

申请号：US16655067

申请日：2019-10-16

Applicant: Google LLC

Inventor： Shumin Zhai ,  Yu Ouyang ,  Ken Wakasa ,  Satoshi Kataoka

IPC: G06F17/27 ,  G06F3/01 ,  G06F3/023 ,  G06F3/0488

Abstract: In one example, a computing device includes at least one processor that is operatively coupled to a presence-sensitive display and a gesture module operable by the at least one processor. The gesture module may be operable by the at least one processor to output, for display at the presence-sensitive display, a graphical keyboard comprising a plurality of keys and receive an indication of a continuous gesture detected at the presence-sensitive display, the continuous gesture to select a group of keys of the plurality of keys. The gesture module may be further operable to determine, in response to receiving the indication of the continuous gesture and based at least in part on the group of keys of the plurality of keys, a candidate phrase comprising a group of candidate words.

公开(公告)号：US10514797B2

公开(公告)日：2019-12-24

申请号：US15490760

申请日：2017-04-18

Applicant: Google LLC

Inventor： Tyler Reed Kugler ,  Stuart Murray Scott ,  Alexey Polyudov ,  Seungyon Lee ,  Philip Quinn ,  Kishore Sundara-Rajan ,  Shumin Zhai ,  Debanjan Mukherjee ,  James B. Miller

IPC: G06F3/041 ,  G06F1/16 ,  G06F3/0354

Abstract: A method includes one or more processors of an electronic device receiving signals from multiple sensors located along an edge of the device. The signals are received in response to external contact being provided to the edge of the device. At least one processor determines a distribution of forces applied to the sensors based on the input signals. Based on the determined distribution of forces, the processor determines: i) a location of the external contact that is offset from a location of each of the multiple sensors, and ii) a magnitude of the force of the external contact. The processor detects whether sensing criteria has been satisfied based on an analysis of: i) the location of the external contact and ii) the magnitude of the force of the external contact. Responsive to detecting that sensing criteria has been satisfied, the processor executes a user input action.