公开(公告)号：US11774596B2

公开(公告)日：2023-10-03

申请号：US17901224

申请日：2022-09-01

申请人： Google LLC

发明人： Jonathon Shlens ,  Vijay Vasudevan ,  Jiquan Ngiam ,  Wei Han ,  Zhifeng Chen ,  Brandon Chauloon Yang ,  Benjamin James Caine ,  Zhengdong Zhang ,  Christoph Sprunk ,  Ouais Alsharif ,  Junhua Mao ,  Chen Wu

IPC分类号： G01S17/89 ,  G06T17/00 ,  G06V20/10 ,  G06N3/048 ,  G06V10/764 ,  G06V20/56

CPC分类号： G01S17/89 ,  G06N3/048 ,  G06T17/00 ,  G06V10/764 ,  G06V20/10 ,  G06V20/56

摘要： Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for processing data generated by a sensing system that rotationally senses an environment. In one aspect, a method comprises partitioning a predetermined period of time into a plurality of sub-periods, wherein the predetermined period of time is a period of time for which data generated by the sensing system constitutes a complete rotational sensing of the environment; for each sub-period: receiving current data generated by the sensing system during the sub-period and characterizing a respective partial scene of the environment; processing the current data using an object detection neural network to generate a current object detection output that is specific to the respective partial scene of the environment.

公开(公告)号：US11150804B2

公开(公告)日：2021-10-19

申请号：US16862628

申请日：2020-04-30

申请人： Google LLC

发明人： Shumin Zhai ,  Thomas Breuel ,  Ouais Alsharif ,  Yu Ouyang ,  Francoise Beaufays ,  Johan Schalkwyk

IPC分类号： G06F3/02 ,  G06F3/0488 ,  G06N3/04 ,  G06F40/232 ,  G06F40/274 ,  G06F40/279 ,  G06F3/023 ,  G06F3/0489 ,  G06F3/0482 ,  G06N3/08

摘要： In some examples, a computing device includes at least one processor; and at least one module, operable by the at least one processor to: output, for display at an output device, a graphical keyboard; receive an indication of a gesture detected at a location of a presence-sensitive input device, wherein the location of the presence-sensitive input device corresponds to a location of the output device that outputs the graphical keyboard; determine, based on at least one spatial feature of the gesture that is processed by the computing device using a neural network, at least one character string, wherein the at least one spatial feature indicates at least one physical property of the gesture; and output, for display at the output device, based at least in part on the processing of the at least one spatial feature of the gesture using the neural network, the at least one character string.

公开(公告)号：US20210405868A1

公开(公告)日：2021-12-30

申请号：US17469622

申请日：2021-09-08

申请人： Google LLC

发明人： Shumin Zhai ,  Thomas Breuel ,  Ouais Alsharif ,  Yu Ouyang ,  Francoise Beaufays ,  Johan Schalkwyk

IPC分类号： G06F3/0488 ,  G06N3/04 ,  G06F40/232 ,  G06F40/274 ,  G06F40/279 ,  G06F3/02 ,  G06F3/023 ,  G06F3/0489 ,  G06F3/0482 ,  G06N3/08

摘要： In some examples, a computing device includes at least one processor; and at least one module, operable by the at least one processor to: output, for display at an output device, a graphical keyboard; receive an indication of a gesture detected at a location of a presence-sensitive input device, wherein the location of the presence-sensitive input device corresponds to a location of the output device that outputs the graphical keyboard; determine, based on at least one spatial feature of the gesture that is processed by the computing device using a neural network, at least one character string, wherein the at least one spatial feature indicates at least one physical property of the gesture; and output, for display at the output device, based at least in part on the processing of the at least one spatial feature of the gesture using the neural network, the at least one character string.

公开(公告)号：US11327652B2

公开(公告)日：2022-05-10

申请号：US16989420

申请日：2020-08-10

申请人： Google LLC

发明人： Ouais Alsharif ,  Peter Ciccotto ,  Francoise Beaufays ,  Dragan Zivkovic

IPC分类号： G06F3/04886 ,  G06F3/023 ,  G06F40/263 ,  G06F40/274

摘要： A keyboard is described that determines, using a first decoder and based on a selection of keys of a graphical keyboard, text. Responsive to determining that a characteristic of the text satisfies a threshold, a model of the keyboard identifies the target language of the text, and determines whether the target language is different than a language associated with the first decoder. If the target language of the text is not different than the language associated with the first decoder, the keyboard outputs, for display, an indication of first candidate words determined by the first decoder from the text. If the target language of the text is different: the keyboard enables a second decoder, where a language associated with the second decoder matches the target language of the text, and outputs, for display, an indication of second candidate words determined by the second decoder from the text.

公开(公告)号：US20210279465A1

公开(公告)日：2021-09-09

申请号：US16812154

申请日：2020-03-06

申请人： Google LLC

发明人： Jonathon Shlens ,  Vijay Vasudevan ,  Jiquan Ngiam ,  Wei Han ,  Zhifeng Chen ,  Brandon Chauloon Yang ,  Benjamin James Caine ,  Zhengdong Zhang ,  Christoph Sprunk ,  Ouais Alsharif ,  Junhua Mao ,  Chen Wu

IPC分类号： G06K9/00 ,  G06N3/04 ,  G01S17/89 ,  G06T17/00

摘要： Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for processing data generated by a sensing system that rotationally senses an environment. In one aspect, a method comprises partitioning a predetermined period of time into a plurality of sub-periods, wherein the predetermined period of time is a period of time for which data generated by the sensing system constitutes a complete rotational sensing of the environment; for each sub-period: receiving current data generated by the sensing system during the sub-period and characterizing a respective partial scene of the environment; processing the current data using an object detection neural network to generate a current object detection output that is specific to the respective partial scene of the environment.

公开(公告)号：US20200257447A1

公开(公告)日：2020-08-13

申请号：US16862628

申请日：2020-04-30

申请人： Google LLC

发明人： Shumin Zhai ,  Thomas Breuel ,  Ouais Alsharif ,  Yu Ouyang ,  Francoise Beaufays ,  Johan Schalkwyk

IPC分类号： G06F3/0488 ,  G06N3/04 ,  G06F40/232 ,  G06F40/274 ,  G06F40/279 ,  G06F3/02 ,  G06F3/023 ,  G06F3/0489 ,  G06F3/0482 ,  G06N3/08

摘要： In some examples, a computing device includes at least one processor; and at least one module, operable by the at least one processor to: output, for display at an output device, a graphical keyboard; receive an indication of a gesture detected at a location of a presence-sensitive input device, wherein the location of the presence-sensitive input device corresponds to a location of the output device that outputs the graphical keyboard; determine, based on at least one spatial feature of the gesture that is processed by the computing device using a neural network, at least one character string, wherein the at least one spatial feature indicates at least one physical property of the gesture; and output, for display at the output device, based at least in part on the processing of the at least one spatial feature of the gesture using the neural network, the at least one character string.

公开(公告)号：US20190155504A1

公开(公告)日：2019-05-23

申请号：US16261640

申请日：2019-01-30

申请人： Google LLC

发明人： Shumin Zhai ,  Thomas Breuel ,  Ouais Alsharif ,  Yu Ouyang ,  Francoise Beaufays ,  Johan Schalkwyk

IPC分类号： G06F3/0488 ,  G06N3/04 ,  G06F17/27 ,  G06F3/023 ,  G06F3/0489 ,  G06F3/02 ,  G06N3/08 ,  G06F3/0482

摘要： In some examples, a computing device includes at least one processor; and at least one module, operable by the at least one processor to: output, for display at an output device, a graphical keyboard; receive an indication of a gesture detected at a location of a presence-sensitive input device, wherein the location of the presence-sensitive input device corresponds to a location of the output device that outputs the graphical keyboard; determine, based on at least one spatial feature of the gesture that is processed by the computing device using a neural network, at least one character string, wherein the at least one spatial feature indicates at least one physical property of the gesture; and output, for display at the output device, based at least in part on the processing of the at least one spatial feature of the gesture using the neural network, the at least one character string.

公开(公告)号：US11948062B2

公开(公告)日：2024-04-02

申请号：US17112966

申请日：2020-12-04

申请人： Google LLC

发明人： Ouais Alsharif ,  Rohit Prakash Prabhavalkar ,  Ian C. McGraw ,  Antoine Jean Bruguier

IPC分类号： G06N3/044 ,  G06N3/049 ,  G06N3/08 ,  G06N20/00 ,  G06F17/16 ,  G06N3/04 ,  G06N3/084

CPC分类号： G06N3/044 ,  G06N3/049 ,  G06N3/08 ,  G06N20/00 ,  G05B2219/33025 ,  G05B2219/40326 ,  G06F17/16 ,  G06N3/04 ,  G06N3/084

摘要： Methods, systems, and apparatus, including computer programs encoded on computer storage media, for implementing a compressed recurrent neural network (RNN). One of the systems includes a compressed RNN, the compressed RNN comprising a plurality of recurrent layers, wherein each of the recurrent layers has a respective recurrent weight matrix and a respective inter-layer weight matrix, and wherein at least one of recurrent layers is compressed such that a respective recurrent weight matrix of the compressed layer is defined by a first compressed weight matrix and a projection matrix and a respective inter-layer weight matrix of the compressed layer is defined by a second compressed weight matrix and the projection matrix.

公开(公告)号：US20220415042A1

公开(公告)日：2022-12-29

申请号：US17901224

申请日：2022-09-01

申请人： Google LLC

发明人： Jonathon Shlens ,  Vijay Vasudevan ,  Jiquan Ngiam ,  Wei Han ,  Zhifeng Chen ,  Brandon Chauloon Yang ,  Benjamin James Caine ,  Zhengdong Zhang ,  Christoph Sprunk ,  Ouais Alsharif ,  Junhua Mao ,  Chen Wu

IPC分类号： G06V20/10 ,  G06T17/00 ,  G01S17/89 ,  G06N3/04

摘要： Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for processing data generated by a sensing system that rotationally senses an environment. In one aspect, a method comprises partitioning a predetermined period of time into a plurality of sub-periods, wherein the predetermined period of time is a period of time for which data generated by the sensing system constitutes a complete rotational sensing of the environment; for each sub-period: receiving current data generated by the sensing system during the sub-period and characterizing a respective partial scene of the environment; processing the current data using an object detection neural network to generate a current object detection output that is specific to the respective partial scene of the environment.

公开(公告)号：US20220229548A1

公开(公告)日：2022-07-21

申请号：US17658233

申请日：2022-04-06

申请人： Google LLC

发明人： Ouais Alsharif ,  Peter Ciccotto ,  Francoise Beaufays ,  Dragan Zivkovic

IPC分类号： G06F3/04886 ,  G06F3/023 ,  G06F40/263 ,  G06F40/274

摘要： A keyboard is described that determines, using a first decoder and based on a selection of keys of a graphical keyboard, text. Responsive to determining that a characteristic of the text satisfies a threshold, a model of the keyboard identifies the target language of the text, and determines whether the target language is different than a language associated with the first decoder. If the target language of the text is not different than the language associated with the first decoder, the keyboard outputs, for display, an indication of first candidate words determined by the first decoder from the text. If the target language of the text is different: the keyboard enables a second decoder, where a language associated with the second decoder matches the target language of the text, and outputs, for display, an indication of second candidate words determined by the second decoder from the text.