公开(公告)号：US11417092B2

公开(公告)日：2022-08-16

申请号：US16806505

申请日：2020-03-02

Applicant: Google LLC

Inventor： Marcin Nowak-Przygodzki ,  Gökhan Bakir

IPC: G06F16/487 ,  G06F16/9032 ,  G06F3/01 ,  G06F3/0482 ,  G06F3/04886 ,  G06V20/20 ,  G06V20/68 ,  H04N5/232 ,  G06Q30/02

Abstract: Techniques described herein enable a user to interact with an automated assistant and obtain relevant output from the automated assistant without requiring arduous typed input to be provided by the user and/or without requiring the user to provide spoken input that could cause privacy concerns (e.g., if other individuals are nearby). The assistant application can operate in multiple different image conversation modes in which the assistant application is responsive to various objects in a field of view of the camera. The image conversation modes can be suggested to the user when a particular object is detected in the field of view of the camera. When the user selects an image conversation mode, the assistant application can thereafter provide output, for presentation, that is based on the selected image conversation mode and that is based on object(s) captured by image(s) of the camera.

公开(公告)号：US11361539B2

公开(公告)日：2022-06-14

申请号：US16850294

申请日：2020-04-16

Applicant: Google LLC

Inventor： Marcin Nowak-Przygodzki ,  Gökhan Bakir

IPC: G06V20/20 ,  G06F16/9032 ,  G06F3/0481 ,  G06F3/16 ,  H04N5/232 ,  G06F3/01 ,  G06F3/03 ,  G06F3/00 ,  G06F9/451 ,  G06F16/58

Abstract: Methods, apparatus, systems, and computer-readable media are set forth for generating and/or utilizing image shortcuts that cause one or more corresponding computer actions to be performed in response to determining that one or more features are present in image(s) from a camera of a computing device of a user (e.g., present in a real-time image feed from the camera). An image shortcut can be generated in response to user interface input, such as a spoken command. For example, the user interface input can direct the automated assistant to perform one or more actions in response to object(s) having certain feature(s) being present in a field of view of the camera. Subsequently, when the user directs their camera at object(s) having such feature(s), the assistant application can cause the action(s) to be automatically performed. For example, the assistant application can cause data to be presented and/or can control a remote device in accordance with the image shortcut.

公开(公告)号：US20200236069A1

公开(公告)日：2020-07-23

申请号：US16832637

申请日：2020-03-27

Applicant: Google LLC

Inventor： Marcin Nowak-Przygodzki ,  Jan Lamecki ,  Behshad Behzadi

IPC: H04L12/58 ,  H04L12/18 ,  G10L15/18 ,  G10L15/22 ,  G06Q10/10 ,  H04M3/493 ,  H04M3/527

Abstract: Techniques are described related to enabling automated assistants to enter into a “conference mode” in which they can “participate” in meetings between multiple human participants and perform various functions described herein. In various implementations, an automated assistant implemented at least in part on conference computing device(s) may be set to a conference mode in which the automated assistant performs speech-to-text processing on multiple distinct spoken utterances, provided by multiple meeting participants, without requiring explicit invocation prior to each utterance. The automated assistant may perform semantic processing on first text generated from the speech-to-text processing of one or more of the spoken utterances, and generate, based on the semantic processing, data that is pertinent to the first text. The data may be output to the participants at conference computing device(s). The automated assistant may later determine that the meeting has concluded, and may be set to a non-conference mode.

公开(公告)号：US10657374B2

公开(公告)日：2020-05-19

申请号：US16459869

申请日：2019-07-02

Applicant: Google LLC

Inventor： Marcin Nowak-Przygodzki ,  Gökhan Bakir

IPC: H04N5/232 ,  G06F9/00 ,  G06F3/01 ,  G06F3/03 ,  G06K9/00 ,  G06F16/9032 ,  G06F3/00 ,  G06F9/451 ,  G06F16/58 ,  G06F3/0481 ,  G06F3/16

Abstract: Methods, apparatus, systems, and computer-readable media are set forth for generating and/or utilizing image shortcuts that cause one or more corresponding computer actions to be performed in response to determining that one or more features are present in image(s) from a camera of a computing device of a user (e.g., present in a real-time image feed from the camera). An image shortcut can be generated in response to user interface input, such as a spoken command. For example, the user interface input can direct the automated assistant to perform one or more actions in response to object(s) having certain feature(s) being present in a field of view of the camera. Subsequently, when the user directs their camera at object(s) having such feature(s), the assistant application can cause the action(s) to be automatically performed. For example, the assistant application can cause data to be presented and/or can control a remote device in accordance with the image shortcut.

公开(公告)号：US20190325222A1

公开(公告)日：2019-10-24

申请号：US16459869

申请日：2019-07-02

Applicant: Google LLC

Inventor： Marcin Nowak-Przygodzki ,  Gökhan Bakir

IPC: G06K9/00 ,  G06F3/03 ,  G06F3/01 ,  G06F16/58 ,  G06F9/451 ,  G06F3/0481 ,  G06F3/00 ,  H04N5/232 ,  G06F3/16 ,  G06F16/9032

Abstract: Methods, apparatus, systems, and computer-readable media are set forth for generating and/or utilizing image shortcuts that cause one or more corresponding computer actions to be performed in response to determining that one or more features are present in image(s) from a camera of a computing device of a user (e.g., present in a real-time image feed from the camera). An image shortcut can be generated in response to user interface input, such as a spoken command. For example, the user interface input can direct the automated assistant to perform one or more actions in response to object(s) having certain feature(s) being present in a field of view of the camera. Subsequently, when the user directs their camera at object(s) having such feature(s), the assistant application can cause the action(s) to be automatically performed. For example, the assistant application can cause data to be presented and/or can control a remote device in accordance with the image shortcut.