公开(公告)号：US20220337539A1

公开(公告)日：2022-10-20

申请号：US17859460

申请日：2022-07-07

Applicant: GOOGLE LLC

Inventor： Ibrahim Badr ,  Aayush Kumar ,  Goekhan Hasan Bakir ,  Nils Grimsmo ,  Bianca Madalina Buisman

IPC: H04L51/046 ,  H04L51/10

Abstract: A computer-implemented method is described. The method includes a computing system receiving an item of digital content from a user device. The computing system generates one or more labels that indicate attributes of the item of digital content. The computing system also generates one or more conversational replies to the item of digital content based on the one or more labels that indicate attributes of the item of digital content. The method also includes the computing system selecting a conversational reply from among the one or more conversational replies and providing the conversational reply for output to the user device.

公开(公告)号：US20220309781A1

公开(公告)日：2022-09-29

申请号：US17839104

申请日：2022-06-13

Applicant: Google LLC

Inventor： Ibrahim Badr

IPC: G06V10/98 ,  H04N5/232 ,  G06V10/24

Abstract: Methods, systems, and apparatus for controlling smart devices are described. In one aspect a method includes capturing, by a camera on a user device, a plurality of successive images for display in an application environment of an application executing on the user device, performing an object recognition process on the images, the object recognition process including determining that a plurality of images, each depicting a particular object, are required to perform object recognition on the particular object, and in response to the determination, generating a user interface element that indicates a camera operation to be performed, the camera option capturing two or more images, determining that a user, in response to the user interface element, has caused the indicated camera operation to be performed to capture the two or more images, and in response, determining whether a particular object is positively identified from the plurality of images.

公开(公告)号：US11017299B1

公开(公告)日：2021-05-25

申请号：US16702248

申请日：2019-12-03

Applicant: GOOGLE LLC

Inventor： Ibrahim Badr ,  Mauricio Zuluaga ,  Aneto Okonkwo ,  Gökhan Bakir

IPC: G06N5/02 ,  H04L29/06 ,  G06F9/54 ,  G06F3/0482 ,  G06F40/134 ,  G06F3/0481 ,  G06F8/61 ,  H04W88/02

Abstract: Systems and methods provide an application programming interface to offer action suggestions to third-party applications using context data associated with the third-party. An example method includes receiving content information and context information from a source mobile application, the content information representing information to be displayed on a mobile device as part of a source mobile application administered by a third party, the context information being information specific to the third party and unavailable to a screen scraper. The method also includes predicting an action based on the content information and the context information, the action representing a deep link for a target mobile application. The method further includes providing the action to the source mobile application with a title and a thumbnail, the source mobile application using the title and thumbnail to display a selectable control that, when selected, causes the mobile device to initiate the action.

公开(公告)号：US20210056310A1

公开(公告)日：2021-02-25

申请号：US17093880

申请日：2020-11-10

Applicant: Google LLC

Inventor： Ibrahim Badr ,  Nils Grimsmo ,  Gökhan Bakir

IPC: G06K9/00 ,  G06F3/16 ,  G06F16/9032 ,  G06F16/583 ,  H04L12/58

Abstract: Methods, apparatus, and computer readable media are described related to causing processing of sensor data to be performed in response to determining a request related to an environmental object that is likely captured by the sensor data. Some implementations further relate to determining whether the request is resolvable based on the processing of the sensor data. When it is determined that the request is not resolvable, a prompt is determined and provided as user interface output, where the prompt provides guidance on further input that will enable the request to be resolved. In those implementations, the further input (e.g., additional sensor data and/or the user interface input) received in response to the prompt can then be utilized to resolve the request.

公开(公告)号：US10725629B2

公开(公告)日：2020-07-28

申请号：US16017394

申请日：2018-06-25

Applicant: Google LLC

Inventor： Ibrahim Badr ,  Gokhan H. Bakir ,  Roland Peter Kehl ,  Nils Grimsmo

IPC: G06F3/048 ,  G06F3/0484 ,  G06F9/451 ,  G06F3/0482 ,  G06F3/16 ,  G06K9/00 ,  G08C17/02 ,  G06T19/00 ,  H04W88/02

Abstract: Methods, systems, and apparatus for controlling smart devices are described. In one aspect a method includes receiving image data for an image captured by a camera of a mobile device of a user and determining that the image depicts at least one of a smart device or a physical control for the smart device. In response to determining that that the image depicts a smart device or a physical control for the smart device, identifying one or more user interface controls for controlling the smart device, and generating and presenting, at a display of the mobile device, the one or more user interface controls for controlling the smart device. The method can further include detecting, at the display of the mobile device, user interaction with at least one of the one or more user interface controls, and controlling the smart device based on the detected user interaction.

公开(公告)号：US20200227043A1

公开(公告)日：2020-07-16

申请号：US16829323

申请日：2020-03-25

Applicant: Google LLC

Inventor： Ibrahim Badr ,  Zaheed Sabur ,  Vladimir Vuskovic ,  Adrian Zumbrunnen ,  Lucas Mirelmann

IPC: G10L15/22 ,  G06F16/903 ,  G10L15/18 ,  G06N3/00

Abstract: Methods, apparatus, and computer readable media are described related to automated assistants that proactively incorporate, into human-to-computer dialog sessions, unsolicited content of potential interest to a user. In various implementations, in an existing human-to-computer dialog session between a user and an automated assistant, it may be determined that the automated assistant has responded to all natural language input received from the user. Based on characteristic(s) of the user, information of potential interest to the user or action(s) of potential interest to the user may be identified. Unsolicited content indicative of the information of potential interest to the user or the action(s) may be generated and incorporated by the automated assistant into the existing human-to-computer dialog session. In various implementations, the incorporating may be performed in response to the determining that the automated assistant has responded to all natural language input received from the user during the human-to-computer dialog session.

公开(公告)号：US20200050878A1

公开(公告)日：2020-02-13

申请号：US16058575

申请日：2018-08-08

Applicant: Google LLC

Inventor： Ibrahim Badr

IPC: G06K9/03 ,  H04N5/232 ,  G06K9/32

Abstract: Methods, systems, and apparatus for controlling smart devices are described. In one aspect a method includes capturing, by a camera on a user device, a plurality of successive images for display in an application environment of an application executing on the user device, performing an object recognition process on the images, the object recognition process including determining that a plurality of images, each depicting a particular object, are required to perform object recognition on the particular object, and in response to the determination, generating a user interface element that indicates a camera operation to be performed, the camera option capturing two or more images, determining that a user, in response to the user interface element, has caused the indicated camera operation to be performed to capture the two or more images, and in response, determining whether a particular object is positively identified from the plurality of images.

公开(公告)号：US10467300B1

公开(公告)日：2019-11-05

申请号：US15388912

申请日：2016-12-22

Applicant: Google LLC

Inventor： Michal Jastrzebski ,  Ibrahim Badr ,  Gokhan H. Bakir ,  Aneto Okonkwo ,  Marcin M. Nowak-Przygodzki

IPC: G06F16/951 ,  G06F16/2457

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for providing contextual information to a user. In one aspect, a method includes receiving, from a user device, a query-independent request for contextual information relevant to an active resource displayed in an application environment on the user device, identifying entities from content in the resource, generating queries for topical information based on the entities identified from the content, identifying topical resources that are responsive to the queries for topical information, and providing, to the user device, a user interface element for display with the active resource, wherein the user interface element includes contextual information regarding the identified topical resources.

公开(公告)号：US10212113B2

公开(公告)日：2019-02-19

申请号：US15269238

申请日：2016-09-19

Applicant: Google LLC

Inventor： Ibrahim Badr ,  Paige Alexis Dunn-Rankin

IPC: H04L12/58 ,  G06F17/30 ,  G06T1/00 ,  G06F9/445

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating, in response to a single input operating system command that is invoked independent of a native application, a message that includes an image of a particular environment instance of the native application that was displayed when the single input operating system command and a uniform resource identifier of the particular environment instance of the native application.

公开(公告)号：US20190042564A1

公开(公告)日：2019-02-07

申请号：US16157017

申请日：2018-10-10

Applicant: GOOGLE LLC

Inventor： Ibrahim Badr ,  Yariv Adan ,  Hugo Santos

IPC: G06F17/28 ,  G10L21/06 ,  G10L15/26 ,  G10L15/22 ,  G10L15/18 ,  G06F3/16 ,  G06F17/30 ,  G06F9/54

Abstract: Techniques are described herein for allowing automated assistants serving users to access data controlled by others, including resources available to automated assistants serving others. In various implementations, a voice input may be received from a first user. A task request may be recognized from the voice input and analyzed. In response to the analysis, a determination may be made that the task request relates to a second user. An access control list relating to an automated assistant engaged by the second user may be checked to determine whether the first user has appropriate access rights as regards the second user. In response to determining that the first user has appropriate access rights as regards the second user, action may be taken on the task request.