公开(公告)号：US12230272B2

公开(公告)日：2025-02-18

申请号：US18540377

申请日：2023-12-14

Applicant: GOOGLE LLC

Inventor： Ibrahim Badr ,  Zaheed Sabur ,  Vladimir Vuskovic ,  Adrian Zumbrunnen ,  Lucas Mirelmann

IPC: G10L15/22 ,  G06F16/903 ,  G06N3/006 ,  G10L15/18

Abstract: Methods, apparatus, and computer readable media are described related to automated assistants that proactively incorporate, into human-to-computer dialog sessions, unsolicited content of potential interest to a user. In various implementations, in an existing human-to-computer dialog session between a user and an automated assistant, it may be determined that the automated assistant has responded to all natural language input received from the user. Based on characteristic(s) of the user, information of potential interest to the user or action(s) of potential interest to the user may be identified. Unsolicited content indicative of the information of potential interest to the user or the action(s) may be generated and incorporated by the automated assistant into the existing human-to-computer dialog session. In various implementations, the incorporating may be performed in response to the determining that the automated assistant has responded to all natural language input received from the user during the human-to-computer dialog session.

公开(公告)号：US12141709B1

公开(公告)日：2024-11-12

申请号：US18216402

申请日：2023-06-29

Applicant: GOOGLE LLC

Inventor： Ibrahim Badr ,  Mauricio Zuluaga ,  Aneto Okonkwo ,  Gökhan Bakir

IPC: G06N5/022 ,  G06F3/04817 ,  G06F3/0482 ,  G06F9/54 ,  G06F40/134 ,  H04L9/40 ,  G06F8/61 ,  H04W88/02

Abstract: Systems and methods provide an application programming interface to offer action suggestions to third-party applications using context data associated with the third-party. An example method includes receiving content information and context information from a source mobile application, the content information representing information to be displayed on a mobile device as part of a source mobile application administered by a third party, the context information being information specific to the third party and unavailable to a screen scraper. The method also includes predicting an action based on the content information and the context information, the action representing a deep link for a target mobile application. The method further includes providing the action to the source mobile application with a title and a thumbnail, the source mobile application using the title and thumbnail to display a selectable control that, when selected, causes the mobile device to initiate the action.

公开(公告)号：US20240346796A1

公开(公告)日：2024-10-17

申请号：US18601650

申请日：2024-03-11

Applicant: Google LLC

Inventor： Ibrahim Badr

IPC: G06V10/22 ,  G06V10/10 ,  G06V10/24 ,  G06V10/776 ,  G06V10/98 ,  H04N5/265 ,  H04N23/60 ,  H04N23/61 ,  H04N23/63 ,  H04N23/661 ,  H04N23/698

CPC classification number: G06V10/235 ,  G06V10/16 ,  G06V10/24 ,  G06V10/776 ,  G06V10/98 ,  H04N23/61 ,  H04N23/631 ,  H04N23/64 ,  H04N23/661 ,  H04N5/265 ,  H04N23/698

Abstract: Methods, systems, and apparatus for controlling smart devices are described. In one aspect a method includes capturing, by a camera on a user device, a plurality of successive images for display in an application environment of an application executing on the user device, performing an object recognition process on the images, the object recognition process including determining that a plurality of images, each depicting a particular object, are required to perform object recognition on the particular object, and in response to the determination, generating a user interface element that indicates a camera operation to be performed, the camera option capturing two or more images, determining that a user, in response to the user interface element, has caused the indicated camera operation to be performed to capture the two or more images, and in response, determining whether a particular object is positively identified from the plurality of images.

公开(公告)号：US12013911B2

公开(公告)日：2024-06-18

申请号：US18078765

申请日：2022-12-09

Applicant: GOOGLE LLC

Inventor： Ibrahim Badr

IPC: G06F16/954 ,  G06F16/9535 ,  G06F16/957 ,  H04L67/50

CPC classification number: G06F16/954 ,  G06F16/9535 ,  G06F16/9574 ,  H04L67/535

Abstract: Techniques are described herein for determining a predicted intent of a user and displaying additional content selected based on the predicted intent of the user. A method includes: receiving information identifying a webpage that a user is visiting and a navigational path of the user in navigating to the webpage; determining a predicted intent of the user based on the information identifying the webpage that the user is visiting and the navigational path of the user in navigating to the webpage; selecting additional content based upon the predicted intent of the user; and displaying an overlay, on a portion of the webpage, that includes the additional content.

公开(公告)号：US11961271B2

公开(公告)日：2024-04-16

申请号：US18182737

申请日：2023-03-13

Applicant: Google LLC

Inventor： Ibrahim Badr

IPC: G06V10/22 ,  G06V10/10 ,  G06V10/24 ,  G06V10/776 ,  G06V10/98 ,  H04N5/265 ,  H04N23/60 ,  H04N23/61 ,  H04N23/63 ,  H04N23/661 ,  H04N23/698

CPC classification number: G06V10/235 ,  G06V10/16 ,  G06V10/24 ,  G06V10/776 ,  G06V10/98 ,  H04N23/61 ,  H04N23/631 ,  H04N23/64 ,  H04N23/661 ,  H04N5/265 ,  H04N23/698

Abstract: Methods, systems, and apparatus for controlling smart devices are described. In one aspect a method includes capturing, by a camera on a user device, a plurality of successive images for display in an application environment of an application executing on the user device, performing an object recognition process on the images, the object recognition process including determining that a plurality of images, each depicting a particular object, are required to perform object recognition on the particular object, and in response to the determination, generating a user interface element that indicates a camera operation to be performed, the camera option capturing two or more images, determining that a user, in response to the user interface element, has caused the indicated camera operation to be performed to capture the two or more images, and in response, determining whether a particular object is positively identified from the plurality of images.

公开(公告)号：US11769017B1

公开(公告)日：2023-09-26

申请号：US18123861

申请日：2023-03-20

Applicant: GOOGLE LLC

Inventor： Matthew K. Gray ,  John Blitzer ,  Corinn Herrick ,  Srinivasan Venkatachary ,  Jayant Madhavan ,  Sam Oates ,  Phiroze Parakh ,  Aditya Shah ,  Mahsan Rofouei ,  Ibrahim Badr

IPC: G06F40/40 ,  G06F16/332

CPC classification number: G06F40/40 ,  G06F16/3328

Abstract: At least selectively utilizing a large language model (LLM) in generating a natural language (NL) based summary to be rendered in response to a query. In some implementations, in generating the NL based summary additional content is processed using the LLM. The additional content is in addition to query content of the query itself and, in generating the NL based summary, can be processed using the LLM and along with the query content—or even independent of the query content. Processing the additional content can, for example, mitigate occurrences of the NL based summary including inaccuracies and/or can mitigate occurrences of the NL based summary being over-specified and/or under-specified.

公开(公告)号：US20230215126A1

公开(公告)日：2023-07-06

申请号：US18182737

申请日：2023-03-13

Applicant: Google LLC

Inventor： Ibrahim Badr

IPC: G06V10/22 ,  G06V10/10

CPC classification number: G06V10/235 ,  G06V10/16

Abstract: Methods, systems, and apparatus for controlling smart devices are described. In one aspect a method includes capturing, by a camera on a user device, a plurality of successive images for display in an application environment of an application executing on the user device, performing an object recognition process on the images, the object recognition process including determining that a plurality of images, each depicting a particular object, are required to perform object recognition on the particular object, and in response to the determination, generating a user interface element that indicates a camera operation to be performed, the camera option capturing two or more images, determining that a user, in response to the user interface element, has caused the indicated camera operation to be performed to capture the two or more images, and in response, determining whether a particular object is positively identified from the plurality of images.

公开(公告)号：US11651589B2

公开(公告)日：2023-05-16

申请号：US16347484

申请日：2018-05-07

Applicant: Google LLC

Inventor： Ibrahim Badr ,  Roland Peter Kehl ,  Kaan Yucer ,  Thomas Jonathan Stone ,  Gokhan H. Bakir ,  Adrian Zumbrunnen

IPC: G06V20/20 ,  G06T7/73 ,  G06T7/246 ,  G06K9/62 ,  H04N5/232

CPC classification number: G06V20/20 ,  G06K9/6267 ,  G06T7/248 ,  G06T7/74 ,  H04N5/23293 ,  G06T2207/10016 ,  G06T2207/30244

Abstract: Methods, systems, and apparatus for recognizing objects and providing content related to the recognized objects are described. In one aspect, a method includes detecting presence of one or more objects depicted in a viewfinder of a camera of the mobile device. In response to detecting the presence of the one or more objects, image data representing the one or more objects is sent to a content distribution system that selects content related to objects depicted in images. A location of each of the one or more objects in the viewfinder of the camera is tracked while waiting to receive content from the content distribution system. Content related to the one or more objects is received from the content distribution system. A current location of each object in the viewfinder is determined and the content related to the object is presented within the viewfinder at the current location of the object.

公开(公告)号：US20230007980A1

公开(公告)日：2023-01-12

申请号：US17368155

申请日：2021-07-06

Applicant: Google LLC

Inventor： Ibrahim Badr ,  Imran R. Mansuri ,  Sari Onaissi ,  InHan Kang ,  Wenqiong Guo ,  Anner Kushnir

IPC: G06F16/958 ,  G06F16/9535 ,  G06F16/906 ,  G06F16/955 ,  G06F16/901 ,  G06N20/00

Abstract: A computing system and method that can be used to surface a selectable action element for at least one ongoing task. In particular, the present disclosure provides a general pipeline to identify potential tasks that a user has an ongoing interest in or has not yet completed so that a suggestion of a content item can be made to further advance an identified user’s task. This pipeline can incorporate probabilistic transition graphs, machine-learned models, and/or historical data to determine the relevance and completion of tasks that a user may desire to continue acting upon.

公开(公告)号：US11436417B2

公开(公告)日：2022-09-06

申请号：US16789370

申请日：2020-02-12

Applicant: Google LLC

Inventor： Ibrahim Badr ,  Yariv Adan ,  Hugo Santos ,  Shikha Kapoor ,  Karthik Nagaraj ,  Glenn Wilson ,  Arwa Rangwala ,  Leo Deegan ,  Peter Krogh

IPC: G06F40/40 ,  G10L15/26 ,  G10L15/22 ,  G10L15/18 ,  G10L21/06 ,  G06F9/46 ,  G06F16/9537 ,  G06F16/33 ,  G06F16/332 ,  G06F3/16 ,  G06F9/54

Abstract: Methods, apparatus, and computer readable media are described herein for allowing a first user to interface with an automated assistant to assign tasks to additional user(s), and/or for causing notification(s) of the assigned task to be rendered to the additional user(s) via corresponding automated assistant interface(s). In various implementations, one or more criteria can be utilized in selecting a group of client device(s), linked to the additional user, via which to provide the notification(s) for the task assigned to the additional user. Also, in various implementations condition(s) for providing the notification(s) for the task can be determined, and the notification(s) provided based on determining satisfaction of the condition(s).