-
-
公开(公告)号:US20240272970A1
公开(公告)日:2024-08-15
申请号:US18648842
申请日:2024-04-29
Applicant: GOOGLE LLC
Inventor: Bohdan Vlasyuk , Behshad Behzadi , Mario Bertschler , Denis Burakov , Daniel Cotting , Michael Golikov , Lucas Mirelmann , Steve Cheng , Sergey Nazarov , Zaheed Sabur , Jonathan Lee , Lucia Terrenghi , Adrian Zumbrunnen
CPC classification number: G06F9/547 , G06F3/167 , G06F40/166 , G06F40/35 , G10L15/22 , G10L15/26 , G10L2015/223
Abstract: Implementations set forth herein relate to an automated assistant that can be invoked while a user is interfacing with a foreground application in order to retrieve data from one or more different applications, and then provide the retrieved data to the foreground application. A user can invoke the automated assistant while operating the foreground application by providing a spoken utterance, and the automated assistant can select one or more other applications to query based on content of the spoken utterance. Application data collected by the automated assistant from the one or more other applications can then be used to provide an input to the foreground application. In this way, the user can bypass switching between applications in the foreground in order to retrieve data that has been generated by other applications.
-
公开(公告)号:US20220130386A1
公开(公告)日:2022-04-28
申请号:US17572293
申请日:2022-01-10
Applicant: Google LLC
Inventor: Ibrahim Badr , Zaheed Sabur , Vladimir Vuskovic , Adrian Zumbrunnen , Lucas Mirelmann
IPC: G10L15/22 , G06F16/903 , G10L15/18 , G06N3/00
Abstract: Methods, apparatus, and computer readable media are described related to automated assistants that proactively incorporate, into human-to-computer dialog sessions, unsolicited content of potential interest to a user. In various implementations, in an existing human-to-computer dialog session between a user and an automated assistant, it may be determined that the automated assistant has responded to all natural language input received from the user. Based on characteristic(s) of the user, information of potential interest to the user or action(s) of potential interest to the user may be identified. Unsolicited content indicative of the information of potential interest to the user or the action(s) may be generated and incorporated by the automated assistant into the existing human-to-computer dialog session. In various implementations, the incorporating may be performed in response to the determining that the automated assistant has responded to all natural language input received from the user during the human-to-computer dialog session.
-
公开(公告)号:US11232792B2
公开(公告)日:2022-01-25
申请号:US16829323
申请日:2020-03-25
Applicant: Google LLC
Inventor: Ibrahim Badr , Zaheed Sabur , Vladimir Vuskovic , Adrian Zumbrunnen , Lucas Mirelmann
IPC: G10L15/22 , G06F16/903 , G10L15/18 , G06N3/00
Abstract: Methods, apparatus, and computer readable media are described related to automated assistants that proactively incorporate, into human-to-computer dialog sessions, unsolicited content of potential interest to a user. In various implementations, in an existing human-to-computer dialog session between a user and an automated assistant, it may be determined that the automated assistant has responded to all natural language input received from the user. Based on characteristic(s) of the user, information of potential interest to the user or action(s) of potential interest to the user may be identified. Unsolicited content indicative of the information of potential interest to the user or the action(s) may be generated and incorporated by the automated assistant into the existing human-to-computer dialog session. In various implementations, the incorporating may be performed in response to the determining that the automated assistant has responded to all natural language input received from the user during the human-to-computer dialog session.
-
公开(公告)号:US12087055B2
公开(公告)日:2024-09-10
申请号:US18188005
申请日:2023-03-22
Applicant: Google LLC
Inventor: Ibrahim Badr , Roland Peter Kehl , Kaan Yucer , Thomas Jonathan Stone , Gokhan H. Bakir , Adrian Zumbrunnen
CPC classification number: G06V20/20 , G06F18/24 , G06T7/248 , G06T7/74 , G06V10/764 , G06V20/50 , H04N23/61 , H04N23/63 , H04N23/633 , G06T2207/10016 , G06T2207/30244
Abstract: Methods, systems, and apparatus for recognizing objects and providing content related to the recognized objects are described. In one aspect, a method includes detecting presence of one or more objects depicted in a viewfinder of a camera of the mobile device. In response to detecting the presence of the one or more objects, image data representing the one or more objects is sent to a content distribution system that selects content related to objects depicted in images. A location of each of the one or more objects in the viewfinder of the camera is tracked while waiting to receive content from the content distribution system. Content related to the one or more objects is received from the content distribution system. A current location of each object in the viewfinder is determined and the content related to the object is presented within the viewfinder at the current location of the object.
-
公开(公告)号:US11972307B2
公开(公告)日:2024-04-30
申请号:US17049696
申请日:2019-08-06
Applicant: GOOGLE LLC
Inventor: Bohdan Vlasyuk , Behshad Behzadi , Mario Bertschler , Denis Burakov , Daniel Cotting , Michael Golikov , Lucas Mirelmann , Steve Cheng , Sergey Nazarov , Zaheed Sabur , Jonathan Lee , Lucia Terrenghi , Adrian Zumbrunnen
CPC classification number: G06F9/547 , G06F3/167 , G06F40/166 , G06F40/35 , G10L15/22 , G10L15/26 , G10L2015/223
Abstract: Implementations set forth herein relate to an automated assistant that can be invoked while a user is interfacing with a foreground application in order to retrieve data from one or more different applications, and then provide the retrieved data to the foreground application. A user can invoke the automated assistant while operating the foreground application by providing a spoken utterance, and the automated assistant can select one or more other applications to query based on content of the spoken utterance. Application data collected by the automated assistant from the one or more other applications can then be used to provide an input to the foreground application. In this way, the user can bypass switching between applications in the foreground in order to retrieve data that has been generated by other applications.
-
公开(公告)号:US20240112679A1
公开(公告)日:2024-04-04
申请号:US18540377
申请日:2023-12-14
Applicant: GOOGLE LLC
Inventor: Ibrahim Badr , Zaheed Sabur , Vladimir Vuskovic , Adrian Zumbrunnen , Lucas Mirelmann
IPC: G10L15/22 , G06F16/903 , G06N3/006 , G10L15/18
CPC classification number: G10L15/22 , G06F16/90335 , G06N3/006 , G10L15/1815 , G10L15/1822 , G10L2015/223
Abstract: Methods, apparatus, and computer readable media are described related to automated assistants that proactively incorporate, into human-to-computer dialog sessions, unsolicited content of potential interest to a user. In various implementations, in an existing human-to-computer dialog session between a user and an automated assistant, it may be determined that the automated assistant has responded to all natural language input received from the user. Based on characteristic(s) of the user, information of potential interest to the user or action(s) of potential interest to the user may be identified. Unsolicited content indicative of the information of potential interest to the user or the action(s) may be generated and incorporated by the automated assistant into the existing human-to-computer dialog session. In various implementations, the incorporating may be performed in response to the determining that the automated assistant has responded to all natural language input received from the user during the human-to-computer dialog session.
-
公开(公告)号:US11482217B2
公开(公告)日:2022-10-25
申请号:US16621540
申请日:2019-05-31
Applicant: Google LLC
Inventor: Michael Golikov , Zaheed Sabur , Denis Burakov , Behshad Behzadi , Sergey Nazarov , Daniel Cotting , Mario Bertschler , Lucas Mirelmann , Steve Cheng , Bohdan Vlasyuk , Jonathan Lee , Lucia Terrenghi , Adrian Zumbrunnen
Abstract: Implementations can reduce the time required to obtain responses from an automated assistant by, for example, obviating the need to provide an explicit invocation to the automated assistant, such as by saying a hot-word/phrase or performing a specific user input, prior to speaking a command or query. In addition, the automated assistant can optionally receive, understand, and/or respond to the command or query without communicating with a server, thereby further reducing the time in which a response can be provided. Implementations only selectively initiate on-device speech recognition responsive to determining one or more condition(s) are satisfied. Further, in some implementations, on-device NLU, on-device fulfillment, and/or resulting execution occur only responsive to determining, based on recognized text form the on-device speech recognition, that such further processing should occur. Thus, through selective activation of on-device speech processing, and/or selective activation of on-device NLU and/or on-device fulfillment, various client device resources are conserved.
-
公开(公告)号:US12230272B2
公开(公告)日:2025-02-18
申请号:US18540377
申请日:2023-12-14
Applicant: GOOGLE LLC
Inventor: Ibrahim Badr , Zaheed Sabur , Vladimir Vuskovic , Adrian Zumbrunnen , Lucas Mirelmann
IPC: G10L15/22 , G06F16/903 , G06N3/006 , G10L15/18
Abstract: Methods, apparatus, and computer readable media are described related to automated assistants that proactively incorporate, into human-to-computer dialog sessions, unsolicited content of potential interest to a user. In various implementations, in an existing human-to-computer dialog session between a user and an automated assistant, it may be determined that the automated assistant has responded to all natural language input received from the user. Based on characteristic(s) of the user, information of potential interest to the user or action(s) of potential interest to the user may be identified. Unsolicited content indicative of the information of potential interest to the user or the action(s) may be generated and incorporated by the automated assistant into the existing human-to-computer dialog session. In various implementations, the incorporating may be performed in response to the determining that the automated assistant has responded to all natural language input received from the user during the human-to-computer dialog session.
-
公开(公告)号:US11651589B2
公开(公告)日:2023-05-16
申请号:US16347484
申请日:2018-05-07
Applicant: Google LLC
Inventor: Ibrahim Badr , Roland Peter Kehl , Kaan Yucer , Thomas Jonathan Stone , Gokhan H. Bakir , Adrian Zumbrunnen
CPC classification number: G06V20/20 , G06K9/6267 , G06T7/248 , G06T7/74 , H04N5/23293 , G06T2207/10016 , G06T2207/30244
Abstract: Methods, systems, and apparatus for recognizing objects and providing content related to the recognized objects are described. In one aspect, a method includes detecting presence of one or more objects depicted in a viewfinder of a camera of the mobile device. In response to detecting the presence of the one or more objects, image data representing the one or more objects is sent to a content distribution system that selects content related to objects depicted in images. A location of each of the one or more objects in the viewfinder of the camera is tracked while waiting to receive content from the content distribution system. Content related to the one or more objects is received from the content distribution system. A current location of each object in the viewfinder is determined and the content related to the object is presented within the viewfinder at the current location of the object.
-
-
-
-
-
-
-
-
-