-
公开(公告)号:US20220130386A1
公开(公告)日:2022-04-28
申请号:US17572293
申请日:2022-01-10
Applicant: Google LLC
Inventor: Ibrahim Badr , Zaheed Sabur , Vladimir Vuskovic , Adrian Zumbrunnen , Lucas Mirelmann
IPC: G10L15/22 , G06F16/903 , G10L15/18 , G06N3/00
Abstract: Methods, apparatus, and computer readable media are described related to automated assistants that proactively incorporate, into human-to-computer dialog sessions, unsolicited content of potential interest to a user. In various implementations, in an existing human-to-computer dialog session between a user and an automated assistant, it may be determined that the automated assistant has responded to all natural language input received from the user. Based on characteristic(s) of the user, information of potential interest to the user or action(s) of potential interest to the user may be identified. Unsolicited content indicative of the information of potential interest to the user or the action(s) may be generated and incorporated by the automated assistant into the existing human-to-computer dialog session. In various implementations, the incorporating may be performed in response to the determining that the automated assistant has responded to all natural language input received from the user during the human-to-computer dialog session.
-
公开(公告)号:US11232792B2
公开(公告)日:2022-01-25
申请号:US16829323
申请日:2020-03-25
Applicant: Google LLC
Inventor: Ibrahim Badr , Zaheed Sabur , Vladimir Vuskovic , Adrian Zumbrunnen , Lucas Mirelmann
IPC: G10L15/22 , G06F16/903 , G10L15/18 , G06N3/00
Abstract: Methods, apparatus, and computer readable media are described related to automated assistants that proactively incorporate, into human-to-computer dialog sessions, unsolicited content of potential interest to a user. In various implementations, in an existing human-to-computer dialog session between a user and an automated assistant, it may be determined that the automated assistant has responded to all natural language input received from the user. Based on characteristic(s) of the user, information of potential interest to the user or action(s) of potential interest to the user may be identified. Unsolicited content indicative of the information of potential interest to the user or the action(s) may be generated and incorporated by the automated assistant into the existing human-to-computer dialog session. In various implementations, the incorporating may be performed in response to the determining that the automated assistant has responded to all natural language input received from the user during the human-to-computer dialog session.
-
公开(公告)号:US20210342047A1
公开(公告)日:2021-11-04
申请号:US17378856
申请日:2021-07-19
Applicant: Google LLC
Inventor: Ibrahim Badr , Gokhan H. Bakir , Roland Peter Kehl , Nils Grimsmo
IPC: G06F3/0484 , G06F9/451 , G06F3/0482 , G06F3/16 , G06K9/00 , G08C17/02
Abstract: Methods, systems, and apparatus for controlling smart devices are described. In one aspect a method includes receiving image data for an image captured by a camera of a mobile device of a user and determining that the image depicts at least one of a smart device or a physical control for the smart device. In response to determining that that the image depicts a smart device or a physical control for the smart device, identifying one or more user interface controls for controlling the smart device, and generating and presenting, at a display of the mobile device, the one or more user interface controls for controlling the smart device. The method can further include detecting, at the display of the mobile device, user interaction with at least one of the one or more user interface controls, and controlling the smart device based on the detected user interaction.
-
公开(公告)号:US10791078B2
公开(公告)日:2020-09-29
申请号:US15953266
申请日:2018-04-13
Applicant: Google LLC
Inventor: Fredrik Bergenlid , Vladyslav Lysychkin , Denis Burakov , Behshad Behzadi , Andrea Terwisscha van Scheltinga , Quentin Lascombes de Laroussilhe , Mikhail Golikov , Koa Metter , Ibrahim Badr , Zaheed Sabur
IPC: H04L12/58 , G06F16/44 , H04N21/4788 , H04N21/439 , H04N7/15 , G10L15/22 , G10L25/63 , G10L15/16 , G10L15/00
Abstract: Implementations relate to providing information items for display during a communication session. In some implementations, a computer-implemented method includes receiving, during a communication session between a first computing device and a second computing device, first media content from the communication session. The method further includes determining a first information item for display in the communication session based at least in part on the first media content. The method further includes sending a first command to at least one of the first computing device and the second computing device to display the first information item.
-
公开(公告)号:US20200219294A1
公开(公告)日:2020-07-09
申请号:US16727337
申请日:2019-12-26
Applicant: Google LLC
Inventor: Ibrahim Badr , Roza Chojnacka
Abstract: A system and method for creating an augmented reality (AR) environment are disclosed. AR effects are determined based on events detected in captured audio and combined with captured video to create an AR environment for an application. The resulting AR experience is triggered, generated, altered or otherwise controlled by sound, such as speech.
-
公开(公告)号:US20190391716A1
公开(公告)日:2019-12-26
申请号:US16017394
申请日:2018-06-25
Applicant: Google LLC
Inventor: Ibrahim Badr , Gokhan H. Bakir , Roland Peter Kehl , Nils Grimsmo
IPC: G06F3/0484 , G08C17/02 , G06F3/16 , G06F3/0482 , G06K9/00 , G06F9/451
Abstract: Methods, systems, and apparatus for controlling smart devices are described. In one aspect a method includes receiving image data for an image captured by a camera of a mobile device of a user and determining that the image depicts at least one of a smart device or a physical control for the smart device. In response to determining that that the image depicts a smart device or a physical control for the smart device, identifying one or more user interface controls for controlling the smart device, and generating and presenting, at a display of the mobile device, the one or more user interface controls for controlling the smart device. The method can further include detecting, at the display of the mobile device, user interaction with at least one of the one or more user interface controls, and controlling the smart device based on the detected user interaction.
-
公开(公告)号:US20190354252A1
公开(公告)日:2019-11-21
申请号:US15981536
申请日:2018-05-16
Applicant: Google LLC
Inventor: Ibrahim Badr
IPC: G06F3/0484 , G06F3/16 , G06F3/0481
Abstract: Methods, systems, and apparatus for selecting an input mode are described. In one aspect, a method includes receiving request data specifying a request to launch a virtual assistant application from a lock screen of a mobile device. In response to receiving the request data, input signals are obtained. A selection of an input mode for the virtual assistant application is made, from candidate input modes, based on the input signals. Each candidate input mode is of an input type different from each other input type of each other candidate input mode. The input types include an image type and an audio type. The input mode of the image type receives pixel data for input to the virtual assistant application. The input mode of the audio type receives audio input for the virtual assistant application. The virtual assistant application presents content selected based on input signals received using the selected input mode.
-
公开(公告)号:US20190036856A1
公开(公告)日:2019-01-31
申请号:US15953266
申请日:2018-04-13
Applicant: Google LLC
Inventor: Fredrik Bergenlid , Vladyslav Lysychkin , Denis Burakov , Behshad Behzadi , Andrea Terwisscha van Scheltinga , Quentin Lascombes de Laroussilhe , Mikhail Golikov , Koa Metter , Ibrahim Badr , Zaheed Sabur
CPC classification number: H04L51/10 , G06F16/44 , G10L15/005 , G10L15/16 , G10L15/22 , G10L25/63 , G10L2015/223 , H04N7/15 , H04N21/4394 , H04N21/4788
Abstract: Implementations relate to providing information items for display during a communication session. In some implementations, a computer-implemented method includes receiving, during a communication session between a first computing device and a second computing device, first media content from the communication session. The method further includes determining a first information item for display in the communication session based at least in part on the first media content. The method further includes sending a first command to at least one of the first computing device and the second computing device to display the first information item.
-
公开(公告)号:US20240404277A1
公开(公告)日:2024-12-05
申请号:US18801217
申请日:2024-08-12
Applicant: Google LLC
Inventor: Ibrahim Badr , Roland Peter Kehl , Kaan Yucer , Thomas Jonathan Stone , Gokhan H. Bakir , Adrian Zumbrunnen
Abstract: Methods, systems, and apparatus for recognizing objects and providing content related to the recognized objects are described. In one aspect, a method includes detecting presence of one or more objects depicted in a viewfinder of a camera of the mobile device. In response to detecting the presence of the one or more objects, image data representing the one or more objects is sent to a content distribution system that selects content related to objects depicted in images. A location of each of the one or more objects in the viewfinder of the camera is tracked while waiting to receive content from the content distribution system. Content related to the one or more objects is received from the content distribution system. A current location of each object in the viewfinder is determined and the content related to the object is presented within the viewfinder at the current location of the object.
-
公开(公告)号:US20240403185A1
公开(公告)日:2024-12-05
申请号:US18651198
申请日:2024-04-30
Applicant: Google LLC
Inventor: Ibrahim Badr , Imran R. Mansuri , Sari Onaissi , InHan Kang , Wenqiong Guo , Anner Kushnir
IPC: G06F11/34 , G06F16/906 , G06F16/9535 , G06N20/00
Abstract: A computing system and method that can be used to surface a selectable action element for at least one ongoing task. In particular, the present disclosure provides a general pipeline to identify potential tasks that a user has an ongoing interest in or has not yet completed so that a suggestion of a content item can be made to further advance an identified user's task. This pipeline can incorporate probabilistic transition graphs, machine-learned models, and/or historical data to determine the relevance and completion of tasks that a user may desire to continue acting upon.
-
-
-
-
-
-
-
-
-