公开(公告)号：US12223954B2

公开(公告)日：2025-02-11

申请号：US17058895

申请日：2020-11-10

Applicant: Google LLC

Inventor： Thomas Deselaers ,  Sandro Feuz

IPC: G10L15/22 ,  G06F3/16 ,  G06F9/54 ,  G10L15/06 ,  G06F3/048

Abstract: Implementations relate to an automated assistant that is capable of interacting with non-assistant applications that do not have functionality explicitly provided for interfacing with certain automated assistants. Application data, such as annotation data and/or GUI data, associated with a non-assistant application, can be processed to map such data into an embedding space. An assistant input command can then be processed and mapped to the same embedding space, and a distance from the assistant input command embedding and the non-assistant application data embedding can be determined. When the distance between the assistant input command embedding and the non-assistant application data embedding satisfies threshold(s), the automated assistant can generate instruction(s), for the non-assistant application, that correspond to the non-assistant application data. For instance, the instruction(s) can simulate user input(s) that cause the non-assistant application to perform one or more operations characterized by, or otherwise associated with, the non-assistant application data.

公开(公告)号：US12041057B2

公开(公告)日：2024-07-16

申请号：US18159900

申请日：2023-01-26

Applicant: Google LLC

Inventor： Victor Carbune ,  Sandro Feuz

IPC: H04L67/52 ,  G06F21/62 ,  H04L9/40 ,  H04L67/306 ,  H04L67/54 ,  G06F9/4401

CPC classification number: H04L63/102 ,  G06F21/629 ,  H04L63/08 ,  H04L67/306 ,  H04L67/52 ,  H04L67/54 ,  G06F9/442

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for extending application access across devices. In some implementations, an electronic device receives a request to provide access to the electronic device to a particular user that is not registered as a user of the electronic device. The electronic device receives authentication credentials for the particular user. The electronic device provides the authentication credentials to a server system and receives data from the server system that (i) indicates that the providing access to the electronic device in a guest mode is authorized, and (ii) indicates a state of an instance of an application installed on a second device. The electronic device provides access to the electronic device in the guest mode that provides an interface that at least partially recreates the state of the instance of the application installed on the second device.

公开(公告)号：US12018949B2

公开(公告)日：2024-06-25

申请号：US16611453

申请日：2018-11-07

Applicant: GOOGLE LLC

Inventor： Thomas Deselaers ,  Sandro Feuz

IPC: G01C21/34 ,  G01C21/36 ,  G06N5/04 ,  G06N20/00 ,  H04L51/046

CPC classification number: G01C21/3438 ,  G01C21/3691 ,  G06N5/04 ,  G06N20/00 ,  H04L51/046 ,  G01C21/362

Abstract: A navigation service determines that a first user intends to navigate to a shared destination from a first location, at a first time, and that a second user intends to navigate to the shared destination from a second location, at a second time within a threshold interval of the first time. The navigation service notifies the first user using an electronic notification that the second user intends to navigate to the shared destination, receives from the first user an electronic request to coordinate navigation to the shared destination with the second user, and in response to receiving the electronic request, provides navigation directions to the shared destination to a device associated with the first user in view of a progress of the second user toward the shared destination.

公开(公告)号：US20220405423A1

公开(公告)日：2022-12-22

申请号：US17893989

申请日：2022-08-23

Applicant: GOOGLE LLC

Inventor： Sandro Feuz ,  Sammy El Ghazzal

IPC: G06F21/62 ,  G10L15/18 ,  G10L15/22 ,  G10L15/30 ,  H04L51/02 ,  H04L67/306 ,  G06F16/33 ,  G06F40/279 ,  H04L9/40 ,  H04L67/52

Abstract: Automated assistant responses may be assembled and/or evaluated to address privacy concerns. In various implementations, a free-form natural language input may be received from a first user and may include a request for information pertaining to a second user. Multiple data sources may be identified that are accessible by an automated assistant to retrieve data associated with the second user. The multiple data sources may collectively include sufficient data to formulate a natural language response to the request. Respective privacy scores associated with the multiple data sources may be used to determine an aggregate privacy score associated with responding to the request. The natural language response may then be output at a client device operated by the first user in response to a determination that the aggregate privacy score associated with the natural language response satisfies a privacy criterion established for the second user with respect to the first user.

公开(公告)号：US11366812B2

公开(公告)日：2022-06-21

申请号：US16621109

申请日：2019-06-25

Applicant: Google LLC

Inventor： Victor Carbune ,  Sandro Feuz

IPC: G06F17/00 ,  G06F16/2455 ,  G06F16/953 ,  G06N20/00 ,  G06F16/901

Abstract: Techniques and a framework are described herein for gathering information about developing events from multiple live data streams and pushing new pieces of information to interested individuals as those pieces of information are learned. In various implementations, a plurality of live data streams may be monitored. Based on the monitoring, a data structure that models diffusion of information through a population may be generated and applied as input across a machine learning model to generate output. The output may be indicative of a likelihood of occurrence of a developing event and/or a predicted measure of relevancy of the developing event to a particular user. Based on a determination that the likelihood and/or measure of relevancy satisfies a criterion, one or more computing devices may render, as output, information about the developing event.

公开(公告)号：US20220101200A1

公开(公告)日：2022-03-31

申请号：US17545384

申请日：2021-12-08

Applicant: Google LLC

Inventor： Sandro Feuz ,  Victor Carbune

IPC: G06N20/00 ,  G06N5/02 ,  G06F9/46

Abstract: The present disclosure provides systems and methods for on-device machine learning. In particular, the present disclosure is directed to an on-device machine learning platform and associated techniques that enable on-device prediction, training, example collection, and/or other machine learning tasks or functionality. The on-device machine learning platform can include a mode controller that allows a user to provide data input indicating whether to operate one or more applications on the device in a first collection mode (e.g., permission mode) for storing training examples or a second collection mode for (e.g., incognito mode) for not storing training examples. The training examples can be generated based on user interaction with the one or more applications and used to personalize one or more machine-learned models used by the application(s) by retraining the models using the user-specific training examples.

公开(公告)号：US20210409361A1

公开(公告)日：2021-12-30

申请号：US17474756

申请日：2021-09-14

Applicant: Google LLC

Inventor： Sandro Feuz ,  Sebastian Millius

IPC: H04L12/58 ,  G06Q10/10

Abstract: This specification is generally directed to techniques for automatically transitioning applications—especially those that enable exchange of messages between users—into and/or out of a private state based on a variety of signals associated with the messages and/or the participants themselves. In various implementations, an ongoing message exchange thread between two or more participants operating two or more respective message exchange clients may be examined. Based at least in part on the examining, a likelihood may be determined that message(s) directed by one of the participants to another of the participants as part of the ongoing message exchange thread would be deemed private by at least a given participant of the two or more participants. A determination may be made of whether the determined likelihood satisfies one or more thresholds, and in response, one or more of the message exchange clients may be transitioned into a private state.

公开(公告)号：US11157488B2

公开(公告)日：2021-10-26

申请号：US15840103

申请日：2017-12-13

Applicant: Google LLC

Inventor： Sandro Feuz ,  Thomas Deselaers

IPC: G06F16/242 ,  G06F9/54 ,  G06N20/00 ,  G06F16/9535

Abstract: Implementations are related to observing user interactions in association with searching for various files, and modifying a model and/or index based on such observations in order to improve the search process. In some implementations, a reinforcement learning model is utilized to adapt one or more search actions of the search process. Such search action(s) can include, for example, updating an index, reweighting terms in an index, modifying a search query, and/or modifying one or more ranking signal(s) utilized in raking search results. A policy of the reinforcement learning model can be utilized to generate action parameters that dictate performance of search action(s) for a search query, dependent on an observed state that is based on the search query. The policy can be iteratively updated in view of a reward function, and observed user interactions across multiple search sessions, to generate a learned policy that reduces duration of search sessions.

公开(公告)号：US20210297530A1

公开(公告)日：2021-09-23

申请号：US17340768

申请日：2021-06-07

Applicant: GOOGLE LLC

Inventor： Sandro Feuz ,  Thomas Deselaers

IPC: H04M3/436 ,  G06N20/00 ,  G06F3/01 ,  H04M3/42

Abstract: Implementations set forth herein relate to generating a pre-call analysis for one or more users that are receiving and/or initializing a call with one or more other users, and/or prioritizing pre-call content according to whether security-related value was gleaned from provisioning certain pre-call content. One or more machine learning models can be employed for determining the pre-call content to be cached and/or presented prior to a user accepting a call from another user. Feedback provided before, during, and/or after the call can be used as a basis from which to prioritize certain content and/or sources of content when generating pre-call content for a subsequent call. Other information, such as contextual data (e.g., calendar entries, available peripheral devices, location, etc.) corresponding to the previous call and/or the subsequent call, can also be used as a basis from which to provide a pre-call analysis.

公开(公告)号：US11032418B2

公开(公告)日：2021-06-08

申请号：US16339235

申请日：2019-01-16

Applicant: Google LLC

Inventor： Sandro Feuz ,  Thomas Deselaers

IPC: H04M3/436 ,  G06N20/00 ,  G06F3/01 ,  H04M3/42

Abstract: Implementations set forth herein relate to generating a pre-call analysis for one or more users that are receiving and/or initializing a call with one or more other users, and/or prioritizing pre-call content according to whether security-related value was gleaned from provisioning certain pre-call content. One or more machine learning models can be employed for determining the pre-call content to be cached and/or presented prior to a user accepting a call from another user. Feedback provided before, during, and/or after the call can be used as a basis from which to prioritize certain content and/or sources of content when generating pre-call content for a subsequent call. Other information, such as contextual data (e.g., calendar entries, available peripheral devices, location, etc.) corresponding to the previous call and/or the subsequent call, can also be used as a basis from which to provide a pre-call analysis.