公开(公告)号：US11971801B1

公开(公告)日：2024-04-30

申请号：US18082492

申请日：2022-12-15

Applicant: GOOGLE LLC

Inventor： Keun Soo Yim ,  Zhitu Chen

IPC: G06F11/34

CPC classification number: G06F11/3438

Abstract: Implementations determine log-in information indicating whether a user of a first application is logged into a target application and/or a website of the target application. In response to the log-in information indicating that the user is logged into the target application but not logged into the website of the target application, a first selectable element can be displayed at a user interface of the first application to receive user input that causes the target application to be opened. In response to the log-in information indicating that the user is not logged into the target application but is logged into the website of the target application, a second selectable element can be displayed at the first application to receive user input that leads to the website of the target application, or the first selectable element can be assigned a deeplink that leads to the website of the target application.

公开(公告)号：US11790173B2

公开(公告)日：2023-10-17

申请号：US17082580

申请日：2020-10-28

Applicant: Google LLC

Inventor： Keun Soo Yim ,  Kyung Yul Lim ,  Umesh Patil

IPC: G06F40/295 ,  G06F40/205 ,  G06F40/279 ,  G10L15/19

CPC classification number: G06F40/295 ,  G06F40/205 ,  G06F40/279 ,  G10L15/19

Abstract: In various implementations described herein, a partial free-form natural language input may be received from a user at an input component of a computing device. The partial free-form natural language input may identify an entity without identifying a responsive action and may be directed by the user to an automated assistant that operates at least in part on the computing device. The partial free-form natural language input may be analyzed to identify the entity. Based on the identified entity, a plurality or superset of candidate responsive actions may be identified, filtered, and/or ranked based on one or more signals. The automated assistant may then provide output that recommends one or more of the candidate responsive actions based on the ranking and/or filtering.

公开(公告)号：US20230274737A1

公开(公告)日：2023-08-31

申请号：US18013083

申请日：2022-05-31

Applicant: Google LLC

Inventor： Keun Soo Yim ,  Ilya Firman ,  Adam Miller Coimbra ,  Robert James Berry ,  Mugurel Ionut Andreica ,  Mikhail Reutov ,  Gabriel Oak Taubman ,  Cliff Shan Kuang ,  Michael Oh ,  Svetoslav Radoslavov Ganov ,  Kalyana Ram Desineni

IPC: G10L15/22 ,  G10L15/18

CPC classification number: G10L15/22 ,  G10L15/1822 ,  G10L2015/223

Abstract: The present disclosure is directed to automating user interactions in an application. In particular, the computing device can determine, based on the input data, an intent associated with performing an action on the computing device. Additionally, the computing device can invoke, using an application-level assistant component configured to provide an application-level interface on the computing device, execution of an application. Moreover, the computing device can transmit, to a system-level assistant component configured to provide a system-level interface with the computing device, instructions to interface with an actionable component of the application. The instructions can be transmitted using a trusted intermediary component configured to facilitate an interface between the system-level assistant component and the application-level assistant component. Furthermore, the computing device can engage, using the system-level assistant component, the actionable component of the application to perform the action.

公开(公告)号：US20220365745A1

公开(公告)日：2022-11-17

申请号：US17319378

申请日：2021-05-13

Applicant: GOOGLE LLC

Inventor： Keun Soo Yim ,  Zhitu Chen ,  Brendan G. Lim

IPC: G06F3/16 ,  G06F3/0488 ,  G06F3/01 ,  G06N20/00

Abstract: Implementations set forth herein relate to an automated assistant that can adapt to circumstances in which a user may invoke an automated assistant with an intention of interacting with the automated assistant via a non-default interface. For example, in some instances, a user may invoke an automated assistant by selecting a selectable GUI element. In response, the automated assistant can determine that, in the current context, spoken utterances may not be suitable for providing to the automated assistant. Based on this determination, the automated assistant can cause a keyboard interface to be rendered and/or initialized for receiving typed inputs from the user. Should the user subsequently change contexts, the automated assistant can determine that voice input is now suitable for user input and initialize an audio interface in response to the user providing an invocation input in the subsequent context.

公开(公告)号：US11374887B2

公开(公告)日：2022-06-28

申请号：US16973380

申请日：2019-10-29

Applicant: Google LLC

Inventor： Keun Soo Yim

IPC: H04L51/046 ,  G06F9/455 ,  H04L51/02

Abstract: Implementations set forth herein relate to an automated assistant that allows third party applications to inject dependencies to leverage automated assistant functions. Furthermore, enabling such dependency injections can allow third party applications to preserve privacy of any application content that is used during execution of automated assistant functions. In some implementations, a third party application can initialize a function with an assistant dependency using parameters that are tagged as private. Initializing a function in such as a way can allow private content communicated between the third party application and the automated assistant to be abstracted for security purposes. The abstracted content can thereafter be communicated to a remote server-such as a server hosting an extensively trained machine learning model. Intelligent output provided by the server can then be incorporated into one or more processes of the third party application without comprising security.

公开(公告)号：US11354464B2

公开(公告)日：2022-06-07

申请号：US16913412

申请日：2020-06-26

Applicant: Google LLC

Inventor： Keun Soo Yim ,  Iliyan Malchev

IPC: G06F30/20 ,  G06F9/455 ,  G06F9/451

Abstract: Methods and apparatus are described herein emulating, by one or more servers on behalf of a mobile computing device, a cloud-based virtual machine. The cloud-based virtual machine may include a virtualized hardware component that provides, as virtual hardware input for a software application executing on the cloud-based virtual machine, either “genuine” virtual hardware input or “simulated” virtual hardware input. Genuine virtual hardware input may be based on an actual hardware signal received from a hardware component of the mobile computing device that corresponds to the virtualized hardware component. Simulated virtual hardware input may be generated independently of any hardware signal associated with the hardware component. Output of the software application may be interactively streamed to the mobile computing device.

公开(公告)号：US12259947B2

公开(公告)日：2025-03-25

申请号：US17252218

申请日：2020-05-29

Applicant: Google LLC

Inventor： Keun Soo Yim

IPC: G06F18/21 ,  G06N20/20 ,  H04L51/02 ,  H04L51/046

Abstract: Implementations set forth herein relate to selectively relying on additional suggestion model(s) when generating selectable suggestions, while also maintaining access to a default suggestion model. The selectable suggestions can be generated using one or more additional multi-domain machine learning (ML) models, which can be optionally available to the client application, regardless of whether a default suggestion model remains useful for generating suitable suggestions. In some implementations, as the client application employs various additional multi-domain ML models, a particular model can be identified as improving suggestions for the client application, at least based on user feedback and/or other data. The particular model can then be selected to replace and/or supplement the default suggestion model, in order to provide more accurate suggestions that, when selected, initialize actions that can preserve time and computational resources.

公开(公告)号：US12169764B2

公开(公告)日：2024-12-17

申请号：US17971331

申请日：2022-10-21

Applicant: GOOGLE LLC

Inventor： Keun Soo Yim ,  Zhitu Chen ,  Brendan G. Lim

IPC: G06N20/00 ,  G06F3/01 ,  G06F3/04886 ,  G06F3/16

Abstract: Implementations set forth herein relate to an automated assistant that can adapt to circumstances in which a user may invoke an automated assistant with an intention of interacting with the automated assistant via a non-default interface. For example, in some instances, a user may invoke an automated assistant by selecting a selectable GUI element. In response, the automated assistant can determine that, in the current context, spoken utterances may not be suitable for providing to the automated assistant. Based on this determination, the automated assistant can cause a keyboard interface to be rendered and/or initialized for receiving typed inputs from the user. Should the user subsequently change contexts, the automated assistant can determine that voice input is now suitable for user input and initialize an audio interface in response to the user providing an invocation input in the subsequent context.

公开(公告)号：US20240281358A1

公开(公告)日：2024-08-22

申请号：US18649016

申请日：2024-04-29

Applicant: GOOGLE LLC

Inventor： Keun Soo Yim ,  Zhitu Chen

IPC: G06F11/34

CPC classification number: G06F11/3438

Abstract: Implementations determine log-in information indicating whether a user of a first application is logged into a target application and/or a website of the target application. In response to the log-in information indicating that the user is logged into the target application but not logged into the website of the target application, a first selectable element can be displayed at a user interface of the first application to receive user input that causes the target application to be opened. In response to the log-in information indicating that the user is not logged into the target application but is logged into the website of the target application, a second selectable element can be displayed at the first application to receive user input that leads to the website of the target application, or the first selectable element can be assigned a deeplink that leads to the website of the target application.

公开(公告)号：US20240095273A1

公开(公告)日：2024-03-21

申请号：US17946806

申请日：2022-09-16

Applicant: GOOGLE LLC

Inventor： Keun Soo Yim

IPC: G06F16/45 ,  G06F16/435

CPC classification number: G06F16/45 ,  G06F16/435

Abstract: Implementations relate to processing media content, and/or associated metadata, to classify the media content into a first category, of a plurality of predefined categories. Versions of those implementations further relate to extracting target content from the media content; generating, based on the extracted target content, an action that corresponds to an application; and generating, based on the generated action, a selectable suggestion including a textual portion that describes the action. Some of those versions further relate to causing the selectable suggestion to be displayed at a display of a client device, along with rendering of the media content. The selectable suggestion, when selected, causes the application to perform the action. The target content can be extracted based on the first category and can be extracted based on the first category in response to the media content being classified into the first category.