公开(公告)号：US11991221B1

公开(公告)日：2024-05-21

申请号：US17843910

申请日：2022-06-17

Applicant: Google LLC

Inventor： Julien Marchand ,  Ramona Bobohalma ,  Daniel Kaemmerer ,  Sana Mithani

IPC: H04L65/1073 ,  H04L61/4541 ,  H04L65/403 ,  H04L67/51 ,  H04W8/00

CPC classification number: H04L65/1073 ,  H04L61/4541 ,  H04L65/403 ,  H04L67/51 ,  H04W8/005

Abstract: A registration request is transmitted to register a media device with a server, the registration request comprising a device identifier associated with the media device. A discovery request is caused to be issued to allow client devices previously registered with the server and connected to the first network to discover the media device, wherein the discovery request is to cause at least a subset of the client devices previously registered with the server and connected to the first network to initiate discovery of the media device without requesting permission from a user of a respective client device to initiate the discovery of the media device, wherein the at least the subset of the client devices includes two or more client devices each associated with an auto-connect status. An identifier of each of the one or more client devices that are previously registered with the server and connected to a first network and an indication of whether each of the one or more client devices has discovered the media device are received, wherein each of the plurality of client devices is associated with a registration identifier pertaining to the first network.

公开(公告)号：US11347834B2

公开(公告)日：2022-05-31

申请号：US16673888

申请日：2019-11-04

Applicant: Google LLC

Inventor： Julien Marchand ,  Sophia Bong ,  Daniel Kaemmerer ,  Allan Mills ,  Jaee Patwardhan ,  Steven Wright ,  Sana Mithani ,  Nicolas Klein ,  William Denniss

IPC: H04L29/06 ,  G06F21/35 ,  H04W8/00 ,  H04W12/06

Abstract: Implementations disclose methods and systems for facilitating an automated user login into a first application hosted by a first-screen device. A method includes detecting, by a second-screen device, a message transmitted by the first-screen device over a network; determining, based on the message, that the first application hosted by the first-screen device is requesting user authentication for the automated user login; presenting, via a second application hosted by the second-screen device, a prompt for user input indicating user acceptance of the automated user login; receiving the user input indicating the user acceptance of the automated user login; and responsive to the user input, transmitting an authentication code from the message to the server device to perform the user authentication for the automated user login into the first application.

公开(公告)号：US12061834B2

公开(公告)日：2024-08-13

申请号：US17745825

申请日：2022-05-16

Applicant: Google LLC

Inventor： Aditya Nag ,  Christopher David Patrick Cooke ,  Ken Hy Kha Thai ,  Sana Mithani ,  Aran Mun

IPC: G06F3/14 ,  H04L65/401 ,  H04L65/403

CPC classification number: G06F3/1462 ,  G06F3/1415 ,  H04L65/4015 ,  H04L65/403

Abstract: A method includes providing, via a user interface (UI) of a first application on a first screen device, a UI element prompting a user to connect the first screen device with a second screen device that is presenting a video to the user. The method further includes receiving, via the UI element, an indication of a user request to connect the first screen device with the second screen device. In response to receiving the indication of the user request to connect the first screen device with the second screen device, the method further includes causing the first screen device to be paired with the second screen device. The method further includes providing, for presentation in the UI of the first application of the first screen device, on or more comments provided by one or more other users for the video that is concurrently presented on the second screen device.

公开(公告)号：US11368500B1

公开(公告)日：2022-06-21

申请号：US17306932

申请日：2021-05-03

Applicant: Google LLC

Inventor： Julien Marchand ,  Ramona Bobohalma ,  Daniel Kaemmerer ,  Sana Mithani

IPC: H04L65/1073 ,  H04W8/00 ,  H04L65/403 ,  H04L67/51 ,  H04L61/4541

Abstract: The present disclosure describes methods and systems for an automatic device discovery. A registration request is transmitted to register a media device with a server, the registration request comprising a device identifier associated with the media device. A discovery request is caused to be issued to allow client devices previously registered with the server and connected to the first network to discover the media device, wherein the discovery request is to cause at least a subset of the client devices previously registered with the server and connected to the first network to initiate discovery of the media device without requesting permission from a user of a respective client device to initiate the discovery of the media device, wherein the at least the subset of the client devices includes two or more client devices each associated with an auto-connect status. An identifier of each of the one or more client devices that are previously registered with the server and connected to a first network and an indication of whether each of the one or more client devices has discovered the media device are received, wherein each of the plurality of client devices is associated with a registration identifier pertaining to the first network.

公开(公告)号：US20250005293A1

公开(公告)日：2025-01-02

申请号：US18217313

申请日：2023-06-30

Applicant: GOOGLE LLC

Inventor： Tuan Nguyen ,  Sergei Volnov ,  William A. Truong ,  Yunfan Ye ,  Sana Mithani ,  Neel Joshi ,  Alexey Galata ,  Tzu-Chan Chuang ,  Liang-yu Chen ,  Qiong Huang ,  Krunal Shah ,  Sai Aditya Chitturu

IPC: G06F40/40 ,  G06F40/30

Abstract: Implementations relate to leveraging large language model(s) (LLMs) and vision language model(s) (VLMs) to facilitate human-to-computer dialogs. In various implementations, one or more digital images may be processed using one or more VLMs to generate VLM output indicative of a state of an environment. An LLM prompt may be assembled based on the VLM output and a natural language input. The LLM prompt may be processed using one or more LLMs to generate content that is responsive to the natural language input. The content that is responsive to the natural language input may subsequently be rendered at one or more output devices.

公开(公告)号：US20240354042A1

公开(公告)日：2024-10-24

申请号：US18758465

申请日：2024-06-28

Applicant: Google LLC

Inventor： Aran Mun ,  Sana Mithani

IPC: G06F3/14 ,  G06F3/0482 ,  H04L65/1069 ,  H04L65/65

CPC classification number: G06F3/1423 ,  G06F3/0482 ,  H04L65/1069 ,  H04L65/65

Abstract: A method includes presenting, in a user interface on a first screen device, a primary media item comprising a video, and one or more secondary media items related to the primary media item. The primary media item and the one or more secondary media items are concurrently presented on a second screen device which is in a pairing session with the first screen device. User input is received, via the user interface on the first screen device, indicating a user request to disable presentation of the at least one of the secondary media items on the second screen device. In response to the user input, at least one of the secondary media items is caused to be no longer presented on the second screen device.

公开(公告)号：US20220113935A1

公开(公告)日：2022-04-14

申请号：US17419255

申请日：2019-07-01

Applicant: GOOGLE LLC

Inventor： Jaee Patwardhan ,  Sana Mithani ,  Allan Mills ,  Nicolas Klein ,  Yakka Nakia Murphy ,  Adam Harrison

IPC: G06F3/16 ,  G06F3/0481 ,  G10L15/26 ,  G10L15/22 ,  G06F16/438 ,  G06F16/435

Abstract: A method includes detecting a session between a mobile device and an alternative playback device. In response to detecting that the session has been established, the method also includes presenting a graphical user interface (GUI) on a screen of a mobile device of a user including a voice search GUI element representing a voice search, receiving a user selection of the voice search GUI element, receiving an audio input of the user to request a search of one or more media items, the audio input specifying one or more search criteria for the search, and submitting a textual search query derived from the audio input for processing, wherein a result of the search is to be presented to the user on a screen of the alternative playback device.

公开(公告)号：US20250078484A1

公开(公告)日：2025-03-06

申请号：US18242213

申请日：2023-09-05

Applicant: GOOGLE LLC

Inventor： Tuan Nguyen ,  Sergei Volnov ,  Yunfan Ye ,  Alexey Galata ,  William A. Truong ,  Tzu-Chan Chuang ,  Liang-yu Chen ,  Qiong Huang ,  Krunal Shah ,  Sai Aditya Chitturu ,  Sana Mithani

IPC: G06V10/80 ,  G06V40/16 ,  G10L15/183 ,  G10L15/30

Abstract: Implementations relate to generating and using multimodal embeddings. In various implementations, first modality data may be obtained and encoded into first modality embedding(s) using a trained first modality encoder that is stored in memory of edge-based client device(s). Second modality data may be obtained and encoded into second modality embedding(s) using a trained second modality encoder that is also stored in the memory of the edge-based client device(s). The first and second modality embeddings may be processed using an edge-based multimodal LLM that is also stored locally in memory of the edge-based client device(s) to generate a multimodal contextual embedding, which may be provided to a remote server that hosts a central LLM, e.g., in conjunction with a natural language input provided by the user. Information generated using the central LLM, responsive to the natural language input, may be received from the remote server.

公开(公告)号：US20240402978A1

公开(公告)日：2024-12-05

申请号：US18801349

申请日：2024-08-12

Applicant: Google LLC

Inventor： Aditya Nag ,  Christopher David Patrick Cooke ,  Ken Hy Kha Thai ,  Sana Mithani ,  Aran Mun

IPC: G06F3/14 ,  H04L65/401 ,  H04L65/403

Abstract: Systems and computer readable mediums are provided that involve operations including providing, via a user interface (UI) of a first application on a first screen device, a UI element prompting a user to connect the first screen device with a second screen device that is presenting a video to the user, receiving, via the UI element, an indication of a user request to connect the first screen device with the second screen device, causing the first screen device to be paired with the second screen device, and providing, for presentation in the UI of the first application of the first screen device, on or more comments provided by one or more other users for the video that is concurrently presented on the second screen device.

公开(公告)号：US12073140B2

公开(公告)日：2024-08-27

申请号：US17043645

申请日：2020-04-01

Applicant: GOOGLE LLC

Inventor： Aran Mun ,  Sana Mithani

IPC: G06F3/14 ,  G06F3/0482 ,  H04L65/1069 ,  H04L65/65

CPC classification number: G06F3/1423 ,  G06F3/0482 ,  H04L65/1069 ,  H04L65/65

Abstract: A first screen device establishes a pairing session between a first screen device and a second screen device. The first screen device presents, in a user interface on the first screen device, a video and one or more media features related to the video. The media features pertain to at least one of a presentation of the video or user feedback about the video. The video is cast from the first screen device onto the second screen device. The first screen device receives, via the user interface, user input indicating a user request to enable presentation of at least one of the media features on the second screen device in connection with the video. In response to the user input, the first screen device causes the at least one of the media features to be presented on the second screen device in connection with the video.