公开(公告)号：US10389986B2

公开(公告)日：2019-08-20

申请号：US15900766

申请日：2018-02-20

Applicant: Google LLC

Inventor： Ghulam Ahmed Kirmani ,  Andrea Colaco ,  Dongeek Shin

IPC: H04N5/33 ,  H04N5/222 ,  H04N5/225 ,  H04N7/18 ,  G06K9/00 ,  G06K9/52 ,  G06K9/20 ,  G06K9/46 ,  G06T7/586 ,  G06T7/50

Abstract: A method generates depth maps at a camera having illuminators, a lens assembly, an image sensing element, a processor, and memory. The illuminators operate in a first mode to provide illumination, the lens assembly focuses incident light on the image sensing element, the memory stores image data from the image sensing element, and the processor executes programs to control operation of the camera. The method reconfigures the illuminators to operate in a second mode, where each of a plurality of subsets of the illuminators provides illumination of a scene separately. For each subset, the process activates the illuminators in the subset without activating illuminators not in the subset and receives reflected illumination from the scene incident on the lens assembly and focused onto the image sensing element. The measured light intensity of the received reflected illumination at the image sensing element is stored in association with activation of the subset.

公开(公告)号：US10008003B2

公开(公告)日：2018-06-26

申请号：US15582755

申请日：2017-04-30

Applicant: GOOGLE LLC

Inventor： Ghulam Ahmed Kirmani ,  Andrea Colaco ,  Dongeek Shin

IPC: H04N7/173 ,  G06T7/586 ,  H04N5/33 ,  H04N7/18 ,  G06T15/50 ,  H04N13/02

CPC classification number: G06T7/586 ,  G06K9/00624 ,  G06K9/2036 ,  G06T15/506 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/10028 ,  G06T2207/10048 ,  G06T2207/20081 ,  G06T2207/20104 ,  G06T2207/30232 ,  G06T2207/30244 ,  H04N5/33 ,  H04N7/181 ,  H04N7/183 ,  H04N13/207 ,  H04N13/243 ,  H04N13/254 ,  H04N13/271

Abstract: A process generates a lookup table to estimate spatial depth in a visual scene. The process identifies subsets of illuminators of a camera system with image sensors and illuminators. The image sensors are associated with multiple pixels. For each pixel, and for each of multiple depths from the pixel, the process simulates a virtual surface at the depth. For each subset of the subsets of illuminators, the process simulates illumination of the virtual surface from the subset and determines an expected light intensity at the pixel from light reflected from the virtual surface due to the simulated illumination. The process forms intensity information from the expected light intensity determined for the pixel for each of the depths and each of the subsets. The process constructs a lookup table comprising the intensity information. The lookup table associates the intensity information for each pixel with the respective depth and the respective subset.

公开(公告)号：US20250071354A1

公开(公告)日：2025-02-27

申请号：US18236244

申请日：2023-08-21

Applicant: Google LLC

Inventor： Dongeek Shin

IPC: H04N21/2343 ,  H04N21/25

Abstract: A method for generating a video transition sequence between a first and a second video is provided. The method first identifies and embeds starting and ending images for the video transition sequence into a latent vector space. The method then interpolates to generate an interpolation trajectory between the starting and ending image embeddings within the latent vector space. The method then reconstructs the interpolation trajectory from the latent vector space to a final video transition sequence in the original image vector space. This video transition sequence is then displayed so as to smoothly transition between two videos.

公开(公告)号：US12229747B2

公开(公告)日：2025-02-18

申请号：US18183460

申请日：2023-03-14

Applicant: Google LLC

Inventor： Dongeek Shin

IPC: G06Q20/32

Abstract: The present disclosure provides computer-implemented methods, systems, and devices for enabling frictionless transactions at a merchant location using audio communication. A central hub device receives transaction notification data describing a transaction with a user computing device. The central hub device accesses one or more location determination signals to estimate a location of the user computing device with the merchant location. The central hub device transmits transaction data to the estimated location of the user computing device using audio-based communications, the transaction data including an audio key that, when detected by the user computing device, causes the user computing device to automatically activate an application for providing payment data. The central hub device receiving transaction payment data from the user computing device. The central hub device executes the transaction by transmitting transaction data to a payment system.

公开(公告)号：US20250054052A1

公开(公告)日：2025-02-13

申请号：US18565363

申请日：2022-12-29

Applicant: Google LLC

Inventor： Dongeek Shin

IPC: G06Q30/0601 ,  G06Q30/0251 ,  H04W4/02 ,  H04W4/38

Abstract: Systems (312) and methods (400) are provided for passively collecting context data associated with in-store shopping by a user. In this regard, one or more processors (202, 204) may receive, from each earbud in a pair of earbuds (238) worn by a user, sensor data corresponding to an orientation of each respective earbud (240, 242). Based on the received sensor data, the one or more processors (202, 204) may determine the gaze directions of the user as the user travels within a store and one or more products viewed by the user while traveling within the store by comparing, using a content map (128) of the store, the gaze directions of the user to product locations storing products, wherein the one or more products are the context data.

公开(公告)号：US20250039501A1

公开(公告)日：2025-01-30

申请号：US18360233

申请日：2023-07-27

Applicant: Google LLC

Inventor： Dongeek Shin

IPC: H04N21/4402 ,  G06T3/40

Abstract: Techniques and systems are disclosed that reduce latency in streaming media items. The techniques include communicating, to a media streaming service, a selection of a media item from a client device, receiving, from the media streaming service, a first portion of the media item having a first resolution and presenting, using the first portion, the media item on a presentation interface of the client device. The techniques further include receiving, from the media streaming service, a second portion of the media item having a second resolution, and presenting, responsive to an occurrence of a first threshold condition, the second portion of the media item on the presentation interface of the client device.

公开(公告)号：US20250024218A1

公开(公告)日：2025-01-16

申请号：US18351988

申请日：2023-07-13

Applicant: GOOGLE LLC

Inventor： Rajeev Nongpiur ,  Dongeek Shin ,  Sinan Hersek ,  Jason Kerr

IPC: H04S7/00

Abstract: Techniques include providing a user with a set of loudspeakers on a sphere and playing back sound from the set of loudspeakers one at a time. For each loudspeaker, the user points in a direction at which the user perceives the sound. The HRTF corresponding to a new direction based on the perceived direction is used instead, or the original HRTF at the perceived direction is used. In some implementations, the new direction is obtained from the perceived direction via a barycentric mapping. In some implementations, a difference between the new direction and the perceived direction is equal to a difference between the perceived direction and the original direction.

公开(公告)号：US20240419463A1

公开(公告)日：2024-12-19

申请号：US18210586

申请日：2023-06-15

Applicant: GOOGLE LLC

Inventor： Dongeek Shin

IPC: G06F9/451 ,  G06F3/044 ,  G06F3/16

Abstract: Implementations set forth herein relate to controlling invocation of an automated assistant according to whether a capacitive touch sensor array has detected a particular input that indicates a user has positioned an assistant-enabled device near their face. The capacitive touch sensor array can be part of a touch display interface of a portable computing device that provides access to an automated assistant. When the interface is positioned near the face of the user, input data from the interface can be processed to determine whether the input data indicates the display interface is near their face or whether the user is providing some other input to the display interface. When the input data indicates the user is positioning the display interface near their face or mouth, the automated assistant can be invoked in lieu of the user providing any other invocation input.

公开(公告)号：US20240411788A1

公开(公告)日：2024-12-12

申请号：US18332356

申请日：2023-06-09

Applicant: GOOGLE LLC

Inventor： Dongeek Shin

IPC: G06F16/332 ,  G06F3/0483 ,  G06F16/33 ,  G06F16/338 ,  G06F16/34 ,  G06F40/35 ,  G06F40/40

Abstract: According to an aspect, a method includes receiving, by a language model, session state information, generated by a browser application, about a computer session of a user, receiving, by the language model, a user-generated query including a natural language description about a browser tab, generating, by the language model, a textual response about the browser tab using contextual data, the contextual data including the session state information, and providing the textual response on a user device.

公开(公告)号：US12105885B2

公开(公告)日：2024-10-01

申请号：US18006096

申请日：2021-09-27

Applicant: GOOGLE LLC

Inventor： Dongeek Shin

IPC: G06F3/01 ,  G04G21/02 ,  G04G21/08 ,  G06F3/03

CPC classification number: G06F3/017 ,  G04G21/025 ,  G04G21/08 ,  G06F3/0304

Abstract: A sensor on a wearable device may be further configured as a sensor for detecting and recognizing a gesture to control the wearable device. For example, light detected by a photoplethysmography (PPG) sensor of a smart watch may include (i) light back reflected from underneath the smart watch and (ii) light back reflected from a touch to a wrist adjacent to the smart watch. The detected light may be filtered to isolate the light back reflected from the touch. A waterfall image that includes information about how the isolated light changes with time and amplitude may be generated and used to detect and recognize gestures performed on the wrist, such as a touch. This additional touch area may help to supplement a touch area provided by a display to control the smart watch.