公开(公告)号：US20230379520A1

公开(公告)日：2023-11-23

申请号：US17746818

申请日：2022-05-17

Applicant: Google LLC

Inventor： Dongeek Shin

IPC: H04N21/25 ,  H04N21/845 ,  H04N21/472

CPC classification number: H04N21/251 ,  H04N21/8455 ,  H04N21/47217

Abstract: Methods and systems for time marking of media items at a platform using machine learning are provided herein. A media item to be provided to users of a platform is identified. The media item includes two or more content segments. An indication of the identified media item is provided as input to a machine learning model. The machine learning model is trained using to predict, for a given media item, content segments of the given media item depicting an event of interest to the one or more users. One or more outputs of the machine learning model are obtained. The one or more obtained outputs include event data identifying each content segment of the media item and an indication of a level of confidence that each respective content segment depicts an event of interest. In response to determining that at least one content segment is associated with a level of confidence that satisfies a level of confidence criterion, the at least one content segment is associated with a bookmark for a timeline of the media item. The media item and an indication of the bookmark is provided for presentation to the at least one user.

公开(公告)号：US20230377215A1

公开(公告)日：2023-11-23

申请号：US17663972

申请日：2022-05-18

Applicant: Google LLC

Inventor： Dongeek Shin ,  Aveek Purohit

IPC: G06T11/00 ,  G06V10/25 ,  G06T11/60 ,  G06V10/56 ,  G06V10/70 ,  G06T7/90

CPC classification number: G06T11/001 ,  G06V10/25 ,  G06T11/60 ,  G06V10/56 ,  G06V10/70 ,  G06T7/90 ,  G06T2207/10024 ,  G06T2207/20081

Abstract: A method can include selecting an image from a set of images captured by a camera of a wearable device, identifying a region of interest in the image based on a position of an overlay display of the wearable device, determining a characteristic of the region of interest, determining a characteristic of content to be rendered on the overlay display, modifying the content based on the characteristic of the region of interest and the characteristic of the content, and rendering the modified content on the overlay display.

公开(公告)号：US20230376125A1

公开(公告)日：2023-11-23

申请号：US17663978

申请日：2022-05-18

Applicant: Google LLC

Inventor： Dongeek Shin ,  Ricardo John Campbell

IPC: G06F3/0346 ,  G06F3/01

CPC classification number: G06F3/0346 ,  G06F3/017 ,  G06F3/012 ,  G06F2203/0331

Abstract: Physical gestures may be performed by a user to interact with a head-mounted device. These physical gestures can be detected by other devices worn by the user. For example, a fitness tracker worn on a wrist of a user may be used to detect the movement of the wrist as a gesture and then communicate this gesture to the head-mounted device. This accessory-mediated gesture interaction may be interrupted when the accessory device loses power or otherwise stops tracking. In this condition, the disclosed head-mounted device may take-over gesture detection by monitoring distortions to a magnetic field caused by movement of the device. This form of gesture detection can be used when an active device has exhausted its battery. Further, this form of gesture detection can be used for electrically inactive objects that can cause detectable changes to the magnetic field when moved in the magnetic field.

公开(公告)号：US20230359271A1

公开(公告)日：2023-11-09

申请号：US17662175

申请日：2022-05-05

Applicant: Google LLC

Inventor： Dongeek Shin ,  Ricardo John Campbell ,  Jingying Hu

IPC: G06F3/01

CPC classification number: G06F3/013

Abstract: A method including determining historical user data associated with an event occurring on a wearable device, determining a probability of interacting with an object on a display of the wearable device based on the historical user data, scaling a hitbox associated with the object to form a scaled hitbox, detecting a user input based on an eye tracking being within the scaled hitbox, and in response to detecting the user input, initiating an action corresponding to the object.

公开(公告)号：US11792597B2

公开(公告)日：2023-10-17

申请号：US17456007

申请日：2021-11-22

Applicant: GOOGLE LLC

Inventor： Dongeek Shin

IPC: H04S7/00 ,  G06T7/70 ,  G06F3/01 ,  H04R1/40

CPC classification number: H04S7/303 ,  G06F3/013 ,  G06T7/70 ,  H04R1/406 ,  G06T2207/30201

Abstract: Beamforming can improve the audio quality and/or intensity in a particular direction, which can help a user hear, especially in certain environments. Augmented reality glasses can track the eye, or eyes, of a user which can trigger and guide the beamforming towards a particular object of interest, such as a person speaking. The beamforming may be made efficient by storing information necessary for beamforming in a database and recalling the information at runtime.

公开(公告)号：US20230281935A1

公开(公告)日：2023-09-07

申请号：US18115510

申请日：2023-02-28

Applicant: Google LLC

Inventor： Adam Mittleman ,  Jason Chamberlain ,  Jacobi Grillo ,  Daniel Biran ,  Mark Kraz ,  Lauren Chanen ,  Daniel Foran ,  David Fichou ,  William Dong ,  Bao-Tram Phan Nguyen ,  Brian Silverstein ,  Yash Modi ,  Alex Finlayson ,  Dongeek Shin

IPC: G06T19/00 ,  G06T19/20 ,  G06T15/30 ,  G06T15/20

CPC classification number: G06T19/006 ,  G06T19/20 ,  G06T15/30 ,  G06T15/20 ,  G06T2219/2021 ,  G06T2219/2012

Abstract: A method for guiding installation of smart-home devices may include capturing, by a camera of a mobile computing device, a view of an installation location for a smart-home device; rendering, by the mobile computing device, a view of a virtual object that represents a real-world obstruction that will interfere with the operation or installation of the smart-home device; and displaying, by the mobile computing device, the view of a virtual object that represents real-world obstruction with the view of the installation location on the display of the mobile computing device.

公开(公告)号：US11716569B2

公开(公告)日：2023-08-01

申请号：US17565916

申请日：2021-12-30

Applicant: Google LLC

Inventor： Dongeek Shin ,  Gabriel Slotnick

IPC: H04R29/00 ,  H04R5/04 ,  H04R5/02 ,  H04R27/00 ,  H04S7/00

CPC classification number: H04R5/04 ,  H04R5/02 ,  H04R27/00 ,  H04R29/001 ,  H04S7/301 ,  H04R2227/005 ,  H04R2227/009

Abstract: Methods, systems, and media for identifying a plurality of sets of coordinates for a plurality of devices are provided. In some embodiments, the method comprises: identifying each device in a plurality of devices associated with a user account; instructing the plurality of devices to perform an audio sequence; receiving a plurality of transit times from the plurality of devices; determining a plurality of distances based on the plurality of transit times; determining a plurality of sets of coordinates based on the plurality of distances; associating to each of the plurality of devices a corresponding unique one of the plurality of sets of coordinates; and causing at least one of the plurality of devices to play spatial audio determined from the plurality of sets of coordinates.

公开(公告)号：US20230164508A1

公开(公告)日：2023-05-25

申请号：US17456007

申请日：2021-11-22

Applicant: GOOGLE LLC

Inventor： Dongeek Shin

IPC: H04S7/00 ,  H04R1/40 ,  G06F3/01 ,  G06T7/70

CPC classification number: H04S7/303 ,  H04R1/406 ,  G06F3/013 ,  G06T7/70 ,  G06T2207/30201

Abstract: Beamforming can improve the audio quality and/or intensity in a particular direction, which can help a user hear, especially in certain environments. Augmented reality glasses can track the eye, or eyes, of a user which can trigger and guide the beamforming towards a particular object of interest, such as a person speaking. The beamforming may be made efficient by storing information necessary for beamforming in a database and recalling the information at runtime.

公开(公告)号：US11627890B2

公开(公告)日：2023-04-18

申请号：US17846438

申请日：2022-06-22

Applicant: Google LLC

Inventor： Dongeek Shin ,  Michael Dixon ,  Jake Garrison ,  Andrew William Goldenson

IPC: A61B5/08 ,  G10L25/51 ,  H04R1/04 ,  G10L15/22 ,  G10L15/30 ,  H04R1/02 ,  G01S7/41 ,  G06N20/00 ,  G06N5/04 ,  A61B7/00 ,  A61B5/05 ,  A61B5/00 ,  G06F3/16 ,  G06F3/14

Abstract: Methods, devices, and systems for contactless cough detection and attribution are presented herein. Audio data may be received using a microphone. A cough may be identified as having occurred based on the received audio data. Radar data may be received indicative of reflected radio waves from a radar sensor. A state analysis process may be performed using the received radar data. The detected cough may be attributed to a particular user based at least in part on the state analysis process performed using the radar data.

公开(公告)号：US11592908B2

公开(公告)日：2023-02-28

申请号：US17249966

申请日：2021-03-19

Applicant: GOOGLE LLC

Inventor： Dongeek Shin ,  Shahram Izadi ,  David Kim ,  Sofien Bouaziz ,  Steven Benjamin Goldberg ,  Ivan Poupyrev ,  Shwetak N. Patel

IPC: G06F3/01 ,  G06F1/16 ,  G06V40/20

Abstract: Techniques of identifying gestures include detecting and classifying inner-wrist muscle motions at a user's wrist using micron-resolution radar sensors. For example, a user of an AR system may wear a band around their wrist. When the user makes a gesture to manipulate a virtual object in the AR system as seen in a head-mounted display (HMD), muscles and ligaments in the user's wrist make small movements on the order of 1-3 mm. The band contains a small radar device that has a transmitter and a number of receivers (e.g., three) of electromagnetic (EM) radiation on a chip (e.g., a Soli chip. This radiation reflects off the wrist muscles and ligaments and is received by the receivers on the chip in the band. The received reflected signal, or signal samples, are then sent to processing circuitry for classification to identify the wrist movement as a gesture.