公开(公告)号：US12167082B2

公开(公告)日：2024-12-10

申请号：US17933631

申请日：2022-09-20

Applicant: Google LLC

Inventor： Alex Olwal ,  Ruofei Du

IPC: G06F3/16 ,  G06F3/01 ,  G06T19/00 ,  H04N21/431 ,  H04N21/442

Abstract: Systems and methods are related to tracking an attention of a user with respect to content presented on a virtual screen, detecting a defocus event associated with a first region of the content, and determining a next focus event associated with a second region of the content. The determination can be based at least in part on the defocus event and on the tracked attention of the user. The systems and methods can include generating, based on the determined next focus event, a marker for differentiating the second region of the content from a remainder of the content, and in response to detecting a refocus event associated with the virtual screen, triggering execution of the marker associated with the second region of the content.

公开(公告)号：US12142185B2

公开(公告)日：2024-11-12

申请号：US17569022

申请日：2022-01-05

Applicant: Google LLC

Inventor： Alex Olwal ,  Artem Dementyev

IPC: G09G3/20 ,  G06T11/20 ,  G09G3/3216

Abstract: Subsurface display interfaces and associated systems and methods are provided. In some embodiments, an example method can include: dividing a graphic to be displayed into a plurality of sets of primitives, each primitive of the sets of primitives comprising a rectangle or a line; assigning the plurality of sets of primitives to display frames of a plurality of display frames; and outputting, at a display positioned under a surface and in series, the plurality of display frames.

公开(公告)号：US20240330362A1

公开(公告)日：2024-10-03

申请号：US18555814

申请日：2022-10-25

Applicant: GOOGLE LLC

Inventor： Ruofei Du ,  Alex Olwal ,  Xingyu Liu

IPC: G06F16/58 ,  G02B27/01 ,  G10L15/26

CPC classification number: G06F16/58 ,  G02B27/017 ,  G10L15/26 ,  G02B2027/0178

Abstract: Methods and devices are provided where a device may receive audio data via a sensor of a computing device. The device may convert the audio data to text and extract a portion of the text. The device may input the portion of the text to a neural network-based language model to obtain at least one of a type of visual images, a source of the visual images, a content of the visual images, or a confidence score for the visual images. The device may determine at least one visual image based on at least one of the type of the visual images, the source of the visual images, the content of the visual images, or the confidence score for each of the visual images. The at least one visual image may be output on a display of the computing device to supplement the audio data and facilitate a communication.

公开(公告)号：US11715362B2

公开(公告)日：2023-08-01

申请号：US17366890

申请日：2021-07-02

Applicant: Google LLC

Inventor： Franziska Schlagenhauf ,  Nina R. Sinatra ,  Kurtis Robert Gross ,  Kelly Elizabeth Dobson ,  Artem Dementyev ,  Alex Olwal ,  Richard Francis Lyon

IPC: G08B21/18 ,  G01L5/10 ,  G08B7/06 ,  B06B1/04

CPC classification number: G08B21/182 ,  B06B1/045 ,  G01L5/10 ,  G08B7/06

Abstract: A wearable device can include a wearable band configured to contact a user of the wearable device, an actuator, a sensor, and one or more processors in communication with the actuator and the sensor. The processors can be configured to measure a back electromotive force (“EMF”) of the actuator; determine, based on the measured back EMF, data that describes a contact force between the wearable band and the user; and determine, based on the data that describes the contact force, a quality metric describing a data quality of sensor data collected by the sensor. In some embodiments, the processor(s) can determine, generate sensor output data based on the sensor data and based at least in part on the data describing the contact force between the wearable band and the user. For example, one or more machine-learned models maybe leveraged to generate sensor output data that is compensated for the wearable band being too tight or too loose.

公开(公告)号：US20230186438A1

公开(公告)日：2023-06-15

申请号：US17643552

申请日：2021-12-09

Applicant: Google LLC

Inventor： Hendrik Wagenaar ,  Alex Olwal

IPC: G06T5/00 ,  G06T9/00

CPC classification number: G06T5/006 ,  G06T9/00

Abstract: A method including receiving, by a companion device from an optical display, a distortion information associated with a geometric distortion associated with rendering an image on a display of the optical display, distorting, by the companion device, the image using the distortion information, preprocessing, by the companion device, the distorted image based on compression artifacts, compressing, by the companion device, the distorted image, and communicating, by the companion device, the compressed image to the optical display

公开(公告)号：US11637519B2

公开(公告)日：2023-04-25

申请号：US17733181

申请日：2022-04-29

Applicant: Google LLC

Inventor： Artem Dementyev ,  Richard Francis Lyon ,  Alex Olwal

IPC: H02P25/034

Abstract: The present disclosure provides systems and methods for using a linear resonant actuator (“LRA”) to determine a type of contact between a device and its surroundings. The LRA may be coupled to an amplifier by one or more switches. The audio amplifier may receive a signal from a microcontroller and transmit the signal the LRA when the switches are closed. When the switches are in an open position, the LRA may be actively sensing for the type of contact. The back EMF may be measured when the switches are open. The measured back EMF waveform may be used to determine the type of contact. When the signal is not being transmitted, the LRA may be passively sensing to determine whether the device was tapped.

公开(公告)号：US20230117142A1

公开(公告)日：2023-04-20

申请号：US17794899

申请日：2020-01-24

Applicant: Huanfen YAO ,  Alex OLWAL ,  Abdelkareem BEDRI ,  Google LLC

Inventor： Abdelkareem Bedri ,  Alex Olwal ,  Huanfen Yao

IPC: A61B5/00 ,  A61B5/11 ,  A61B5/103

Abstract: A computing system configured to perform operations that identify user movement(s) as upper-body exercise(s). The operations can include obtaining sensor data generated by one or more sensors of a footwear device worn by a user, the one or more sensors positioned in one or more positions of the footwear device, the sensor data associated with one or more movements performed by the user. The sensor data can be input into a machine-learned exercise identification model. Exercise identification data can be received as an output of the machine-learned exercise identification model. The exercise identification data can identify the one or more movements performed by the user as one or more upper-body exercises performed by the user, the exercise identification data comprising one or more exercise characteristics associated with each upper-body exercise of the one or more upper-body exercises performed by the user.

公开(公告)号：US20220165054A1

公开(公告)日：2022-05-26

申请号：US17594209

申请日：2020-10-13

Applicant: Google LLC

Inventor： Alex Olwal ,  Kevin Balke ,  Dmitrii Votintcev

IPC: G06V10/94 ,  G06V10/764 ,  G06V40/16 ,  H04N7/18

Abstract: According to an aspect, a method for distributed sound/image recognition using a wearable device includes receiving, via at least one sensor device, sensor data, and detecting, by a classifier of the wearable device, whether or not the sensor data includes an object of interest. The classifier configured to execute a first machine learning (ML) model. The method includes transmitting, via a wireless connection, the sensor data to a computing device in response to the object of interest being detected within the sensor data, where the sensor data is configured to be used by a second ML model on the computing device or a server computer for further sound/image classification.

公开(公告)号：US10809667B2

公开(公告)日：2020-10-20

申请号：US15960808

申请日：2018-04-24

Applicant: Google LLC

Inventor： Alex Olwal

IPC: G04B45/00 ,  G04B19/04

Abstract: Aspects of the disclosure provide a hybrid smartwatch that incorporates digital technology with an analog timepiece in a wristwatch form factor. A digital display layer of a non-emissive material is configured to present notices, data, content and other information. An analog display layer includes one or more hands of the timepiece, and overlies the digital display layer. The hands may be controlled by a processor through micro-stepper motors or other actuators. Physical motion of the hands provides expressivity, for instance via visual mechatronic effects. This may include buzzing, clapping, providing stylized visual features, hiding or minimizing information, and revealing information. The information presented on the digital display layer is presented concurrently with the hand movement, in a manner that complements the hand motion. This provides a rich, symbiotic dual-display layer arrangement that enhances the capabilities of the digital and analog display layers.

公开(公告)号：US20250054246A1

公开(公告)日：2025-02-13

申请号：US18707075

申请日：2022-10-14

Applicant: Google LLC

Inventor： Ruofei Du ,  Alex Olwal

IPC: G06T19/00 ,  G06F3/01

Abstract: A user can interact with sounds and speech in an environment using an augmented reality device. The augmented reality device can be configured to identify objects in the environment and display messages beside the object that are related to sounds produced by the object. For example, the messages may include sound statistics, transcripts of speech, and/or sound detection events. The disclosed approach enables a user to interact with these messages using a gaze and a gesture.