公开(公告)号：US11320667B2

公开(公告)日：2022-05-03

申请号：US16585603

申请日：2019-09-27

Applicant: Matthew Hanover ,  Richard Zhuang

Inventor： Matthew Hanover ,  Richard Zhuang

IPC: G02B27/64 ,  G02B27/01 ,  H04N1/00

Abstract: Systems, devices, media, and methods are described for capturing a series of video clips, together with position, orientation, and motion data collected from an inertial measurement unit during filming. The methods in some examples include calculating camera orientations based on the data collected, computing a stabilized output path based on the camera orientations, and then combining the video segments in accordance with said stabilized output path to produce a video composition that is stable, short, and easy to share. The video clips are filmed in accordance with a set of conditions called a capture profile. In some implementations, the capture profile conditions are reactive, adjusting in real time, during filming, in response to sensor data gathered in real time from a sensor array.

公开(公告)号：US20210096388A1

公开(公告)日：2021-04-01

申请号：US16585603

申请日：2019-09-27

Applicant: Matthew Hanover ,  Richard Zhuang

Inventor： Matthew Hanover ,  Richard Zhuang

IPC: G02B27/64 ,  G02B27/01 ,  H04N1/00

Abstract: Systems, devices, media, and methods are described for capturing a series of video clips, together with position, orientation, and motion data collected from an inertial measurement unit during filming. The methods in some examples include calculating camera orientations based on the data collected, computing a stabilized output path based on the camera orientations, and then combining the video segments in accordance with said stabilized output path to produce a video composition that is stable, short, and easy to share. The video clips are filmed in accordance with a set of conditions called a capture profile. In some implementations, the capture profile conditions are reactive, adjusting in real time, during filming, in response to sensor data gathered in real time from a sensor array.

公开(公告)号：US20220252894A1

公开(公告)日：2022-08-11

申请号：US17731823

申请日：2022-04-28

Applicant: Matthew Hanover ,  Richard Zhuang

Inventor： Matthew Hanover ,  Richard Zhuang

IPC: G02B27/64 ,  H04N1/00 ,  G02B27/01

Abstract: Systems, devices, media, and methods are described for capturing a series of video clips, together with position, orientation, and motion data collected from an inertial measurement unit during filming. The methods in some examples include calculating camera orientations based on the data collected, computing a stabilized output path based on the camera orientations, and then combining the video segments in accordance with said stabilized output path to produce a video composition that is stable, short, and easy to share. The video clips are filmed in accordance with a set of conditions called a capture profile. In some implementations, the capture profile conditions are reactive, adjusting in real time, during filming, in response to sensor data gathered in real time from a sensor array.

公开(公告)号：US20230098451A1

公开(公告)日：2023-03-30

申请号：US17490915

申请日：2021-09-30

Applicant: Edmund Graves Brown ,  Benjamin Lucas ,  Jonathan M. Rodriguez, II ,  Richard Zhuang

Inventor： Edmund Graves Brown ,  Benjamin Lucas ,  Jonathan M. Rodriguez, II ,  Richard Zhuang

IPC: B62J50/22 ,  G06T7/70 ,  G06T19/00 ,  B62J45/20

Abstract: A method of controlling a personal mobility system includes displaying a virtual object on an augmented reality wearable device, the virtual object being located in a position in the field of view of the augmented reality device corresponding to a position in the real world. Proximity of the personal mobility system or a user of the personal mobility system with the position in the real world is detected. In response to the detection of proximity, a performance characteristic of the personal mobility system is modified.

公开(公告)号：US20240283554A1

公开(公告)日：2024-08-22

申请号：US18644932

申请日：2024-04-24

Applicant: Samuel Ahn ,  Dmitry Ryuma ,  Richard Zhuang

Inventor： Samuel Ahn ,  Dmitry Ryuma ,  Richard Zhuang

IPC: H04J3/06 ,  G02B27/01 ,  G06F1/10 ,  G06F1/12 ,  G06F13/24 ,  G06F13/40

CPC classification number: H04J3/065 ,  G02B27/017 ,  G06F1/10 ,  G06F1/12 ,  G06F13/24 ,  G06F13/4068 ,  G02B2027/0178 ,  G06F2213/0026 ,  G06F2213/0038

Abstract: An electronic eyewear device includes first and second systems-on-chip (SoCs) having independent time bases. The first and second SoCs are connected by a shared general purpose input/output (GPIO) connection and an inter-SoC interface. The first and second SoCs are synchronized to each other by the first SoC asserting the shared GPIO connection to the second SoC where assertion of the message to the shared GPIO connection triggers an interrupt request (IRQ) at the second SoC. The first SoC records a first timestamp for assertion of the message to the GPIO connection, and the second SoC records a second timestamp of receipt of the IRQ. The first SoC sends a message including the first timestamp to the second SoC over the inter-SoC interface. The second SoC calculates a clock offset between the first and second SoCs as a difference between the first and second timestamps.

公开(公告)号：US20250110563A1

公开(公告)日：2025-04-03

申请号：US18504009

申请日：2023-11-07

Applicant: Hunter Araujo ,  Sambu Patach Arrojula ,  Ilteris Kaan Canberk ,  Luke Cartwright ,  Samuel Geoffrey Finding ,  Matthew Hallberg ,  Dmytro Kucher ,  Jeremy Littel ,  Charles Miller ,  William Miles Miller ,  Richard Zhuang

Inventor： Hunter Araujo ,  Sambu Patach Arrojula ,  Ilteris Kaan Canberk ,  Luke Cartwright ,  Samuel Geoffrey Finding ,  Matthew Hallberg ,  Dmytro Kucher ,  Jeremy Littel ,  Charles Miller ,  William Miles Miller ,  Richard Zhuang

IPC: G06F3/01 ,  G06F3/04815 ,  G06F3/04845 ,  G06F3/14

Abstract: The subject technology receives, by one or more hardware processors implementing a local wireless network, a request from a client device to mirror media content displayed on a screen of the client device on a wearable device. In response to the request, the subject technology causes a display of the media content in a mirroring lens of the wearable device. While the media content is being displayed in the mirroring lens of the wearable device, the subject technology tracks hand gestures of a user wearing the wearable device and viewing the media content displayed in the mirroring lens of the wearable device. The subject technology processes navigational or manipulation data based on the tracked hand gestures and sends a navigation or manipulation instruction to the client device or a mirroring lens processor of the wearable device based on the tracked hand gestures.

公开(公告)号：US12021611B2

公开(公告)日：2024-06-25

申请号：US17496261

申请日：2021-10-07

Applicant: Samuel Ahn ,  Dmitry Ryuma ,  Richard Zhuang

Inventor： Samuel Ahn ,  Dmitry Ryuma ,  Richard Zhuang

IPC: H04W56/00 ,  G02B27/01 ,  G06F1/10 ,  G06F1/12 ,  G06F13/24 ,  G06F13/40 ,  H04J3/06

CPC classification number: H04J3/065 ,  G02B27/017 ,  G06F1/10 ,  G06F1/12 ,  G06F13/24 ,  G06F13/4068 ,  G02B2027/0178 ,  G06F2213/0026 ,  G06F2213/0038

Abstract: An electronic eyewear device includes first and second systems-on-chip (SoCs) having independent time bases. The first and second SoCs are connected by a shared general purpose input/output (GPIO) connection and an inter-SoC interface. The first and second SoCs are synchronized to each other by the first SoC asserting the shared GPIO connection to the second SoC where assertion of the message to the shared GPIO connection triggers an interrupt request (IRQ) at the second SoC. The first SoC records a first timestamp for assertion of the message to the GPIO connection, and the second SoC records a second timestamp of receipt of the IRQ. The first SoC sends a message including the first timestamp to the second SoC over the inter-SoC interface. The second SoC calculates a clock offset between the first and second SoCs as a difference between the first and second timestamps.

公开(公告)号：US20230214639A1

公开(公告)日：2023-07-06

申请号：US17566877

申请日：2021-12-31

Applicant: Sumant Milind Hanumante ,  Qing Jin ,  Sergei Korolev ,  Denys Makoviichuk ,  Jian Ren ,  Dhritiman Sagar ,  Patrick Timothy McSweeney Simons ,  Sergey Tulyakov ,  Yang Wen ,  Richard Zhuang

Inventor： Sumant Milind Hanumante ,  Qing Jin ,  Sergei Korolev ,  Denys Makoviichuk ,  Jian Ren ,  Dhritiman Sagar ,  Patrick Timothy McSweeney Simons ,  Sergey Tulyakov ,  Yang Wen ,  Richard Zhuang

IPC: G06N3/08

CPC classification number: G06N3/08

Abstract: Techniques for training a neural network having a plurality of computational layers with associated weights and activations for computational layers in fixed-point formats include determining an optimal fractional length for weights and activations for the computational layers; training a learned clipping-level with fixed-point quantization using a PACT process for the computational layers; and quantizing on effective weights that fuses a weight of a convolution layer with a weight and running variance from a batch normalization layer. A fractional length for weights of the computational layers is determined from current values of weights using the determined optimal fractional length for the weights of the computational layers. A fixed-point activation between adjacent computational layers is related using PACT quantization of the clipping-level and an activation fractional length from a node in a following computational layer. The resulting fixed-point weights and activation values are stored as a compressed representation of the neural network.

公开(公告)号：US11990989B2

公开(公告)日：2024-05-21

申请号：US17496261

申请日：2021-10-07

Applicant: Samuel Ahn ,  Dmitry Ryuma ,  Richard Zhuang

Inventor： Samuel Ahn ,  Dmitry Ryuma ,  Richard Zhuang

IPC: H04W56/00 ,  G02B27/01 ,  G06F1/10 ,  G06F1/12 ,  G06F13/24 ,  G06F13/40 ,  H04J3/06

CPC classification number: H04J3/065 ,  G02B27/017 ,  G06F1/10 ,  G06F1/12 ,  G06F13/24 ,  G06F13/4068 ,  G02B2027/0178 ,  G06F2213/0026 ,  G06F2213/0038

Abstract: An electronic eyewear device includes first and second systems-on-chip (SoCs) having independent time bases. The first and second SoCs are connected by a shared general purpose input/output (GPIO) connection and an inter-SoC interface. The first and second SoCs are synchronized to each other by the first SoC asserting the shared GPIO connection to the second SoC where assertion of the message to the shared GPIO connection triggers an interrupt request (IRQ) at the second SoC. The first SoC records a first timestamp for assertion of the message to the GPIO connection, and the second SoC records a second timestamp of receipt of the IRQ. The first SoC sends a message including the first timestamp to the second SoC over the inter-SoC interface. The second SoC calculates a clock offset between the first and second SoCs as a difference between the first and second timestamps.

公开(公告)号：US20230113076A1

公开(公告)日：2023-04-13

申请号：US17496261

申请日：2021-10-07

Applicant: Samuel Ahn ,  Dmitry Ryuma ,  Richard Zhuang

Inventor： Samuel Ahn ,  Dmitry Ryuma ,  Richard Zhuang

IPC: H04J3/06 ,  G06F13/40 ,  G06F13/24 ,  G06F1/10 ,  G06F1/12 ,  G02B27/01

Abstract: An electronic eyewear device includes first and second systems-on-chip (SoCs) having independent time bases. The first and second SoCs are connected by a shared general purpose input/output (GPIO) connection and an inter-SoC interface. The first and second SoCs are synchronized to each other by the first SoC asserting the shared GPIO connection to the second SoC where assertion of the message to the shared GPIO connection triggers an interrupt request (IRQ) at the second SoC. The first SoC records a first timestamp for assertion of the message to the GPIO connection, and the second SoC records a second timestamp of receipt of the IRQ. The first SoC sends a message including the first timestamp to the second SoC over the inter-SoC interface. The second SoC calculates a clock offset between the first and second SoCs as a difference between the first and second timestamps.