公开(公告)号：US20240283554A1

公开(公告)日：2024-08-22

申请号：US18644932

申请日：2024-04-24

Applicant: Samuel Ahn ,  Dmitry Ryuma ,  Richard Zhuang

Inventor： Samuel Ahn ,  Dmitry Ryuma ,  Richard Zhuang

IPC: H04J3/06 ,  G02B27/01 ,  G06F1/10 ,  G06F1/12 ,  G06F13/24 ,  G06F13/40

CPC classification number: H04J3/065 ,  G02B27/017 ,  G06F1/10 ,  G06F1/12 ,  G06F13/24 ,  G06F13/4068 ,  G02B2027/0178 ,  G06F2213/0026 ,  G06F2213/0038

Abstract: An electronic eyewear device includes first and second systems-on-chip (SoCs) having independent time bases. The first and second SoCs are connected by a shared general purpose input/output (GPIO) connection and an inter-SoC interface. The first and second SoCs are synchronized to each other by the first SoC asserting the shared GPIO connection to the second SoC where assertion of the message to the shared GPIO connection triggers an interrupt request (IRQ) at the second SoC. The first SoC records a first timestamp for assertion of the message to the GPIO connection, and the second SoC records a second timestamp of receipt of the IRQ. The first SoC sends a message including the first timestamp to the second SoC over the inter-SoC interface. The second SoC calculates a clock offset between the first and second SoCs as a difference between the first and second timestamps.

公开(公告)号：US20210203909A1

公开(公告)日：2021-07-01

申请号：US17180249

申请日：2021-02-19

Applicant: Dmitry Ryuma ,  David Ben Ezra ,  Dunxu Hu ,  Patrick Timothy McSweeney Simons

Inventor： Dmitry Ryuma ,  David Ben Ezra ,  Dunxu Hu ,  Patrick Timothy McSweeney Simons

IPC: H04N13/246 ,  G02B27/01 ,  H04N13/239 ,  G06T7/80 ,  H04N13/344

Abstract: Camera compensation methods and systems that compensate for misalignment of sensors/camera in stereoscopic camera systems. The compensation includes identifying a pitch angle offset between a first camera and a second camera, determining misalignment of the first and second cameras from the identified pitch angle offset, determining a relative compensation delay responsive to the determined misalignment, introducing the relative compensation delay to image streams produced by the cameras, and producing a stereoscopic image on a display from the first and second image streams with the introduced delay.

公开(公告)号：US20240275937A1

公开(公告)日：2024-08-15

申请号：US18643331

申请日：2024-04-23

Applicant: Jason Heger ,  Gerald Nilles ,  Dmitry Ryuma ,  Patrick Timothy McSweeney Simons ,  Daniel Wagner

Inventor： Jason Heger ,  Gerald Nilles ,  Dmitry Ryuma ,  Patrick Timothy McSweeney Simons ,  Daniel Wagner

IPC: H04N13/344 ,  G06F1/16 ,  G06F1/20 ,  H04N13/239 ,  H04N13/296 ,  H04N13/383 ,  H04N13/398 ,  H04N23/90

CPC classification number: H04N13/344 ,  G06F1/163 ,  G06F1/206 ,  H04N13/239 ,  H04N13/296 ,  H04N13/383 ,  H04N13/398 ,  H04N23/90 ,  H04N2213/001

Abstract: Eyewear devices that include two SoCs that share processing workload. Instead of using a single SoC located either on the left or right side of the eyewear devices, the two SoCs have different assigned responsibilities to operate different devices and perform different processes to balance workload. In one example, the eyewear device utilizes a first SoC to operate a first color camera, a second color camera, a first display, and a second display. The first SoC and a second SoC are configured to selectively operate a first and second computer vision (CV) camera algorithms. The first SoC is configured to perform visual odometry (VIO), track hand gestures of the user, and provide depth from stereo images. This configuration provides organized logistics to efficiently operate various features, and balanced power consumption.

公开(公告)号：US20230393609A1

公开(公告)日：2023-12-07

申请号：US18236732

申请日：2023-08-22

Applicant: Samuel Ahn ,  Jason Heger ,  Dmitry Ryuma

Inventor： Samuel Ahn ,  Jason Heger ,  Dmitry Ryuma

IPC: G06F1/12 ,  G06F1/04 ,  G06F13/42

CPC classification number: G06F1/12 ,  G06F1/04 ,  G06F13/4221 ,  G06F2213/0026

Abstract: An electronic eyewear device includes first and second systems on a chip (SoCs) having independent time bases that are synchronized by generating a common clock signal from a clock generator of the first SoC and simultaneously applying the common clock signal to a first counter of the first SoC and a second counter of the second SoC whereby the first counter and the second counter count clock edges of the common clock. The clock counts are shared through an interface between the first SoC and the second SoC and compared to each other. When the clock counts are different, a clock count of the first counter or the second counter is adjusted to cause the clock counts to match each other. The adjusted clock count is synchronized to the respective clocks of the first and second SoCs, thus synchronizing the first and second SoCs to each other.

公开(公告)号：US10965931B1

公开(公告)日：2021-03-30

申请号：US16706162

申请日：2019-12-06

Applicant: Dmitry Ryuma ,  David Ben Ezra ,  Dunxu Hu ,  Patrick Timothy McSweeney Simons

Inventor： Dmitry Ryuma ,  David Ben Ezra ,  Dunxu Hu ,  Patrick Timothy McSweeney Simons

IPC: H04N13/239 ,  H04N13/344 ,  H04N13/246 ,  G06T7/80 ,  G02B27/01

Abstract: Camera compensation methods and systems that compensate for misalignment of sensors/camera in stereoscopic camera systems. The compensation includes identifying a pitch angle offset between a first camera and a second camera, determining misalignment of the first and second cameras from the identified pitch angle offset, determining a relative compensation delay responsive to the determined misalignment, introducing the relative compensation delay to image streams produced by the cameras, and producing a stereoscopic image on a display from the first and second image streams with the introduced delay.

公开(公告)号：US10757342B1

公开(公告)日：2020-08-25

申请号：US15962314

申请日：2018-04-25

Applicant: Bo Ding ,  Dmitry Ryuma

Inventor： Bo Ding ,  Dmitry Ryuma

IPC: H04N5/235 ,  G03B17/48 ,  G03B7/093 ,  G02B27/01

Abstract: An auto exposure method for an image capture device includes the steps of gathering ambient light data using an ambient light sensor of the image capture device, selecting a frame rate corresponding to the gathered ambient light data, and determining an optimal image capture frame rate for the image capture device. The auto exposure method determines the optimal image capture frame rate by executing an auto exposure algorithm with a processor using the selected frame rate as an initialization parameter for the auto exposure algorithm.

公开(公告)号：US12021611B2

公开(公告)日：2024-06-25

申请号：US17496261

申请日：2021-10-07

Applicant: Samuel Ahn ,  Dmitry Ryuma ,  Richard Zhuang

Inventor： Samuel Ahn ,  Dmitry Ryuma ,  Richard Zhuang

IPC: H04W56/00 ,  G02B27/01 ,  G06F1/10 ,  G06F1/12 ,  G06F13/24 ,  G06F13/40 ,  H04J3/06

CPC classification number: H04J3/065 ,  G02B27/017 ,  G06F1/10 ,  G06F1/12 ,  G06F13/24 ,  G06F13/4068 ,  G02B2027/0178 ,  G06F2213/0026 ,  G06F2213/0038

Abstract: An electronic eyewear device includes first and second systems-on-chip (SoCs) having independent time bases. The first and second SoCs are connected by a shared general purpose input/output (GPIO) connection and an inter-SoC interface. The first and second SoCs are synchronized to each other by the first SoC asserting the shared GPIO connection to the second SoC where assertion of the message to the shared GPIO connection triggers an interrupt request (IRQ) at the second SoC. The first SoC records a first timestamp for assertion of the message to the GPIO connection, and the second SoC records a second timestamp of receipt of the IRQ. The first SoC sends a message including the first timestamp to the second SoC over the inter-SoC interface. The second SoC calculates a clock offset between the first and second SoCs as a difference between the first and second timestamps.

公开(公告)号：US11997249B2

公开(公告)日：2024-05-28

申请号：US17501654

申请日：2021-10-14

Applicant: Jason Heger ,  Gerald Nilles ,  Dmitry Ryuma ,  Patrick Timothy Mcsweeney Simons ,  Daniel Wagner

Inventor： Jason Heger ,  Gerald Nilles ,  Dmitry Ryuma ,  Patrick Timothy Mcsweeney Simons ,  Daniel Wagner

IPC: H04N13/344 ,  G06F1/16 ,  G06F1/20 ,  H04N13/239 ,  H04N13/296 ,  H04N13/383 ,  H04N13/398 ,  H04N23/90

CPC classification number: H04N13/344 ,  G06F1/163 ,  G06F1/206 ,  H04N13/239 ,  H04N13/296 ,  H04N13/383 ,  H04N13/398 ,  H04N23/90 ,  H04N2213/001

Abstract: Eyewear devices that include two SoCs that share processing workload. Instead of using a single SoC located either on the left or right side of the eyewear devices, the two SoCs have different assigned responsibilities to operate different devices and perform different processes to balance workload. In one example, the eyewear device utilizes a first SoC to operate a first color camera, a second color camera, a first display, and a second display. The first SoC and a second SoC are configured to selectively operate a first and second computer vision (CV) camera algorithms. The first SoC is configured to perform visual odometry (VIO), track hand gestures of the user, and provide depth from stereo images. This configuration provides organized logistics to efficiently operate various features, and balanced power consumption.

公开(公告)号：US20230117690A1

公开(公告)日：2023-04-20

申请号：US17501654

申请日：2021-10-14

Applicant: Jason Heger ,  Gerald Nilles ,  Dmitry Ryuma ,  Patrick Timothy McSweeney Simons ,  Daniel Wagner

Inventor： Jason Heger ,  Gerald Nilles ,  Dmitry Ryuma ,  Patrick Timothy McSweeney Simons ,  Daniel Wagner

IPC: H04N13/344 ,  H04N13/239 ,  H04N13/398 ,  H04N13/296 ,  H04N13/383 ,  H04N5/247 ,  G06F1/16 ,  G06F1/20

Abstract: Eyewear devices that include two SoCs that share processing workload. Instead of using a single SoC located either on the left or right side of the eyewear devices, the two SoCs have different assigned responsibilities to operate different devices and perform different processes to balance workload. In one example, the eyewear device utilizes a first SoC to operate a first color camera, a second color camera, a first display, and a second display. The first SoC and a second SoC are configured to selectively operate a first and second computer vision (CV) camera algorithms. The first SoC is configured to perform visual odometry (VIO), track hand gestures of the user, and provide depth from stereo images. This configuration provides organized logistics to efficiently operate various features, and balanced power consumption.

公开(公告)号：US20230109916A1

公开(公告)日：2023-04-13

申请号：US17496189

申请日：2021-10-07

Applicant: Jason Heger ,  Gerald Nilles ,  Dmitry Ryuma ,  Patrick Timothy McSweeney Simons ,  Daniel Wagner

Inventor： Jason Heger ,  Gerald Nilles ,  Dmitry Ryuma ,  Patrick Timothy McSweeney Simons ,  Daniel Wagner

IPC: H04N13/344 ,  H04N13/239 ,  H04N5/247 ,  H04N9/04 ,  G02B27/01

Abstract: Eyewear devices that include two SoCs that share processing workload. Instead of using a single SoC located either on the left or right side of the eyewear devices, the two SoCs have different assigned responsibilities to operate different devices and perform different processes to balance workload. In one example, the eyewear device utilizes a first SoC to operate the OS, a first color camera, a second color camera, a first display, and a second display. A second SoC is configured to run computer vision (CV) algorithms, visual odometry (VIO), tracking hand gestures of the user, and providing depth from stereo. This configuration provides organized logistics to efficiently operate various features, and balanced power consumption.