公开(公告)号：US20240355240A1

公开(公告)日：2024-10-24

申请号：US18642376

申请日：2024-04-22

Applicant: GOOGLE LLC

Inventor： Stuart James Myron Nicholson ,  Nils Johan Fransson ,  Brian Cousins

IPC: G09G3/00

CPC classification number: G09G3/001 ,  G09G2320/0233 ,  G09G2320/0242 ,  G09G2320/066 ,  G09G2360/144

Abstract: A system is disclosed for correcting a world-additive display of a head mounted device (HMD). The system includes a processor of a controller of the HMD connected to the world-additive display and a memory on which are stored machine-readable instructions that when executed by the processor, cause the processor to perform a process. The process includes receiving optical data from the world-additive display, receiving background data from an optical sensor connected to the controller, deriving scene estimate data from the background data, extracting display color estimate data from the optical data, generating a correction map based on the scene estimate data and the display color estimate data, and applying the correction map to the optical data. Corresponding methods and devices are also disclosed.

公开(公告)号：US12092823B2

公开(公告)日：2024-09-17

申请号：US17204308

申请日：2021-03-17

Applicant: GOOGLE LLC

Inventor： Daniel Adema ,  Stuart James Myron Nicholson ,  Ian Andrews

IPC: G02B27/01 ,  G02B17/08 ,  G02B26/10 ,  G02B27/00

CPC classification number: G02B27/0172 ,  G02B17/0816 ,  G02B26/101 ,  G02B27/0081 ,  G02B2027/0123 ,  G02B2027/0178

Abstract: A laser projection system utilizes a waveguide having a narrow incoupler for double-bounce mitigation and form factor reduction. An optical scanner includes an optical relay positioned in between two scan mirrors. The first scan mirror scans laser light into the optical relay in a first dimension, and the optical relay and converges the scanned laser light towards a second scan mirror. The second scan mirror scans laser light along a second dimension substantially perpendicular to a path over which the laser light is scanned across the second scan mirror, and the convergence introduced by the optical relay causes the laser light to be scanned as a line or arc path of an exit pupil plane that is coincident with the incoupler. The optical relay may include one or more lenses or may be a monolithic molded structure, which may be an Offner-style relay or a molded reflective relay.

公开(公告)号：US11647168B2

公开(公告)日：2023-05-09

申请号：US17495308

申请日：2021-10-06

Applicant: Google LLC

Inventor： Isaac James Deroche ,  Lai Pong Wong ,  Stuart James Myron Nicholson ,  Jerrold Richard Randell ,  Dustin Griesdorf

IPC: H04N9/31 ,  G02B27/01

CPC classification number: H04N9/312 ,  G02B27/0172 ,  H04N9/3185 ,  G02B2027/011 ,  G02B2027/0178

Abstract: There is provided a method including obtaining an initial spatial coordinate of a pixel of an image to be projected. The method may also include generating a pre-warped spatial coordinate associated with the initial spatial coordinate. The pre-warped spatial coordinate may be calculated as a sum of a value of a warp path function at the initial spatial coordinate and a delta. Moreover, the method may include outputting the pre-warped spatial coordinate.

公开(公告)号：US11561400B2

公开(公告)日：2023-01-24

申请号：US17067229

申请日：2020-10-09

Applicant: GOOGLE LLC

Inventor： Stuart James Myron Nicholson ,  Timothy Paul Bodiya

IPC: G02B27/01 ,  G02B6/00 ,  G02C11/00 ,  F21V8/00 ,  G02B26/08 ,  G02B26/10 ,  H01S5/00 ,  G02C5/22

Abstract: A wearable heads-up display includes a power source, laser sources, and a lightguide. A photodetector is positioned to detect an intensity of a test light emitted at a perimeter of the lightguide from an optical path within the lightguide. A laser safety circuit provides a control to reduce or shut off a supply of electrical power from the power source to the laser sources in response to an output signal from the photodetector indicating that the detected intensity is below a threshold.

公开(公告)号：US20220375374A1

公开(公告)日：2022-11-24

申请号：US17771760

申请日：2021-02-03

Applicant: GOOGLE LLC

Inventor： Stuart James Myron Nicholson ,  Nils Johan Fransson ,  Cecilia Ka Vai Mok ,  David James Mak-Fan

IPC: G09G3/00 ,  G02B27/01 ,  H04N5/232 ,  H04N7/18 ,  G06T11/00 ,  G06V20/10

Abstract: A controller bypasses processing raw image data captured by an image sensor at a wearable device and selects among modes of operation, to direct the raw image data to a light engine, to a transmitter, and/or to a computer vision engine. The light engine outputs display light based on the raw image data, the transmitter transmits the raw image data external to the wearable device, and the computer vision engine analyzes the raw image data to identify at least one feature represented in the raw image data and outputs computer vision data. The modes of operation selected by the controller reduce or eliminate intensive image signal processing operations performed by the wearable device on the raw image data.

公开(公告)号：US20220342221A1

公开(公告)日：2022-10-27

申请号：US17747444

申请日：2022-05-18

Applicant: GOOGLE LLC

Inventor： Timothy Paul Bodiya ,  Shreyas Potnis ,  Stuart James Myron Nicholson ,  Bergen Fletcher

IPC: G02B27/01 ,  H04N9/31 ,  G02B27/00 ,  G09G5/10

Abstract: There is provided a method of operating a wearable heads-up display (WHUD). The WHUD may include a light source, a spatial modulator, and a display optic. The method may include generating, by the light source, an output light to form an image viewable by a user of the WHUD. The method may also include receiving a position of a pupil of the user relative to an eyebox of the WHUD, and obtaining an image correction map based on the position of the pupil. Moreover, the method may include adjusting the output light to form an adjusted output light. The adjusted output light may be adjusted based on the image correction map to reduce at least one of an intensity non-uniformity and a color balance non-uniformity of the image. The method may also include directing, by the display optic, the adjusted output light into a field of view of the user.

公开(公告)号：US20220269084A1

公开(公告)日：2022-08-25

申请号：US17580749

申请日：2022-01-21

Applicant: GOOGLE LLC

Inventor： Daniel Adema ,  Stuart James Myron Nicholson

IPC: G02B27/01 ,  G02B27/14

Abstract: Systems, devices, and methods for accommodating multiple sets of laser light sources in an optical engine of a display system such as a laser projection system are described. Laser light beams may be combined via wavelength-, polarization-, and/or angular-separation-based techniques. First and second sets of laser light beams may be angularly separated such that different sets of partially overlapping pixels are projected by the system, thereby increasing the display pixel density and/or an expanding the field of view of the display. One or more laser die may be mounted to each submount of the optical engine. For embodiments with two laser dies on each submount, collimating lenses may introduce angular separation between laser light beams output by each pair of commonly mounted laser dies. A retroreflector prism may be disposed at a beam combiner to provide a compact extension of the optical path through the beam combiner.

公开(公告)号：US11756510B2

公开(公告)日：2023-09-12

申请号：US17344394

申请日：2021-06-10

Applicant: GOOGLE LLC

Inventor： Stuart James Myron Nicholson ,  Isaac James Deroche ,  Jerrold Richard Randell ,  Lai Pong Wong ,  Chris Brown

IPC: G09G5/393

CPC classification number: G09G5/393 ,  G09G2330/021 ,  G09G2340/145 ,  G09G2352/00 ,  G09G2360/128

Abstract: Systems, devices, and methods for generating, processing, assembling, and/or formatting data for display are described. Example display controllers are described in which image data is stored in a framebuffer, and a compositor selectively retrieves portions of the image data. At least one P-operator produces lines of intermediate P-operated data by performing at least one intra-line operation on the image data retrieved by the compositor, such as repeating or reordering pixels of the image data. A Q-operator produces a stream of pixel data by performing inter-line operations on the intermediate P-operated data, such as interpolating between lines of the P-operated data. A display is driven according to the stream of pixel data.

公开(公告)号：US20230224476A1

公开(公告)日：2023-07-13

申请号：US17996281

申请日：2021-04-09

Applicant: Google LLC

Inventor： Jerrold Richard Randell ,  Stuart James Myron Nicholson

IPC: H04N19/159 ,  H04N19/172 ,  G06T5/40 ,  G06V10/74 ,  G06V10/764

CPC classification number: H04N19/159 ,  H04N19/172 ,  G06T5/40 ,  G06V10/761 ,  G06V10/764 ,  G06T2207/10024

Abstract: A method including generating at least one of a key frame and an inter-predicted frame based on a received video stream including at least one video frame, the inter-predicted frame being generated using information from the key frame, determining whether the key frame is stored at a receiving device, selecting video data as one of the key frame or a key frame identifier representing the key frame based on whether the key frame is stored at the receiving device, and communicating at least one of the video data and the inter-predicted frame.

公开(公告)号：US11487125B2

公开(公告)日：2022-11-01

申请号：US17229523

申请日：2021-04-13

Applicant: GOOGLE LLC

Inventor： Stuart James Myron Nicholson ,  Andrew S. Logan

IPC: G02B27/01 ,  G02B27/18 ,  G06F1/16

Abstract: Systems, devices, and methods provide for the prevention of laser light escaping a foldable wearable heads-up display (WHUD) when the WHUD is folded. For a WHUD that adopts the form factor of conventional eyeglasses or sunglasses, enabling the WHUD to fold “like glasses” can cause an interruption in the optical path of display light and enable display light to escape into the external environment. This can be hazardous when laser light is used to provide display light. Systems, devices, and methods that automatically detect, sense, and/or respond to the fold configuration state of a WHUD are described. When the WHUD is unfolded a laser-based display operates normally. When the WHUD is folded the laser-based display is disabled to prevent laser light from projecting out of the WHUD through the folded region. Proximity sensors and laser light containing mechanisms also may be employed as alternative or supplementary safety elements.