公开(公告)号：US20240114226A1

公开(公告)日：2024-04-04

申请号：US17564889

申请日：2021-12-29

Applicant: Meta Platforms Technologies, LLC

Inventor： Andrew Samuel Berkovich ,  Warren Andrew Hunt ,  Daniel Morgan ,  Shlomo Alkalay ,  Jack Thomas Lavier

IPC: H04N5/225 ,  G06F3/01 ,  G06V10/25 ,  G09G3/32 ,  H01L23/00 ,  H01L27/146 ,  H01L27/15 ,  H04N5/232

CPC classification number: H04N5/2257 ,  G06F3/013 ,  G06V10/25 ,  G09G3/32 ,  H01L24/08 ,  H01L24/16 ,  H01L27/14618 ,  H01L27/14634 ,  H01L27/14636 ,  H01L27/156 ,  H04N5/2252 ,  H04N5/232 ,  G09G2360/18 ,  H01L2224/08145 ,  H01L2224/16145

Abstract: In one example, an apparatus for integrating sensing and display system includes a first semiconductor layer that includes an image sensor; a second semiconductor layer that includes a display; a third semiconductor layer that includes compute circuits configured to support an image sensing operation by the image sensor and a display operation by the display; and a semiconductor package that encloses the first, second, and third semiconductor layers, the semiconductor package further including a first opening to expose the image sensor and a second opening to expose the display. The first, second, and third semiconductor layers form a first stack structure along a first axis. The third semiconductor layer is sandwiched between the first semiconductor layer and the second semiconductor layer in the first stack structure.

公开(公告)号：US20230245381A1

公开(公告)日：2023-08-03

申请号：US18296326

申请日：2023-04-05

Applicant: Meta Platforms Technologies, LLC

Inventor： Larry Seiler ,  Alexander Nankervis ,  Warren Andrew Hunt

IPC: G06T15/40 ,  G06T15/20 ,  G06T15/04 ,  G06T15/06 ,  G06T3/00 ,  G06T19/00 ,  G06T15/02 ,  G06T15/10

CPC classification number: G06T15/40 ,  G06T15/20 ,  G06T15/04 ,  G06T15/06 ,  G06T3/0068 ,  G06T19/006 ,  G06T15/02 ,  G06T15/10

Abstract: In one embodiment, a computing system may access surfaces and texel data of an artificial reality scene. The surfaces may be generated based on a first viewing position of a viewer. The system may determine tiles on a display to test for a visibility of the surfaces from a second viewing position. The tiles may include first tiles that need more computational resources and second tiles that need less computational resources. The system may determine a tile order which interleaves the first and second tiles. The system may generate rays based on the tile order. The system may determine the visibility of the surfaces from the second viewing position based on the ray-surface intersections. The system may generate color values of a subframe based on the surface visibility and the texel data. The system may provide the color values to the display.

公开(公告)号：US11557095B2

公开(公告)日：2023-01-17

申请号：US17375965

申请日：2021-07-14

Applicant: Meta Platforms Technologies, LLC

Inventor： Steve John Clohset ,  Warren Andrew Hunt

IPC: G06T19/00 ,  G06T17/20

Abstract: In one embodiment, one or more computing devices access an image comprising at least a portion of a hand of a user of a head-mounted display and generate a planar representation of the hand and a height map associated with the planar representation. A first portion of the planar representation that is closer than a first portion of a virtual object to a viewpoint and a second portion of the planar representation that is farther than a second portion of the virtual object from the viewpoint is determined based on the height map and the virtual object. A display image is rendered from the viewpoint for display, the display image comprising a first set of pixels corresponding to the first portion of the planar representation and a second set of pixels corresponding to the second portion of the virtual object.

公开(公告)号：US11721307B1

公开(公告)日：2023-08-08

申请号：US16669234

申请日：2019-10-30

Applicant: Meta Platforms Technologies, LLC

Inventor： Larry Seiler ,  Warren Andrew Hunt

IPC: G09G5/38 ,  G09G5/373 ,  G09G3/02

CPC classification number: G09G5/38 ,  G09G3/025 ,  G09G5/373 ,  G09G2310/06 ,  G09G2310/08 ,  G09G2320/0252 ,  G09G2320/0261 ,  G09G2354/00

Abstract: In one embodiment, a method includes accessing display timing information associated with a display, and determining, based on the display timing information, one or more rendering requirements for a plurality of portions of the display. For each portion of the display, the method may determine a current viewpoint of a user, render, based on the current viewpoint of the user, pixel values for that portion of the display in accordance with the associated rendering requirement, and send the rendered pixel values to be output by the display. The display timing information may include a waveform associated with an oscillation motion of a scanning assembly of the display, and/or a requested size for each portion of the plurality of portions of the display. The rendering requirements may include a timing interval for rendering and sending the pixel values for each of the plurality of portions of the display.

公开(公告)号：US20240346772A1

公开(公告)日：2024-10-17

申请号：US18614574

申请日：2024-03-22

Applicant: Meta Platforms Technologies, LLC

Inventor： Steve John Clohset ,  Warren Andrew Hunt

IPC: G06T19/00 ,  G06T17/20

CPC classification number: G06T19/003 ,  G06T17/20

Abstract: Systems and methods for occluding virtual objects in an augmented reality environment are described. A method includes generating a distance map associated with a physical object, determining a location of a virtual object in an artificial-reality environment, determining, based at least in part upon the distance map and the location of the virtual object, a first portion of the physical object that is closer than a first portion of the virtual object from the viewpoint of the user, determining a second portion of the virtual object that is not obscured by the physical object from the viewpoint of the user, and rendering a display image. The display image comprises a first set of pixels corresponding to the first portion of the physical object in a first state, and the display image comprises a second set of pixels corresponding to the second portion of the virtual object in a second state.

公开(公告)号：US12099192B1

公开(公告)日：2024-09-24

申请号：US17684325

申请日：2022-03-01

Applicant: META PLATFORMS TECHNOLOGIES, LLC

Inventor： Andrew John Ouderkirk ,  James Hillis ,  Marina Zannoli ,  Jasmine Soria Sears ,  James Ronald Bonar ,  Gareth John Valentine ,  Barry David Silverstein ,  Warren Andrew Hunt

IPC: G02B27/14 ,  G02B27/01 ,  G02B27/10 ,  G02F1/03 ,  G02F1/1335 ,  G03H1/00 ,  G09G5/00 ,  H01L27/15 ,  G09G5/02

CPC classification number: G02B27/0172 ,  G02B27/0101 ,  G02B27/017 ,  G02B27/0179 ,  H01L27/156 ,  G02B2027/0112 ,  G02B2027/0118 ,  G02B2027/0123 ,  G02B2027/0178 ,  G02B2027/0187 ,  G09G5/026 ,  G09G2320/0686 ,  G09G2330/021 ,  G09G2354/00

Abstract: A display device includes a display panel having a first emission region and one or more second emission regions disposed adjacent to the first emission region. The display device includes a plurality of light emitters, arranged in the first emission region, corresponding to a first color gamut and a plurality of light emitters, arranged in the one or more second emission regions, corresponding to a second color gamut that is distinct from the first color gamut. A method for making a display device with a plurality of light emitters corresponding to a first color gamut in a first emission region and a plurality of light emitters corresponding to a second color gamut in a second emission region is also described.

公开(公告)号：US11954805B2

公开(公告)日：2024-04-09

申请号：US18148133

申请日：2022-12-29

Applicant: Meta Platforms Technologies, LLC

Inventor： Steve John Clohset ,  Warren Andrew Hunt

IPC: G06T19/00 ,  G06T17/20

CPC classification number: G06T19/003 ,  G06T17/20

Abstract: In one embodiment, a method includes by one or more computing devices, accessing an image including a hand of a user of a head-mounted display at a first time. The method includes generating, from at least the image, a virtual object representation of the hand, defined in a virtual environment that includes at least one other virtual object. The method includes rendering a first image of the virtual environment comprising a first portion of the hand of the user at a first frame rate, and determining a second viewpoint of the user at a second time. The method includes rendering a second image of the virtual environment comprising a second portion of the hand of the user at a second frame rate. The method includes providing, to a set of light emitters of the head-mounted display, instructions to display the second image.

公开(公告)号：US11743435B2

公开(公告)日：2023-08-29

申请号：US17349769

申请日：2021-06-16

Applicant: Meta Platforms Technologies, LLC

Inventor： Larry Seiler ,  William Thomas Blank ,  Warren Andrew Hunt ,  Michael Yee

IPC: H04N9/31 ,  G09G3/32 ,  G02B27/01

CPC classification number: H04N9/3182 ,  G02B27/0172 ,  G09G3/32 ,  H04N9/3185 ,  G02B2027/0178

Abstract: In an embodiment, a headset display device includes a central processor and multiple projector integrated circuits for eyes of a wearer of the headset display device. Each eye of the wear is associated with at least three projector integrated circuits. Each of the three projector integrated circuits is communicatively coupled to the central processor. Each projector integrated circuit includes a first integrated circuit including a light emitter array having monochrome light emitters of a single color, and a second integrated circuit coupled to the first integrated circuit. The second integrated circuit includes a graphics processor configured to generate transformed image data. The graphics processor is configured to provide the transformed image data to the first integrated circuit. The first integrated circuit is configured to output the transformed image data using the light emitter array.