-
公开(公告)号:US11663689B2
公开(公告)日:2023-05-30
申请号:US17526681
申请日:2021-11-15
Applicant: Meta Platforms Technologies, LLC
Inventor: Behnam Bastani , Tianxin Ning , Haomiao Jiang
CPC classification number: G06T3/0012 , G06F3/013 , G06T1/60 , G06T11/00 , G06T19/006
Abstract: A method for providing imagery to a user on a display includes receiving eye tracking data. The method also includes determining a current gaze location and a relative distance between the current gaze location and an edge of the display using the eye tracking data. The method also includes defining a first tile centered at the current gaze location and multiple tiles that surround the first tile using the current gaze location and the relative distance between the current gaze location and the edge of the display. The method includes providing a foveated rendered image using the first tile and the multiple tiles.
-
公开(公告)号:US12069230B2
公开(公告)日:2024-08-20
申请号:US17132228
申请日:2020-12-23
Applicant: Meta Platforms Technologies, LLC
Inventor: Behnam Bastani , Steven Paul Lansel , Todd Douglas Keeler
IPC: H04N13/332 , G06T7/269
CPC classification number: H04N13/332 , G06T7/269 , G06T2207/10016
Abstract: In one embodiment, a method includes accessing a first image corresponding to a first frame of a video stream, where the first image has complete pixel information, rendering a provisional image corresponding to a second frame of the video stream subsequent to the first frame, where the provisional image has a first area with complete pixel information and a second area with incomplete pixel information, generating a predicted image corresponding to the second frame by re-projecting at least an area of the first image according to one or more warping parameters, and generating a second image corresponding to the second frame by compositing the rendered provisional image and the predicted image.
-
公开(公告)号:US11838513B2
公开(公告)日:2023-12-05
申请号:US17576250
申请日:2022-01-14
Applicant: META PLATFORMS TECHNOLOGIES, LLC
Inventor: Brian Funt , Behnam Bastani , Curtis Buckoll
IPC: H04N19/132 , H04N19/172 , H04N19/42 , H04N19/136 , G06T9/00 , H04N19/182 , H04N19/85
CPC classification number: H04N19/132 , G06T9/00 , H04N19/136 , H04N19/172 , H04N19/182 , H04N19/42 , H04N19/85
Abstract: In one embodiment, the disclosure provides a computer-implemented method for Progressive Subsampled Transmission of image data. In one embodiment, a source computer may: generate a first down-sampled frame by sampling an input image according to a first sampling pattern; generate a first encoded down-sampled frame; transmit the first encoded down-sampled frame to a recipient device to cause the recipient device to display/use a first output frame generated by decoding and up-sampling the first encoded down-sampled frame; generate a second down-sampled frame by sampling the input image according to a second sampling pattern; generate a second encoded down-sampled frame; and transmit the second encoded down-sampled frame to the recipient device to cause the recipient device to display/use a second output frame generated based on the first encoded down-sampled frame and the second encoded down-sampled frame and in accordance with the first sampling pattern and the second sampling pattern.
-
公开(公告)号:US11817022B2
公开(公告)日:2023-11-14
申请号:US18046644
申请日:2022-10-14
Applicant: Meta Platforms Technologies, LLC
Inventor: Nicholas Daniel Trail , Byron Taylor , Yufeng Zhu , Andrew John Ouderkirk , Hee Yoon Lee , Sharvil Shailesh Talati , Behnam Bastani , Pasi Saarikko
CPC classification number: G09G3/003 , G02B27/0172 , G02B2027/0118 , G09G2300/026 , G09G2320/0233 , G09G2320/0626 , G09G2340/12
Abstract: A method for correcting artifacts in artificial reality headsets is provided. The method includes coupling a first image portion into a waveguide in a display for an artificial reality device, provided by a first array of pixels, coupling a second image portion into the waveguide in the display, provided by a second array of pixels, directing the first image portion through an eyebox, directing the second image portion through the eyebox, and tiling, in a user's retina, the first image portion and the second image portion to form an image having an extended field of view that includes an overlapping area comprising light provided by the first array of pixels and the second array of pixels. A system including a memory storing instructions and a processor to execute the instructions to cause the system to perform the above method are also provided.
-
公开(公告)号:US20230199184A1
公开(公告)日:2023-06-22
申请号:US18113459
申请日:2023-02-23
Applicant: Meta Platforms Technologies, LLC
Inventor: Matthew Robert Fulghum , Reza Nourai , Behnam Bastani
IPC: H04N19/119 , H04N19/174 , G02B27/01 , G06F3/01 , G06T19/00 , H04L65/70 , H04L65/75
CPC classification number: H04N19/119 , G02B27/0172 , G06F3/011 , G06F3/017 , G06T19/006 , H04L65/70 , H04L65/75 , H04N19/174
Abstract: Disclosed herein are related to a device and a method of remotely rendering an image. In one approach, a device divides an image of an artificial reality space into a plurality of slices. In one approach, the device encodes a first slice of the plurality of slices. In one approach, the device encodes a portion of a second slice of the plurality of slices, while the device encodes a portion of the first slice. In one approach, the device transmits the encoded first slice of the plurality of slices to a head wearable display. In one approach, the device transmits the encoded second slice of the plurality of slices to the head wearable display, while the device transmits a portion of the encoded first slice to the head wearable display.
-
公开(公告)号:US11651570B2
公开(公告)日:2023-05-16
申请号:US17475067
申请日:2021-09-14
Applicant: Meta Platforms Technologies, LLC
Inventor: Behnam Bastani , James Randal Hughes , Reza Nourai
CPC classification number: G06T19/006 , G02B27/0093 , G02B27/017 , G06T19/20
Abstract: Disclosed herein are related to systems and methods for providing artificial reality. In one aspect, a console receives feedback information indicative of a first completion time from a head wearable display (HWD). The HWD may complete generating a first image frame at the first completion time. The HWD may display the first image frame. In one aspect, the console compares a display time, at which the first image frame is displayed by the HWD, and the first completion time. In one aspect, the console adjusts, according to the comparison, image processing, to adjust a second completion time, at which the console completes generating a second image frame. In one aspect, the console generates, via the adjusted image processing, the second image frame to provide to the HWD.
-
公开(公告)号:US12039695B1
公开(公告)日:2024-07-16
申请号:US17666332
申请日:2022-02-07
Applicant: META PLATFORMS TECHNOLOGIES, LLC
Inventor: Haomiao Jiang , Todd Douglas Keeler , Grant Kaijuin Yang , Rohit Rao Padebettu , Steven Paul Lansel , Behnam Bastani
IPC: G06T5/00 , G06T3/4046 , G06T3/4053 , G06T15/00
CPC classification number: G06T3/4046 , G06T3/4053 , G06T15/005 , G06T2200/24
Abstract: In particular embodiments, the disclosure provides a method comprising: rendering, on a graphics processing unit (GPU), a low-resolution image associated with a scene, the low-resolution image having a resolution that is lower than a target resolution; transmitting a version of the low-resolution image to a neural accelerator; processing, on the neural accelerator, the version of the low-resolution image using a trained machine-learning model, thereby outputting a plurality of control parameters; transmitting the control parameters from the neural accelerator to the GPU; processing, on the GPU, the low-resolution image and the control parameters to construct a high-resolution image having the target resolution, wherein the GPU is programmed to determine a plurality of pixel weights for performing an interpolation using the control parameters; and outputting the high-resolution image.
-
公开(公告)号:US20230245261A1
公开(公告)日:2023-08-03
申请号:US18133568
申请日:2023-04-12
Applicant: Meta Platforms Technologies, LLC
Inventor: Behnam Bastani , Tianxin Ning , Haomiao Jiang
CPC classification number: G06T3/0012 , G06F3/013 , G06T1/60 , G06T19/006 , G06T11/00
Abstract: A method for providing imagery to a user on a display includes receiving eye tracking data. The method also includes determining a current gaze location and a relative distance between the current gaze location and an edge of the display using the eye tracking data. The method also includes defining a first tile centered at the current gaze location and multiple tiles that surround the first tile using the current gaze location and the relative distance between the current gaze location and the edge of the display. The method includes providing a foveated rendered image using the first tile and the multiple tiles.
-
公开(公告)号:US20230169897A1
公开(公告)日:2023-06-01
申请号:US18046644
申请日:2022-10-14
Applicant: Meta Platforms Technologies, LLC
Inventor: Nicholas Daniel Trail , Byron Taylor , Yufeng Zhu , Andrew John Ouderkirk , Hee Yoon Lee , Sharvil Shailesh Talati , Behnam Bastani , Pasi Saarikko
CPC classification number: G09G3/003 , G02B27/0172 , G09G2300/026 , G09G2340/12 , G09G2320/0233 , G09G2320/0626 , G02B2027/0118
Abstract: A method for correcting artifacts in artificial reality headsets is provided. The method includes coupling a first image portion into a waveguide in a display for an artificial reality device, provided by a first array of pixels, coupling a second image portion into the waveguide in the display, provided by a second array of pixels, directing the first image portion through an eyebox, directing the second image portion through the eyebox, and tiling, in a user's retina, the first image portion and the second image portion to form an image having an extended field of view that includes an overlapping area comprising light provided by the first array of pixels and the second array of pixels. A system including a memory storing instructions and a processor to execute the instructions to cause the system to perform the above method are also provided.
-
公开(公告)号:US20230097534A1
公开(公告)日:2023-03-30
申请号:US18072077
申请日:2022-11-30
Applicant: Meta Platforms Technologies, LLC
Inventor: Behnam Bastani , Haomiao Jiang
Abstract: Disclosed herein are related to a system and a method for providing an artificial reality. In one aspect, a system includes a shared physical memory and a first processor having access to the shared physical memory. In one aspect, the first processor performs, during a first time period, a first rendering process to generate a first image frame of a first view of an artificial reality. In one aspect, the first processor performs, during a second time period, a second rendering process to generate a second image frame of a second view of the artificial reality. In one aspect, the system includes a second processor including a neural network and having access to the shared physical memory. In one aspect, the second processor performs, during a third time period overlapping a portion of the second time period, an image enhancing process on the first image frame.
-
-
-
-
-
-
-
-
-