公开(公告)号：US10553016B2

公开(公告)日：2020-02-04

申请号：US15813558

申请日：2017-11-15

Applicant: Google LLC

Inventor： Eric Turner ,  Damien Saint-Macary ,  Behnam Bastani ,  Haomiao Jiang

IPC: G06T15/00 ,  G06T15/20 ,  G02B27/01 ,  G06F3/01 ,  G06T19/00 ,  G06F3/0481

Abstract: A display device, such as a head mounted device (HMD), displays a virtual scene. The display device includes a motion tracker for detecting rotation and/or translation of the display device. The display device also includes a processor that is configured to determine, in response to the detected, an orientation of the display device relative to a plurality of world-aligned viewing frustums that are stationary relative to the virtual scene. The processor is also configured to identify a set of those world-aligned viewing frustums that overlap with an output field of view. The processor is further configured to render pixels of the set of those world-aligned viewing frustums that overlap with an output field of view and upsample the rendered pixels to generate values of display pixels for presentation by the display device.

公开(公告)号：US10546364B2

公开(公告)日：2020-01-28

申请号：US16000305

申请日：2018-06-05

Applicant: GOOGLE LLC

Inventor： Behnam Bastani ,  Brian Funt ,  Sylvain Vignaud ,  Haomiao Jiang

IPC: G06T3/00 ,  G06T19/00 ,  G06T15/20 ,  G06T1/60 ,  G06F3/01

Abstract: Systems and methods for performing foveated rendering are provided. An example system and method may warp a 3D scene based on a fixation point. The system and method may also render the warped 3D scene to generate a first image. The system and method may also unwarp the first image to generate a second image. For example, the first image may have fewer pixels than the second image.

公开(公告)号：US10564715B2

公开(公告)日：2020-02-18

申请号：US15351196

申请日：2016-11-14

Applicant: Google LLC

Inventor： Mark Spitzer ,  Carlin Vieri ,  Eric Turner ,  Behnam Bastani

IPC: G06F3/01 ,  G02B27/00 ,  G06F3/147 ,  G09G5/391 ,  G09G5/00 ,  G06T1/20 ,  G06T3/40

Abstract: A foveated display system includes a rendering device including at least one graphics processing unit (GPU) to render a foveal region and a peripheral region of a first image, wherein the foveal region has a higher resolution than the peripheral region. The system further includes a display device coupled to the rendering device via at least one physical layer. The display device includes a pixel array and a display controller coupled to the pixel array. The display controller includes a scaling component to upscale the first peripheral region to generate a scaled first peripheral region and a blending component to blend the foveal region with the scaled first peripheral region to generate a second image.

公开(公告)号：US20180350032A1

公开(公告)日：2018-12-06

申请号：US16000305

申请日：2018-06-05

Applicant: GOOGLE LLC

Inventor： Behnam Bastani ,  Brian Funt ,  Sylvain Vignaud ,  Haomiao Jiang

IPC: G06T3/00 ,  G06T19/00 ,  G06T15/20

CPC classification number: G06T3/0093 ,  G06F3/013 ,  G06T1/60 ,  G06T15/20 ,  G06T19/00 ,  G06T2200/04 ,  G06T2210/36 ,  G06T2210/44

Abstract: Systems and methods for performing foveated rendering are provided. An example system and method may warp a 3D scene based on a fixation point. The system and method may also render the warped 3D scene to generate a first image. The system and method may also unwarp the first image to generate a second image. For example, the first image may have fewer pixels than the second image.

公开(公告)号：US10714027B1

公开(公告)日：2020-07-14

申请号：US16000204

申请日：2018-06-05

Applicant: Google LLC

Inventor： Behnam Bastani ,  Carlin Vieri

IPC: G09G3/34 ,  G09G3/36

Abstract: Head-mounted displays (HMDs) for virtual reality (VR) provide backlit illumination when the LCD rows corresponding to a non-dominant eye of the viewer are being updated. For example, when a human viewer operates a VR computer in the form of a smartphone with an LCD screen embedded in specialized goggles (e.g., Google Cardboard), the human viewer may specify that his/her right eye is dominant. In this case, the VR computer times the backlit illumination to be activated when the rows of LCD pixels in the field of view of the non-dominant, i.e., left, eye are being updated. When the rows of LCD pixels in the field of view of the dominant, i.e., right eye are being updated, the VR computer deactivates the backlit illumination.

公开(公告)号：US10572761B1

公开(公告)日：2020-02-25

申请号：US15997891

申请日：2018-06-05

Applicant: GOOGLE LLC

Inventor： Behnam Bastani ,  Eliezer Peli

IPC: G06K9/40 ,  G06T5/00 ,  G06T19/00 ,  G06T3/40

Abstract: Displaying video in an HMD may include introducing unperceived noise to the video frame signal in order to enhance dynamic range. For example, each of a viewer's left and right eyes have a field of view (FOV) corresponding to a portion of pixels shown on the HMD. For each of these portions of pixels, the VR system may combine a noise signal (e.g., zero-mean Gaussian white noise) with the video signals corresponding to each of the portions of pixels. The introduction of such noise may improve the dynamic range of the viewer. Further, in some implementations, the noise signal that is combined with the left video signal may be slightly different from the noise signal that is combined with the right video signal. Such slightly different noise signals may provide further improvement to the image seen by the viewer due to binocular summation.

公开(公告)号：US10572764B1

公开(公告)日：2020-02-25

申请号：US15997884

申请日：2018-06-05

Applicant: GOOGLE LLC

Inventor： Behnam Bastani ,  Damien Saint-Macary

IPC: G06T15/00 ,  G06K9/46 ,  G06F3/01 ,  G02B27/22 ,  G02B27/01

Abstract: Techniques of displaying video in an HMD include performing an adaptive rendering operation to produce a transition between stereo and non-stereo rendering of objects in a virtual environment during eye saccade. Because viewers generally have low visual perception performance during eye saccade, the viewer will not notice this transition as much and will not experience as much motion sickness.