公开(公告)号：US20170228855A1

公开(公告)日：2017-08-10

申请号：US15018941

申请日：2016-02-09

Applicant: Google Inc.

Inventor： John Paul Bates ,  Evangelos Kokkevis

IPC: G06T5/00 ,  H04N13/04 ,  G06T19/00 ,  G02B27/01 ,  G06T3/00 ,  G06T1/20

CPC classification number: G09G3/003 ,  G02B27/0093 ,  G02B27/017 ,  G02B2027/0187 ,  G06F3/011 ,  G06F3/012 ,  G09G3/001 ,  G09G5/363 ,  G09G2320/0261 ,  G09G2354/00

Abstract: An application executed at a central processing unit (CPU) of a head mounted display (HMD) system generates sets of frame drawing commands for a graphics processing unit (GPU), and for each set of frame drawing commands the GPU renders a corresponding frame into one of a plurality of frame buffers. Each frame is generated to include or be associated with a frame number that indicates the location of the frame in the sequence of frames generated over time. In addition, each frame is generated to include or be associated with pose information indicating the pose of the HMD system when the frame is generated. At periodic preemption points, the GPU selects the frame stored at the plurality of frame buffers having the most recent frame number and applies an electronic display stabilization warp to the frame based on the difference between the current pose and the pose information stored with the selected frame.

公开(公告)号：US20170329136A1

公开(公告)日：2017-11-16

申请号：US15153125

申请日：2016-05-12

Applicant: Google Inc.

Inventor： John Paul Bates ,  Hendrik Wagenaar

IPC: G02B27/01 ,  G06T3/00

CPC classification number: G02B27/0172 ,  G02B27/0093 ,  G02B2027/011 ,  G02B2027/0116 ,  G02B2027/014 ,  G06T3/0093

Abstract: Display pre-distortion methods and apparatus for HMDs are disclosed. A disclosed example method includes determining a position of a pupil relative to a lens of the head-mounted display (HMD), determining, based on the determined position, a pre-distortion map for an image to be displayed on a display screen of the HMD, and displaying the image on the display screen of the HMD, wherein the image is modified by the pre-distortion map.

公开(公告)号：US10453175B2

公开(公告)日：2019-10-22

申请号：US15439589

申请日：2017-02-22

Applicant: Google Inc.

Inventor： Keir Banks Mierle ,  John Paul Bates

IPC: G06F3/01 ,  G06T11/60 ,  G06T15/00 ,  G06T3/00 ,  G02B27/01 ,  G06F3/0346 ,  G06T19/00 ,  G02B27/00

Abstract: An example technique may include performing a first time-warping of a scene of virtual reality content based on head pose information received during or after a rendering of the scene to obtain a time-warped scene, performing a second time-warping of an object based at least on object pose information received during or after a rendering of the object to obtain a time-warped object, and displaying on a display device a composite image based on the time-warped scene and the time-warped object.

公开(公告)号：US20170345220A1

公开(公告)日：2017-11-30

申请号：US15606569

申请日：2017-05-26

Applicant: Google Inc.

Inventor： John Paul Bates

IPC: G06T19/20 ,  G06T7/50 ,  G06T3/00 ,  G06T5/00 ,  G06F3/01

CPC classification number: G06T19/20 ,  G02B27/017 ,  G06F3/012 ,  G06T3/0093 ,  G06T5/006 ,  G06T7/50 ,  G06T15/005 ,  G06T15/205 ,  G06T2207/10028 ,  G06T2219/2004 ,  G06T2219/2016 ,  H04N13/128 ,  H04N13/279 ,  H04N13/344 ,  H04N13/366 ,  H04N13/383 ,  H04N2013/0081

Abstract: A technique includes determining a depth value for each of a plurality of pixels of a frame, down-sampling the depth values of a tile of the frame to obtain a plurality of down-sampled depth values, the frame including one or more tiles, determining a change in a head pose, determining, from the plurality of down-sampled depth values, a down-sampled depth value for a vertex, determining an adjusted position for the vertex based on the change in head pose and the down-sampled depth value for the vertex, performing, based on at least the adjusted position for the vertex, a depth-adjusted time-warping of the frame to obtain a depth-adjusted time-warped frame, and triggering display of the depth-adjusted time-warped frame.

公开(公告)号：US10453272B2

公开(公告)日：2019-10-22

申请号：US15606569

申请日：2017-05-26

Applicant: Google Inc.

Inventor： John Paul Bates

IPC: G06T15/00 ,  G06T19/20 ,  G06T7/50 ,  G06F3/01 ,  G06T3/00 ,  G06T5/00 ,  G06T15/20 ,  G02B27/01 ,  H04N13/344 ,  H04N13/279 ,  H04N13/366 ,  H04N13/128 ,  H04N13/383 ,  H04N13/00

Abstract: A technique includes determining a depth value for each of a plurality of pixels of a frame, down-sampling the depth values of a tile of the frame to obtain a plurality of down-sampled depth values, the frame including one or more tiles, determining a change in a head pose, determining, from the plurality of down-sampled depth values, a down-sampled depth value for a vertex, determining an adjusted position for the vertex based on the change in head pose and the down-sampled depth value for the vertex, performing, based on at least the adjusted position for the vertex, a depth-adjusted time-warping of the frame to obtain a depth-adjusted time-warped frame, and triggering display of the depth-adjusted time-warped frame.

公开(公告)号：US10156723B2

公开(公告)日：2018-12-18

申请号：US15153125

申请日：2016-05-12

Applicant: Google Inc.

Inventor： John Paul Bates ,  Hendrik Wagenaar

IPC: G02B27/01 ,  G06T3/00 ,  G02B27/00

Abstract: Display pre-distortion methods and apparatus for HMDs are disclosed. A disclosed example method includes determining a position of a pupil relative to a lens of the head-mounted display (HMD), determining, based on the determined position, a pre-distortion map for an image to be displayed on a display screen of the HMD, and displaying the image on the display screen of the HMD, wherein the image is modified by the pre-distortion map.

公开(公告)号：US10089725B2

公开(公告)日：2018-10-02

申请号：US15018941

申请日：2016-02-09

Applicant: Google Inc.

Inventor： John Paul Bates ,  Evangelos Kokkevis

IPC: G06T5/00 ,  G06T3/00 ,  G06T1/20 ,  G06T19/00 ,  G02B27/01 ,  H04N13/04 ,  H04N13/344

Abstract: An application executed at a central processing unit (CPU) of a head mounted display (HMD) system generates sets of frame drawing commands for a graphics processing unit (GPU), and for each set of frame drawing commands the GPU renders a corresponding frame into one of a plurality of frame buffers. Each frame is generated to include or be associated with a frame number that indicates the location of the frame in the sequence of frames generated over time. In addition, each frame is generated to include or be associated with pose information indicating the pose of the HMD system when the frame is generated. At periodic preemption points, the GPU selects the frame stored at the plurality of frame buffers having the most recent frame number and applies an electronic display stabilization warp to the frame based on the difference between the current pose and the pose information stored with the selected frame.

公开(公告)号：US20170243324A1

公开(公告)日：2017-08-24

申请号：US15439589

申请日：2017-02-22

Applicant: Google Inc.

Inventor： Keir Banks Mierle ,  John Paul Bates

IPC: G06T3/00 ,  G06T11/60 ,  G06T15/00 ,  G06F3/01

CPC classification number: G06T3/0093 ,  G02B27/0093 ,  G02B27/017 ,  G02B2027/0187 ,  G06F3/012 ,  G06F3/0346 ,  G06T11/60 ,  G06T15/005 ,  G06T19/006

Abstract: An example technique may include performing a first time-warping of a scene of virtual reality content based on head pose information received during or after a rendering of the scene to obtain a time-warped scene, performing a second time-warping of an object based at least on object pose information received during or after a rendering of the object to obtain a time-warped object, and displaying on a display device a composite image based on the time-warped scene and the time-warped object.