-
公开(公告)号:US20180077384A1
公开(公告)日:2018-03-15
申请号:US15699651
申请日:2017-09-08
Applicant: Google Inc.
Inventor: Daniel Goldman , Jason Lawrence , Andrew Huibers , Andrew Ian Russell
CPC classification number: H04N21/222 , G02B27/0101 , G02B2027/014 , G02F1/29 , G02F2001/291 , H04N7/142 , H04N7/147 , H04N7/157 , H04N13/305 , H04N21/2187 , H04N21/234363 , H04N21/2365 , H04N21/2393 , H04N21/242 , H04N21/4113 , H04N21/4223 , H04N21/4302 , H04N21/4316 , H04N21/6125 , H04N21/85406 , H04R1/028 , H04R3/005 , H04R2430/20 , H04R2499/15
Abstract: An example telepresence terminal includes a lenticular display, an image sensor, an infrared emitter, and an infrared depth sensor. The terminal may determine image data using visible light emitted by the infrared emitter and captured by the image sensor and determine depth data using infrared light captured by the infrared depth sensor. The terminal may also communicate the depth data and the image data to a remote telepresence terminal and receive remote image data and remote depth data. The terminal may also generate a first display image using the lenticular display based on the remote image data that is viewable from a first viewing location and generate a second display image using the lenticular display based on the remote image data and the remote depth data that is viewable from a second viewing location.
-
公开(公告)号:US09153017B1
公开(公告)日:2015-10-06
申请号:US14460392
申请日:2014-08-15
Applicant: Google Inc.
Inventor: Andrew Ian Russell , Pascal Massimino
CPC classification number: H04N1/409 , H04N1/6027 , H04N9/646 , H04N19/154 , H04N19/59 , H04N19/895
Abstract: A method includes obtaining, at one or more computing devices, an input image; determining a first value of a quality metric for the input image; generating a first chroma subsampled representation of the input image; and generating a reconstructed image based on the chroma subsampled representation. The method also includes determining a second value of the quality metric for the reconstructed image; determining an error value based on the first value of the quality metric and the second value of the quality metric; and generating a second chroma subsampled representation of the input image based in part on the error value.
Abstract translation: 一种方法包括在一个或多个计算设备处获取输入图像; 确定输入图像的质量度量的第一值; 产生所述输入图像的第一色度子采样表示; 以及基于色度子采样表示来生成重建图像。 该方法还包括确定重建图像的质量度量的第二值; 基于质量度量的第一值和质量度量的第二值确定误差值; 以及部分地基于所述误差值来生成所述输入图像的第二色度子采样表示。
-
公开(公告)号:US10217189B2
公开(公告)日:2019-02-26
申请号:US15266602
申请日:2016-09-15
Applicant: Google Inc.
Inventor: Andrew Ian Russell
IPC: H04N7/00 , G06T3/40 , H04N5/247 , H04N13/111 , H04N13/271 , H04N13/344 , G03B37/04 , H04N5/232 , G02B27/01 , H04N13/243 , H04N13/117 , H04N13/239 , H04N13/128 , H04N13/261
Abstract: Systems and methods are described for capturing spherical content. The systems and methods can include determining a region within a plurality of images captured with a plurality of cameras in which to transform two-dimensional data into three-dimensional data, calculating a depth value for a portion of pixels in the region, generating a spherical image, the spherical image including image data for the portion of pixels in the region, constructing, using the image data, a three-dimensional surface in three-dimensional space of a computer graphics object generated by an image processing system, generating, using the image data, a texture mapping to a surface of the computer graphics object, and transmitting the spherical image and the texture mapping for display in a head-mounted display device.
-
公开(公告)号:US20160112713A1
公开(公告)日:2016-04-21
申请号:US14518779
申请日:2014-10-20
Applicant: Google Inc.
Inventor: Andrew Ian Russell
IPC: H04N19/46 , H04N19/91 , H04N19/136 , H04N19/18 , H04N19/20 , H04N19/107
CPC classification number: H04N19/20 , H04N19/597
Abstract: Disclosed is a method for encoding a spherical video. The method can include mapping a frame of a spherical video to a first two dimensional representation based on a spherical to square projection, the first two dimensional representation being a square, mapping the first two dimensional representation to a second two dimensional representation, the second two dimensional representation being a rectangle, and encoding the second two dimensional representation as an encoded bit stream.
Abstract translation: 公开了一种用于编码球面视频的方法。 该方法可以包括将球形视频的帧映射到基于球面到正方形投影的第一二维表示,第一二维表示是正方形,将第一二维表示映射到第二二维表示,第二二维 三维表示是矩形,并且将第二二维表示编码为编码比特流。
-
5.
公开(公告)号:US20160042498A1
公开(公告)日:2016-02-11
申请号:US14452790
申请日:2014-08-06
Applicant: Google Inc.
Inventor: Andrew Ian Russell
CPC classification number: G06T3/40 , G06T5/002 , G06T5/007 , G06T7/13 , G06T7/136 , G06T9/00 , G06T2207/20016 , G06T2207/20021 , G06T2207/20192 , H04N19/85
Abstract: A method for processing an image having a first bit depth includes performing two or more iterations of a bit depth enhancement operation that increases the bit depth of the image to a second bit depth that is higher than the first bit depth. The bit depth enhancement operation includes dividing the image into a plurality of areas, performing an edge detection operation to identify one or more areas from the plurality of areas that do not contain edge features, and applying a blur to the one or more areas from the plurality of areas that do not contain edge features. In a first iteration of the of the bit depth enhancement operation, the plurality of areas includes a first number of areas, and the number of areas included in the plurality of areas decreases with each subsequent iteration of the bit depth enhancement operation.
Abstract translation: 用于处理具有第一位深度的图像的方法包括执行将图像的比特深度增加到高于第一比特深度的第二比特深度的比特深度增强操作的两次或更多次迭代。 比特深度增强操作包括将图像划分成多个区域,执行边缘检测操作以识别来自不包含边缘特征的多个区域中的一个或多个区域,以及对来自该边缘特征的一个或多个区域应用模糊 多个不包含边缘特征的区域。 在位深度增强操作的第一次迭代中,多个区域包括第一数量的区域,并且随着位深度增强操作的每个后续迭代,包括在多个区域中的区域的数量减少。
-
公开(公告)号:US20170168311A1
公开(公告)日:2017-06-15
申请号:US15375990
申请日:2016-12-12
Applicant: GOOGLE INC.
Inventor: Andrew Ian Russell
CPC classification number: G02B27/26 , G03B37/00 , G03B37/04 , H04N5/2254 , H04N5/23238 , H04N13/204 , H04N13/239 , H04N13/243 , H04N13/282
Abstract: An apparatus includes at least one camera and a refractor configured to change a direction of a light toward a lens of the camera. The refractor has a shape configured to redirect light representing an image at two focal points, the two focal points are on a same plane and at a same distance from the at least one camera, and the refractor is positioned between the two focal points and the at least one camera.
-
公开(公告)号:US20170076429A1
公开(公告)日:2017-03-16
申请号:US15266602
申请日:2016-09-15
Applicant: Google Inc.
Inventor: Andrew Ian Russell
CPC classification number: G06T3/4038 , G02B27/017 , G02B2027/0134 , G02B2027/0138 , G02B2027/014 , G02B2027/0187 , G03B37/04 , H04N5/23238 , H04N5/247 , H04N13/111 , H04N13/117 , H04N13/128 , H04N13/239 , H04N13/243 , H04N13/261 , H04N13/271 , H04N13/344 , H04N2213/001
Abstract: Systems and methods are described for capturing spherical content. The systems and methods can include determining a region within a plurality of images captured with a plurality of cameras in which to transform two-dimensional data into three-dimensional data, calculating a depth value for a portion of pixels in the region, generating a spherical image, the spherical image including image data for the portion of pixels in the region, constructing, using the image data, a three-dimensional surface in three-dimensional space of a computer graphics object generated by an image processing system, generating, using the image data, a texture mapping to a surface of the computer graphics object, and transmitting the spherical image and the texture mapping for display in a head-mounted display device.
Abstract translation: 描述了捕获球形内容的系统和方法。 系统和方法可以包括确定用多个摄像机捕获的多个图像内的区域,其中将二维数据变换为三维数据,计算该区域中的一部分像素的深度值,产生球面 图像,所述球面图像包括所述区域中的所述像素部分的图像数据,使用所述图像数据构建由图像处理系统生成的计算机图形对象的三维空间中的三维表面, 图像数据,映射到计算机图形对象的表面的纹理映射,以及发送球形图像和纹理映射以在头戴式显示设备中显示。
-
公开(公告)号:US10757399B2
公开(公告)日:2020-08-25
申请号:US14850114
申请日:2015-09-10
Applicant: GOOGLE INC.
Inventor: Andrew Ian Russell
IPC: H04N13/344 , H04N13/117 , H04N13/366 , G02B27/01 , H04N13/15 , H04N13/133
Abstract: A method includes receiving an indication of a field of view associated with a three-dimensional (3D) image being displayed on a head mount display (HMD), receiving an indication of a depth of view associated with the 3D image being displayed on the HMD, selecting a first right eye image and a second right eye image based on the field of view, combining the first right eye image and the second right eye image based on the depth of view, selecting a first left eye image and a second left eye image based on the field of view, and combining the first left eye image and the second left eye image based on the depth of view.
-
公开(公告)号:US20170228015A1
公开(公告)日:2017-08-10
申请号:US15386328
申请日:2016-12-21
Applicant: Google Inc.
Inventor: Andrew Ian Russell
CPC classification number: G06F3/012 , G02B27/0179 , G02B2027/0187 , G06T1/60 , G06T19/006 , H04N13/344
Abstract: The locations of pixels in a frame are adjusted at a display controller after the frame has been generated by a graphics processing unit (GPU) or other processor and provided to the display controller. The adjusting of the pixel locations therefore occurs as close as possible to a display panel in a display system, thereby supporting rapid changes to pixel positions.
-
10.
公开(公告)号:US09286653B2
公开(公告)日:2016-03-15
申请号:US14452790
申请日:2014-08-06
Applicant: Google Inc.
Inventor: Andrew Ian Russell
CPC classification number: G06T3/40 , G06T5/002 , G06T5/007 , G06T7/13 , G06T7/136 , G06T9/00 , G06T2207/20016 , G06T2207/20021 , G06T2207/20192 , H04N19/85
Abstract: A method for processing an image having a first bit depth includes performing two or more iterations of a bit depth enhancement operation that increases the bit depth of the image to a second bit depth that is higher than the first bit depth. The bit depth enhancement operation includes dividing the image into a plurality of areas, performing an edge detection operation to identify one or more areas from the plurality of areas that do not contain edge features, and applying a blur to the one or more areas from the plurality of areas that do not contain edge features. In a first iteration of the of the bit depth enhancement operation, the plurality of areas includes a first number of areas, and the number of areas included in the plurality of areas decreases with each subsequent iteration of the bit depth enhancement operation.
Abstract translation: 用于处理具有第一位深度的图像的方法包括执行将图像的比特深度增加到高于第一比特深度的第二比特深度的比特深度增强操作的两次或更多次迭代。 比特深度增强操作包括将图像划分成多个区域,执行边缘检测操作以识别来自不包含边缘特征的多个区域中的一个或多个区域,以及对来自该边缘特征的一个或多个区域应用模糊 多个不包含边缘特征的区域。 在位深度增强操作的第一次迭代中,多个区域包括第一数量的区域,并且随着位深度增强操作的每个后续迭代,包括在多个区域中的区域的数量减少。
-
-
-
-
-
-
-
-
-