公开(公告)号：US10104382B2

公开(公告)日：2018-10-16

申请号：US15651619

申请日：2017-07-17

Applicant: GOOGLE INC.

Inventor： Jingning Han ,  Yaowu Xu ,  Debargha Mukherjee

IPC: H04N19/176 ,  H04N19/42 ,  H04N19/12 ,  H04N19/60 ,  H04N19/159 ,  H04N19/625 ,  H04N19/593 ,  H04N19/61

Abstract: A method and system may identify a video data block using a video codec and apply a transform kernel of a butterfly asymmetric discrete sine transform (ADST) to the video data block in a pipeline.

公开(公告)号：US20180220152A1

公开(公告)日：2018-08-02

申请号：US15420359

申请日：2017-01-31

Applicant: GOOGLE INC.

Inventor： Debargha Mukherjee ,  Yaowu Xu ,  James Bankoski ,  Yuxin Liu

IPC: H04N19/573 ,  H04N19/132 ,  H04N19/56

CPC classification number: H04N19/573 ,  H04N19/119 ,  H04N19/132 ,  H04N19/176 ,  H04N19/20 ,  H04N19/56 ,  H04N19/577 ,  H04N19/58

Abstract: Multi-reference compound prediction using masking for encoding and decoding blocks of video frames is described. A mask for segmenting a current block of a current frame of the video sequence into at least a first segment and a second segment is determined using a first set of reference frames. A first predictor using the first set of reference frames is generated for the first segment of the current block. A second predictor is generated for the second segment of the current block using a second set of reference frames, wherein the first set of reference frames is a subset of the second set of reference frames.

公开(公告)号：US20180184118A1

公开(公告)日：2018-06-28

申请号：US15387797

申请日：2016-12-22

Applicant: GOOGLE INC.

Inventor： Debargha Mukherjee ,  Yue Chen

IPC: H04N19/583 ,  H04N19/167 ,  H04N19/176

CPC classification number: H04N19/583 ,  H04N19/167 ,  H04N19/176

Abstract: A method for processing a selected portion of a video, the selected portion of the video having a plurality of blocks. The method includes obtaining current prediction parameters for all of a plurality of adjacent blocks from the plurality of blocks that are adjacent to a current block from the plurality of blocks in the selected portion of the video, generating a base prediction for the current block from the plurality of blocks using the current prediction parameters associated with the current block, identifying adjacent prediction parameters from the current prediction parameters for a first adjacent block from the plurality of adjacent blocks, determining an overlap region within the current block and adjacent to the first adjacent block, and generating, for each pixel within the overlap region, an overlapped prediction for the pixel as a function of the base prediction and a prediction based on the adjacent prediction parameters.

公开(公告)号：US20180109811A1

公开(公告)日：2018-04-19

申请号：US15297603

申请日：2016-10-19

Applicant: Google Inc.

Inventor： Debargha Mukherjee ,  Yue Chen ,  Aamir Anis

IPC: H04N19/65 ,  H04N19/184 ,  H04N19/172 ,  H04N19/182

CPC classification number: H04N19/65 ,  H04N19/117 ,  H04N19/136 ,  H04N19/154 ,  H04N19/172 ,  H04N19/174 ,  H04N19/176 ,  H04N19/182 ,  H04N19/184 ,  H04N19/46 ,  H04N19/82

Abstract: Reducing error in a reconstructed frame is described. Pixels of the frame are classified into classes based on a classification scheme. Offset values for each class of at least some of the classes are determined, and a respective offset value for a class is applied to each pixel of the class, resulting in offset-adjusted pixels for the class. For the classes, a respective error rate reduction in using the respective offset value for a class as compared to omitting the respective offset value is determined, where the respective error rate reduction is based on the pixels of the class in the reconstructed frame, the offset-adjusted pixels of the class, and co-located source pixels in a source frame decoded to generate the reconstructed frame. A subset of classes is selected for reducing error in the reconstructed frame based on the error rate reductions.

公开(公告)号：US09918094B2

公开(公告)日：2018-03-13

申请号：US14519006

申请日：2014-10-20

Applicant: GOOGLE INC.

Inventor： Debargha Mukherjee

IPC: H04N7/12 ,  H04N19/17 ,  H04N19/597 ,  H04N19/61 ,  H04N19/124 ,  H04N19/154 ,  H04N19/167 ,  H04N19/12

CPC classification number: H04N19/17 ,  H04N19/12 ,  H04N19/124 ,  H04N19/154 ,  H04N19/167 ,  H04N19/597 ,  H04N19/61

Abstract: In a general aspect, a method includes determining a tile position in a frame of a spherical video based on a view perspective, selecting a first portion of the frame of the spherical video as a first two dimensional tile based on the tile position, selecting a plurality of second two dimensional tiles from a second portion of the frame of the spherical video, the second portion of the frame surrounding the first portion of the frame and extending away from the first portion of the frame, encoding the first two dimensional tile using a first quality, encoding the plurality of second two dimensional tiles using at least one second quality, and transmitting a packet, as a streaming spherical video, the packet including the encoded first two dimensional tile and the plurality of encoded second two dimensional tiles.

公开(公告)号：US09769499B2

公开(公告)日：2017-09-19

申请号：US14823269

申请日：2015-08-11

Applicant: Google Inc.

Inventor： Debargha Mukherjee ,  Yue Chen ,  Shunyao Li

IPC: H04N19/61 ,  H04N19/59 ,  H04N19/176 ,  H04N19/122 ,  H04N19/583 ,  H04N19/184

CPC classification number: H04N19/61 ,  H04N19/122 ,  H04N19/176 ,  H04N19/184 ,  H04N19/583 ,  H04N19/59

Abstract: Super-transform coding may include identifying a plurality of sub-blocks for prediction coding a current block, determining whether to encode the current block using a super-transform, and super-prediction coding the current block. Super-prediction coding may include generating a super-prediction block for the current block by generating a prediction block for each unpartitioned sub-block of the current block, generating a super-prediction block for each partitioned sub-block of the current block by super-prediction coding the sub-block, and including the prediction blocks and super-prediction blocks for the sub-blocks in a super-prediction block for the current block. Including the prediction blocks and super-prediction blocks for the sub-blocks in a super-prediction block for the current block may include filtering at least a portion of each prediction block and each super-prediction block based on a spatially adjacent prediction block. Super-transform coding may include transforming the super-prediction block for the current block using a corresponding super-transform.

公开(公告)号：US09369719B2

公开(公告)日：2016-06-14

申请号：US14539943

申请日：2014-11-12

Applicant: Google Inc.

Inventor： Debargha Mukherjee

IPC: G06K9/36 ,  G06K9/46 ,  H04N19/13 ,  H04N19/176 ,  H04N19/91 ,  H04N19/136

CPC classification number: H04N19/13 ,  H04N19/136 ,  H04N19/176 ,  H04N19/91

Abstract: A code is received. The code conveys data about a quantized coefficient that corresponds to a pixel of an image file. A decoding mode and a version of a code mapping format for decoding the received code is determined. The decoding mode and the version of the code mapping format dynamically change based on a previously-decoded code. The received code is decoded, during the decoding mode, according to the version of the code mapping format to obtain the data about the quantized coefficient.

Abstract translation: 收到代码。 代码传达关于与图像文件的像素对应的量化系数的数据。 确定用于解码接收到的代码的解码模式和代码映射格式的版本。 解码模式和代码映射格式的版本基于先前解码的代码动态地改变。 在解码模式期间，根据代码映射格式的版本解码接收到的代码，以获得关于量化系数的数据。

公开(公告)号：US10448013B2

公开(公告)日：2019-10-15

申请号：US15387690

申请日：2016-12-22

Applicant: GOOGLE INC.

Inventor： Debargha Mukherjee ,  Yaowu Xu ,  James Bankoski ,  Paul Wilkins ,  Jingning Han ,  Yuxin Liu ,  Wei-Ting Lin

IPC: H04N19/117 ,  H04N19/105 ,  H04N19/56 ,  H04N19/134 ,  H04N19/137

Abstract: Encoding or decoding blocks of video frames using multiple reference frames with adaptive temporal filtering can include generating one or more candidate reference frames by applying temporal filtering to one or more frames of a video sequence according to relationships between respective ones of the one or more frames and a current frame of the video sequence. A reference frame to use for predicting the current frame can be selected from the one or more candidate reference frames, and a prediction block can be generated using the selected reference frame. During an encoding operation, the prediction block can be used to encode a block of a current frame of the video sequence. During a decoding operation, the prediction block can be used to decode a block of a current frame of the video sequence.

公开(公告)号：US10194137B1

公开(公告)日：2019-01-29

申请号：US15295944

申请日：2016-10-17

Applicant: Google Inc.

Inventor： Debargha Mukherjee ,  Chen Wu ,  Meng Wang

IPC: H04N13/261 ,  G06T7/40 ,  G06T7/00 ,  H04N13/128

Abstract: A two-dimensional image to be converted to a first three-dimensional image may be received. A second three-dimensional image that is visually similar to the two-dimensional image that is to be converted may be identified. A feature-to-depth mapping function may be computed for the first three-dimensional image by using an approximate depth map of the second three-dimensional image that is visually similar to the two-dimensional image that is to be converted. The feature-to-depth mapping function may be applied to a plurality of pixels of the two-dimensional image to determine a depth value for the plurality of pixels of the two-dimensional image. The first three-dimensional image may be generated based on the depth values for the plurality of pixels of the two-dimensional image.

公开(公告)号：US10142628B1

公开(公告)日：2018-11-27

申请号：US15373590

申请日：2016-12-09

Applicant: GOOGLE INC.

Inventor： Debargha Mukherjee ,  Jingning Han

IPC: H04N19/61 ,  H04N19/11 ,  H04N19/159 ,  H04N19/129 ,  H04N19/122 ,  H04N19/625 ,  H04N19/176 ,  H04N19/172

Abstract: Decoding an encoded video stream may include identifying an encoded block identifying an intra prediction mode for decoding the encoded block from the encoded video stream, identifying a transform mode from a plurality of transform modes for decoding the encoded block based on the intra prediction mode, identifying a probability model from a plurality of probability models for decoding the encoded block based on the transform mode, identifying a scan mode for decoding the encoded block based on the transform mode, generating a decoded block by decoding the encoded block using the scan mode, the probability model, the transform mode, and the intra prediction mode, and outputting or storing the decoded block.