公开(公告)号：US20180184086A1

公开(公告)日：2018-06-28

申请号：US15387690

申请日：2016-12-22

Applicant: GOOGLE INC.

Inventor： Debargha Mukherjee ,  Yaowu Xu ,  James Bankoski ,  Paul Wilkins ,  Jingning Han ,  Yuxin Liu ,  Wei-Ting Lin

IPC: H04N19/117 ,  H04N19/105 ,  H04N19/56

CPC classification number: H04N19/117 ,  H04N19/105 ,  H04N19/134 ,  H04N19/137 ,  H04N19/56

Abstract: Encoding or decoding blocks of video frames using multiple reference frames with adaptive temporal filtering can include generating one or more candidate reference frames by applying temporal filtering to one or more frames of a video sequence according to relationships between respective ones of the one or more frames and a current frame of the video sequence. A reference frame to use for predicting the current frame can be selected from the one or more candidate reference frames, and a prediction block can be generated using the selected reference frame. During an encoding operation, the prediction block can be used to encode a block of a current frame of the video sequence. During a decoding operation, the prediction block can be used to decode a block of a current frame of the video sequence.

公开(公告)号：US20180007361A1

公开(公告)日：2018-01-04

申请号：US15705751

申请日：2017-09-15

Applicant: GOOGLE INC.

Inventor： Debargha Mukherjee

IPC: H04N19/13 ,  H03M7/40

CPC classification number: H04N19/13 ,  H03M7/40 ,  H03M7/4006 ,  H03M7/6035 ,  H04N19/91

Abstract: Adaptive stochastic entropy encoding may include identifying a current portion of an input video stream, and identifying a current probability distribution, which may be an adapted probability distribution associated with a previously encoded portion of the video stream. Adaptive stochastic entropy encoding may include identifying a forward update probability distribution based on the current portion, generating a modified probability distribution for the current portion based on the forward update probability distribution and the current probability distribution, generating an encoded portion based on the current portion and the modified probability distribution, and generating an adapted probability distribution based on the current probability distribution and the forward update probability distribution.

公开(公告)号：US20170353735A1

公开(公告)日：2017-12-07

申请号：US15174223

申请日：2016-06-06

Applicant: GOOGLE INC.

Inventor： Debargha Mukherjee ,  Yue Chen

IPC: H04N19/567 ,  H04N19/182 ,  H04N19/176

CPC classification number: H04N19/567 ,  H04N19/107 ,  H04N19/119 ,  H04N19/157 ,  H04N19/176 ,  H04N19/182 ,  H04N19/583

Abstract: Encoding frames of a video stream may include encoding a current block of a current frame, generating a base prediction block for the current block based on current prediction parameters associated with the current block, identifying adjacent prediction parameters used for encoding previously encoded adjacent blocks that are adjacent to the current block. At least one side of the current block is adjacent to two or more of the previously encoded adjacent blocks. The encoding may include determining overlap regions in the current block, each of the overlap regions corresponding to a respective previously encoded adjacent block, generating an overlapped prediction of pixel values for each of the overlap regions according to a weighted function of the base prediction and a prediction based on the adjacent prediction parameters. The weighted function may be based on a difference between the current prediction parameters and the adjacent prediction parameters.

公开(公告)号：US09800883B2

公开(公告)日：2017-10-24

申请号：US15091777

申请日：2016-04-06

Applicant: Google Inc.

Inventor： Krishna Gadepalli ,  Christophe Chaland ,  Rushabh Doshi ,  Huisheng Wang ,  Wendy Tobagus ,  Vijnan Shastri ,  Debargha Mukherjee

IPC: H04N19/40 ,  H04N19/436 ,  H04N19/85 ,  H04N19/127 ,  H04N19/14 ,  H04N19/184

CPC classification number: H04N19/436 ,  H04N19/127 ,  H04N19/14 ,  H04N19/184 ,  H04N19/40 ,  H04N19/85

Abstract: A system and method provides transcoding a video in parallel by multiple transcoders based on a measure of video coding complexity (VCC). The system has a video pre-processing module, a master transcoder, a transcoding controller and multiple transcoders. The video pre-processing module transcodes a source video into an intermediate video. The master transcoder partitions the intermediate video into multiple transcoding units, where a transcoding unit identifies a portion of data of the intermediate video for transcoding. The master transcoder further generates a transcoding request for each transcoding unit. The transcoding controller distributes the transcoding units to the multiple transcoders, which transcode the data of the transcoding units in parallel into transcoded data.

公开(公告)号：US20170223377A1

公开(公告)日：2017-08-03

申请号：US15011415

申请日：2016-01-29

Applicant: Google Inc.

Inventor： James Bankoski ,  Debargha Mukherjee ,  Yaowu Xu

IPC: H04N19/52 ,  H04N19/167 ,  H04N19/176 ,  H04N19/44

CPC classification number: H04N19/52 ,  H04N19/105 ,  H04N19/119 ,  H04N19/136 ,  H04N19/167 ,  H04N19/176 ,  H04N19/44 ,  H04N19/513

Abstract: Encoding or decoding a video signal includes determining a first partitioning of at least a portion of a frame before a current frame in a video sequence. The first partitioning is modified to a second partitioning using a motion vector that predicts at least one prediction sub-region of a first region from the first partitioning. The second partitioning is used to encode or decode a current region of the current frame. The current region may be collocated with the first region. The technique eliminates the need to re-partition an entire frame each time, and can be used with both rectangular-shaped block partitioning and partitioning using masks and other partitioning techniques.

公开(公告)号：US09681128B1

公开(公告)日：2017-06-13

申请号：US13755108

申请日：2013-01-31

Applicant: Google Inc.

Inventor： Jingning Han ,  Debargha Mukherjee

IPC: H04N19/50

CPC classification number: H04N19/00569 ,  H04N19/122 ,  H04N19/129 ,  H04N19/147 ,  H04N19/157 ,  H04N19/176 ,  H04N19/182

Abstract: Blocks of a frame of a video stream can be encoded using directional intra prediction modes followed by transforming the residual blocks. Coding efficiency can be improved by re-aligning pixels of a residual block before transformation to align the pixels of the block with the direction in which the prediction block for the original block was formed. Such an alignment can reduce the number of bits to be included in an encoded bitstream while maintaining the visual quality of the video stream by reducing the amount of structure or texture in the residual block that is not aligned with a horizontal or vertical axis.

公开(公告)号：US09661307B1

公开(公告)日：2017-05-23

申请号：US13632489

申请日：2012-10-01

Applicant: Google Inc.

Inventor： Debargha Mukherjee ,  Chen Wu ,  Yuchen Xie ,  Meng Wang

IPC: H04N13/02 ,  H04N7/18 ,  H04N13/00 ,  G06K9/00

CPC classification number: H04N13/261 ,  G06K9/00 ,  G06K9/00771 ,  G06T7/579 ,  H04N7/18 ,  H04N13/128 ,  H04N13/264

Abstract: An image converter identifies a subset of frames in a two-dimensional video and determines a global camera motion value for the subset of frames. The image converter also determines a dense motion value for a plurality of pixels in the subset of frames and compares the global camera motion value and the dense motion value to calculate a rough depth map for the subset of frames. The image converter further interpolates, based on the rough depth map, a depth value for each of the plurality of pixels in the subset of frames and renders a three-dimensional video from the subset of frames using the depth value for each of the plurality of pixels.

公开(公告)号：US09544597B1

公开(公告)日：2017-01-10

申请号：US13763921

申请日：2013-02-11

Applicant: Google Inc.

Inventor： Jingning Han ,  Debargha Mukherjee

IPC: H04N7/32 ,  H04N19/61 ,  H04N19/176

CPC classification number: H04N19/00781 ,  H04N19/157 ,  H04N19/176

Abstract: Blocks of a frame of a video stream can be encoded using intra prediction followed by transforming the generated residual blocks. In some cases, coding efficiency can be improved by subdividing large blocks into smaller sub-blocks. Transform modes may be associated with at least one intra prediction mode so as to identify one or more transform modes for the block or its sub-blocks. A scan mode can be identified based on the transform mode. Desirably, each of a plurality of probability models is associated with a transform mode and a block size such that the appropriate model(s) may be selected for a block or its sub-blocks. Each probability model may be associated with only one transform mode and only one block size or may be associated with more than one transform mode and/or more than one block size and may be updated on-the-fly during encoding of a video stream.

Abstract translation: 可以使用帧内预测对视频流的帧的块进行编码，然后变换所生成的残差块。 在某些情况下，通过将大块划分成更小的子块可以提高编码效率。 变换模式可以与至少一个帧内预测模式相关联，以便识别块或其子块的一个或多个变换模式。 可以基于变换模式来识别扫描模式。 期望地，多个概率模型中的每一个与变换模式和块大小相关联，使得可以为块或其子块选择适当的模型。 每个概率模型可以仅与一个变换模式相关联，并且仅与一个块大小相关联，或者可以与多于一个变换模式和/或多于一个块大小相关联，并且可以在编码视频流期间随时更新。

公开(公告)号：US09426449B2

公开(公告)日：2016-08-23

申请号：US14754365

申请日：2015-06-29

Applicant: Google Inc.

Inventor： Chen Wu ,  Debargha Mukherjee ,  Meng Wang

IPC: H04N13/00 ,  H04N15/00 ,  H04N13/02 ,  G06T7/00 ,  G06T7/20

CPC classification number: H04N13/261 ,  G06T7/20 ,  G06T7/55 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/20212

Abstract: A combined depth map is generated for a monoscopic image based on a weighted combination of a color depth map, a spatial depth map, and a motion depth map for the image, each describing the depth of pixels in the image relative to the image plane. The color depth map determines the depth of pixels according to their color, the spatial depth map determines the depth of pixels according to their location in the image, and the motion depth map determines the depth of pixels according to their motion in the image. Each of the depth maps is associated with a weight that is used to generate the weighted combination. The weights are adaptive to account for variation between different monoscopic images.

公开(公告)号：US09374578B1

公开(公告)日：2016-06-21

申请号：US13900592

申请日：2013-05-23

Applicant: Google Inc.

Inventor： Debargha Mukherjee ,  Paul Gordon Wilkins ,  Yaowu Xu

IPC: H04N19/176 ,  H04N19/50

CPC classification number: H04N19/00569 ,  H04N19/105 ,  H04N19/157 ,  H04N19/167 ,  H04N19/176 ,  H04N19/182

Abstract: Blocks of a video data stream may be encoded using either intra-frame (intra) prediction or inter-frame (inter) prediction. Combining intra and inter prediction can provide greater compression while maintaining the quality of the decoded video stream. Intra and inter prediction blocks are combined by weighting each block on a pixel-by-pixel basis and adding the weighted pixel values together. Weighting is based on the intra prediction mode. Pixels are weighted to give emphasis to intra predicted pixels closer to the boundaries where the predicted pixels originate and more emphasis to inter predicted pixels further away from the boundaries.

Abstract translation: 可以使用帧内（帧内）预测或帧间（帧间）预测来对视频数据流的块进行编码。 组合帧内和帧间预测可以在保持解码的视频流的质量的同时提供更大的压缩。 帧内和帧间预测块通过逐像素地对每个块进行加权而组合，并将加权像素值相加。 加权是基于帧内预测模式。 像素被加权以强调靠近预测像素起始的边界的帧内预测像素，并且更加强调进一步远离边界的帧间预测像素。