公开(公告)号：US20130279589A1

公开(公告)日：2013-10-24

申请号：US13865242

申请日：2013-04-18

Applicant: GOOGLE INC.

Inventor： Qunshan Gu ,  Marco Paniconi

IPC: H04N7/26

CPC classification number: H04N19/573 ,  H04L65/607 ,  H04N19/00 ,  H04N19/52 ,  H04N21/234 ,  H04N21/23406 ,  H04N21/44004 ,  H04N21/8451

Abstract: Encoding and decoding is accomplished herein using a multi-reference picture buffer. Reference frames are assigned to reference picture buffers when used for encoding and are identified with picture IDs unique relative to other picture IDs currently associated with the reference picture buffers. The maximum picture number used as the picture ID can be based on a number of reference picture buffers available to encode and decode the frames plus a value based on an expected error rate. The picture IDs can be assigned based on a least recently used policy. When a reference frame is no longer needed for encoding and decoding, a picture ID number associated with the reference frame can be released for re-assignment to a new reference frame.

Abstract translation: 这里使用多参考图像缓冲器来完成编码和解码。 当用于编码时，参考帧被分配给参考图像缓冲器，并且被识别为与当前与参考图像缓冲器相关联的其它图像ID相对于唯一的图像ID。 用作图像ID的最大图像编号可以基于可用于编码和解码帧的参考图像缓冲器的数量加上基于预期误码率的值。 可以基于最近最少使用的策略来分配图片ID。 当编码和解码不再需要参考帧时，可以释放与参考帧相关联的图像ID号，以重新分配给新的参考帧。

公开(公告)号：US09693066B1

公开(公告)日：2017-06-27

申请号：US15193284

申请日：2016-06-27

Applicant: Google Inc.

Inventor： Marco Paniconi ,  Qunshan Gu

IPC: H04N7/26 ,  H04N19/00 ,  H04N19/17 ,  H04N19/44 ,  H04N19/169 ,  H04N19/593

CPC classification number: H04N19/17 ,  H04N19/00 ,  H04N19/119 ,  H04N19/14 ,  H04N19/169 ,  H04N19/176 ,  H04N19/20 ,  H04N19/44 ,  H04N19/593

Abstract: Object-based intra-prediction decoding may include generating a reconstructed block by decoding an encoded block, which may include identifying a first intra-prediction mode for a first portion of the reconstructed block and identifying a second intra-prediction mode for a second portion of the reconstructed block. Decoding the encoded block may include generating a first portion of a prediction block using the first intra-prediction mode, generating a second portion of the prediction block using the second intra-prediction mode, generating the first portion of the reconstructed block based on the first portion of the prediction block, such that the first portion of the reconstructed block corresponds to a first object represented in the reconstructed block, and generating the second portion of the reconstructed block based on the second portion of the prediction block, such that the second portion of the reconstructed block corresponds to a second object represented in the reconstructed block.

公开(公告)号：US09609341B1

公开(公告)日：2017-03-28

申请号：US13865250

申请日：2013-04-18

Applicant: Google Inc.

Inventor： Qunshan Gu ,  Marco Paniconi

IPC: H04N19/46 ,  H04N19/91

CPC classification number: H04N19/46 ,  H04N19/573 ,  H04N19/61 ,  H04N19/70 ,  H04N19/91

Abstract: Encoding and decoding is accomplished herein using a reference picture list. Reference frames are identified with picture numbers and are assigned to reference picture buffers when used for encoding. The picture numbers associated the reference frames in the reference picture buffers are ranked. Reordering can occur to assign short word lengths to those reference frames used frequently for prediction. The resulting encoded reference picture list is sent to a decoder. The decoder decodes the reference picture list. By comparing picture numbers in the reference picture list with picture numbers of reference picture buffers of the decoder, the encoder and decoder buffers can remain in sync even under packet loss conditions. For example, the decoder can use the decoded reference picture list to determine missing and unused reference frames.

公开(公告)号：US10511846B1

公开(公告)日：2019-12-17

申请号：US15254723

申请日：2016-09-01

Applicant: GOOGLE INC.

Inventor： Jing Chen ,  Marco Paniconi ,  Michael Horowitz

IPC: H04N19/117 ,  H04N19/137 ,  H04N19/36 ,  H04L12/801 ,  H04N19/14 ,  H04N19/176 ,  H04N19/172 ,  H04N19/182

Abstract: A method and apparatus for adaptive denoising of source video in a video conference application is provided. Source video frames received from a video capture device are divided into a plurality of 16×16 blocks. For each source block, a moving object detection process and a noise estimation process are performed. Then temporal denoising is adaptively applied to the blocks of the source frame based on the noise estimation and moving object detection. The adaptively filtered blocks are provided to an output frame and forwarded to a coding module for encoding.

公开(公告)号：US09094663B1

公开(公告)日：2015-07-28

申请号：US14319491

申请日：2014-06-30

Applicant: Google Inc.

Inventor： Marco Paniconi ,  Ermin Kozica

IPC: H04N7/26 ,  H04N19/169 ,  H04N19/164 ,  H04N19/196 ,  H04N19/115

CPC classification number: H04N19/196 ,  H04N19/115 ,  H04N19/137 ,  H04N19/14 ,  H04N19/164 ,  H04N19/166 ,  H04N19/174 ,  H04N19/188

Abstract: Adaptive media optimization is described. Aspects of the invention modify video encoding and network transmission settings to optimize the user viewing experience. The system and method sample video content to determine various content features of the video. The system and method use the identified content features in conjunction with network statistics to modify encoding settings and network transmission options to ensure a minimum of interruption in the transmitted video. Previously generated lookup tables ensure efficient mapping of video content and network conditions to encoding and transmission settings.

Abstract translation: 描述了自适应介质优化。 本发明的方面修改视频编码和网络传输设置以优化用户观看体验。 系统和方法采样视频内容来确定视频的各种内容功能。 系统和方法使用所识别的内容特征与网络统计结合来修改编码设置和网络传输选项，以确保传输视频中的最少中断。 以前生成的查找表确保将视频内容和网络条件有效映射到编码和传输设置。

公开(公告)号：US10049436B1

公开(公告)日：2018-08-14

申请号：US15232212

申请日：2016-08-09

Applicant: GOOGLE INC.

Inventor： Jing Chen ,  Marco Paniconi

IPC: H04N7/15 ,  G06T5/00 ,  H04N7/14

Abstract: A method and apparatus for adaptive denoising of source video in a video conference application is provided. Video captured is analyzed on a frame by frame basis to determine whether denoising of the frame should be performed prior to providing the source frame to an encoder. If the frame is to be denoised, the frame is divided into a plurality of blocks and a local denoising process is performed on a block per block basis.

公开(公告)号：US09894381B1

公开(公告)日：2018-02-13

申请号：US15218229

申请日：2016-07-25

Applicant: GOOGLE INC.

Inventor： Qunshan Gu ,  Marco Paniconi

IPC: H04N11/02 ,  H04N19/573 ,  H04N19/52 ,  H04L29/06 ,  H04N21/234 ,  H04N21/44 ,  H04N21/845

CPC classification number: H04N19/573 ,  H04L65/607 ,  H04N19/00 ,  H04N19/52 ,  H04N21/234 ,  H04N21/23406 ,  H04N21/44004 ,  H04N21/8451

Abstract: Encoding and decoding is accomplished herein using a multi-reference picture buffer. Decoding includes receiving an encoded video stream, determining an expected error value representing possible frame errors, decoding a plurality of reference frames from the video stream, adding each of the plurality of reference frames to the reference picture buffers up to a maximum number of reference picture buffers, and determining an encoded video stream error value representing actual frame errors based on the decoded plurality of reference frames. If the encoded video stream error value is greater than the decoded expected error value, an error is signaled.

公开(公告)号：US20170280142A1

公开(公告)日：2017-09-28

申请号：US15618517

申请日：2017-06-09

Applicant: GOOGLE INC.

Inventor： Marco Paniconi ,  Qunshan Gu

IPC: H04N19/17 ,  H04N19/169 ,  H04N19/44 ,  H04N19/593

Abstract: Object-based intra-prediction encoding may include generating, by a processor in response to instructions stored on a non-transitory computer readable medium, an encoded block of a current frame of a video stream by encoding a current block from the current frame, including the encoded block in an output bitstream, and outputting or storing the output bitstream. Encoding the current block may include identifying a first spatial portion of the current block, wherein the first spatial portion includes a first pixel from the current block and omits a second pixel from the current block, encoding the first pixel using a first intra-prediction mode, and encoding the second pixel using a second intra-prediction mode, wherein the second intra-prediction mode differs from the first intra-prediction mode.

公开(公告)号：US20170063497A1

公开(公告)日：2017-03-02

申请号：US15344629

申请日：2016-11-07

Applicant: GOOGLE INC.

Inventor： Marco Paniconi ,  Mikhal Shemer

IPC: H04L1/08 ,  H04L12/801 ,  H04L29/06

CPC classification number: H04L1/08 ,  H03M13/353 ,  H03M13/356 ,  H03M13/373 ,  H03M13/6306 ,  H04L1/18 ,  H04L47/34 ,  H04L69/22

Abstract: A method for decoding a packetized video signal including at least one encoded frame. In one case, the method includes receiving at least one FEC packet at a receiving station. The receiving station uses embedded data associated with the FEC packet to obtain more accurate knowledge of the packet loss state of the media packets. This improved knowledge can allow the receiver to make better use of packet retransmission requests. The embedded data associated with the FEC packet can include in some cases a base sequence number and a packet mask.

Abstract translation: 一种用于对包括至少一个编码帧的分组化视频信号进行解码的方法。 在一种情况下，该方法包括在接收站处接收至少一个FEC分组。 接收站使用与FEC分组相关联的嵌入数据来获得关于媒体分组的分组丢失状态的更准确的知识。 这种改进的知识可以允许接收机更好地利用分组重传请求。 与FEC分组相关联的嵌入数据在一些情况下可以包括基本序列号和分组掩码。

公开(公告)号：US09426459B2

公开(公告)日：2016-08-23

申请号：US13865242

申请日：2013-04-18

Applicant: Google Inc.

Inventor： Qunshan Gu ,  Marco Paniconi

IPC: H04N19/00 ,  H04N21/234 ,  H04N21/44 ,  H04N21/845

CPC classification number: H04N19/573 ,  H04L65/607 ,  H04N19/00 ,  H04N19/52 ,  H04N21/234 ,  H04N21/23406 ,  H04N21/44004 ,  H04N21/8451

Abstract: Encoding and decoding is accomplished herein using a multi-reference picture buffer. Reference frames are assigned to reference picture buffers when used for encoding and are identified with picture IDs unique relative to other picture IDs currently associated with the reference picture buffers. The maximum picture number used as the picture ID can be based on a number of reference picture buffers available to encode and decode the frames plus a value based on an expected error rate. The picture IDs can be assigned based on a least recently used policy. When a reference frame is no longer needed for encoding and decoding, a picture ID number associated with the reference frame can be released for re-assignment to a new reference frame.

Abstract translation: 这里使用多参考图像缓冲器来完成编码和解码。 当用于编码时，参考帧被分配给参考图像缓冲器，并且被识别为与当前与参考图像缓冲器相关联的其它图像ID相对于唯一的图像ID。 用作图像ID的最大图像编号可以基于可用于编码和解码帧的参考图像缓冲器的数量加上基于预期误码率的值。 可以基于最近最少使用的策略来分配图片ID。 当编码和解码不再需要参考帧时，可以释放与参考帧相关联的图像ID号，以重新分配给新的参考帧。