公开(公告)号：US20140184744A1

公开(公告)日：2014-07-03

申请号：US14239918

申请日：2011-08-26

Applicant: Shujie Liu ,  Wang Lin Lai ,  Dong Tian

Inventor： Shujie Liu ,  Wang Lin Lai ,  Dong Tian

IPC: H04N19/597 ,  H04N19/167

Abstract: Various implementations address depth coding and related disciplines. In one particular implementation, a segmentation is determined for a particular portion of a video image in a sequence of video images. The segmentation is determined based on reference depth indicators that are associated with at least a portion of one video image in the sequence of video images. Target depth indicators associated with the particular portion of the video image are processed. The processing is based on the determined segmentation in the particular portion of the video image. In another particular implementation, a segmentation is determined for at least a given portion of a video image based on depth indicators associated with the given portion. The segmentation is extended from the given portion into a target portion of the video image based on pixel values in the given portion and on pixel values in the target portion.

Abstract translation: 各种实现涉及深度编码和相关学科。 在一个特定实现中，为视频图像序列中的视频图像的特定部分确定分割。 基于与视频图像序列中的一个视频图像的至少一部分相关联的参考深度指示符来确定分割。 处理与视频图像的特定部分相关联的目标深度指示符。 该处理基于视频图像的特定部分中确定的分割。 在另一特定实现中，基于与给定部分相关联的深度指示符，确定视频图像的至少一个给定部分的分割。 基于给定部分中的像素值和目标部分中的像素值，将分割从给定部分扩展到视频图像的目标部分。

公开(公告)号：US20130176394A1

公开(公告)日：2013-07-11

申请号：US13822057

申请日：2011-08-31

Applicant: Dong Tian ,  Wang Lin Lai

Inventor： Dong Tian ,  Wang Lin Lai

IPC: H04N13/00

CPC classification number: H04N13/161 ,  H04N19/17 ,  H04N19/30 ,  H04N19/597 ,  H04N19/70

Abstract: Methods and apparatus for coding occlusion layers, such as occlusion video data and occlusion depth data in 3D video, are disclosed. A decoding method comprising the steps of: extracting an indicator representative of an original format for received occlusion data, the original format selected from one of a sparse occlusion data format and a filled occlusion data format; arranging 2D data, which is associated with the occlusion data, at location 0 in a reference picture list; decoding the occlusion data to produce decoded occlusion data; when the indicator indicates the sparse occlusion data format for the occlusion data, filling a non-occlusion area of the occlusion data with data indicative of a defined characteristic to produce decoded occlusion data; when the indicator indicates the filled occlusion data format for the occlusion data, replacing the occlusion data in a non-occlusion area of the occlusion data with sample values from a corresponding area of associated 2D data to produce decoded occlusion data; and outputting the decoded occlusion.

Abstract translation: 公开了用于编码遮挡层的方法和装置，例如3D视频中的遮挡视频数据和遮挡深度数据。 一种解码方法，包括以下步骤：提取表示接收到的遮挡数据的原始格式的指示符，从稀疏遮挡数据格式和填充遮挡数据格式之一中选择的原始格式; 在参考图片列表中的位置0处布置与遮挡数据相关联的2D数据; 解码遮挡数据以产生解码遮挡数据; 当指示符指示遮挡数据的稀疏遮挡数据格式时，用指示定义特征的数据填充遮挡数据的非遮挡区域以产生解码遮挡数据; 当指示符指示遮挡数据的填充遮挡数据格式时，用来自相关2D数据的相应区域的采样值替换遮挡数据的非遮挡区域中的遮挡数据，以产生解码遮挡数据; 并输出解码的遮挡。

公开(公告)号：US20120183078A1

公开(公告)日：2012-07-19

申请号：US13347589

申请日：2012-01-10

Applicant: Wang Lin Lai ,  Felix Carlos Fernandes

Inventor： Wang Lin Lai ,  Felix Carlos Fernandes

IPC: H04N7/26

CPC classification number: H04N19/82 ,  H04N19/117 ,  H04N19/147 ,  H04N19/182 ,  H04N19/46 ,  H04N19/593 ,  H04N19/61

Abstract: A method for processing video information by a video encoder includes classifying video information based on at least one local directional feature of the video information to design multiple filters. The encoder encodes filter coefficients of the multiple filters. The multiple filters are designed with symmetric constraints on the filter coefficients configured according to the classification of the video information based on at least one local directional feature of the video information. The method also includes applying, by the encoder, the multiple directional filters to the video information. A decoder is configured to decode filter coefficients of multiple filters and apply the multiple filters to the video information. The decoder constructs, from decoded filter coefficients, multiple filters with symmetric constraints on the filter coefficients configured according to the classification of the video information based on at least one local directional feature of the video information.

Abstract translation: 通过视频编码器处理视频信息的方法包括基于视频信息的至少一个局部方向特征对视频信息进行分类，以设计多个滤波器。 编码器对多个滤波器的滤波器系数进行编码。 多个滤波器被设计成对基于视频信息的至少一个局部方向特征的根据视频信息的分类配置的滤波器系数具有对称约束。 该方法还包括由编码器将多个方向滤波器应用于视频信息。 解码器被配置为对多个滤波器的滤波器系数进行解码，并将多个滤波器应用于视频信息。 解码器根据解码的滤波器系数，根据基于视频信息的至少一个本地方向特征的视频信息的分类，对对滤波器系数进行对称约束的多个滤波器构成。

公开(公告)号：US20120056981A1

公开(公告)日：2012-03-08

申请号：US13318418

申请日：2010-04-30

Applicant: Dong Tian ,  Wang Lin Lai

Inventor： Dong Tian ,  Wang Lin Lai

IPC: H04N7/32 ,  H04N13/00

CPC classification number: H04N19/30 ,  H04N19/597 ,  H04N19/70

Abstract: Various implementations are directed to providing inter-layer dependency information. In one implementation, syntax elements are generated that indicate an inter-layer dependency structure among three-dimensional video (3DV) layers. Based on the inter-layer dependency structure, an inter-layer reference is identified for a picture from a layer of the 3DV layers. The picture is encoded based, at least in part, on the inter-layer reference. Corresponding decoding implementations are also provided. Additionally, in another implementation, a transmission priority and an indication of network congestion are used to determine whether to transmit data for a particular 3DV layer. The transmission priority is based on an inter-layer dependency structure among multiple 3DV layers. Another implementation is directed to a network abstraction layer unit that can explicitly identify and convey inter-layer references and corresponding dependencies.

Abstract translation: 各种实现涉及提供层间依赖信息。 在一个实现中，生成指示三维视频（3DV）层之间的层间依赖结构的语法元素。 基于层间依赖结构，从3DV层的图层中识别出图层的层间参考。 该图片至少部分地基于层间参考进行编码。 还提供了相应的解码实现。 另外，在另一实现中，使用传输优先级和网络拥塞指示来确定是否传输特定3DV层的数据。 传输优先级基于多个3DV层之间的层间依赖结构。 另一种实施方式涉及可以明确地识别和传送层间引用和相应依赖性的网络抽象层单元。

公开(公告)号：US10462475B2

公开(公告)日：2019-10-29

申请号：US15534534

申请日：2015-12-16

Applicant: Shan Liu ,  Jing Ye ,  Xiaozhong Xu ,  Jungsun Kim ,  Wang-Lin Lai ,  Shaw-Min Lei

Inventor： Shan Liu ,  Jing Ye ,  Xiaozhong Xu ,  Jungsun Kim ,  Wang-Lin Lai ,  Shaw-Min Lei

IPC: G06K9/36 ,  H04N19/186 ,  H04N19/70 ,  H04N19/593 ,  H04N19/103 ,  H04N19/119 ,  H04N19/59 ,  H04N11/00

Abstract: A method of video coding using palette coding mode for color video in a non-444 color format is disclosed. The non-444 video data can be converted to the 444 format so that the palette designed for the 444 format can be used for the non-444 video data. For the 4:2:0 color format, each chroma sample collocated with corresponding quad luma samples is padded with three chroma samples to form converted quad chroma samples. For the 4:2:0 color format, if a current pixel does not belong to the color palette, one or more escape values are signaled for the current pixel and the escape value associated with the chroma sample of the current pixel for each color component is not signaled for three of the quad chroma sample locations collocated with corresponding quad luma samples.

公开(公告)号：US09883161B2

公开(公告)日：2018-01-30

申请号：US13822031

申请日：2011-08-31

Applicant: Dong Tian ,  Wang Lin Lai

Inventor： Dong Tian ,  Wang Lin Lai

IPC: H04N13/00 ,  H04N19/597 ,  H04N19/70 ,  H04N19/30 ,  H04N19/17

CPC classification number: H04N13/161 ,  H04N19/17 ,  H04N19/30 ,  H04N19/597 ,  H04N19/70

Abstract: Methods and apparatuses for coding occlusion layers, such as occlusion video data and occlusion depth data in 3D video, are disclosed. A decoding method comprising the steps of: extracting an indicator representative of an original format for received occlusion data, the original format selected from one of a sparse occlusion data format and a filled occlusion data format; decoding the received occlusion data to produce decoded occlusion data; and when the indicator indicates the original format as a filled occlusion data format, converting the decoded occlusion data from a sparse occlusion data format to the filled occlusion data format, the converting further including; replacing non-occlusion area data, which is represented with a defined characteristic, by respective collocated samples from 2D data in the video data frame associated with the occlusion data; outputting the decoded occlusion data and, when present, converted decoded occlusion data.

公开(公告)号：US09485492B2

公开(公告)日：2016-11-01

申请号：US13822057

申请日：2011-08-31

Applicant: Dong Tian ,  Wang Lin Lai

Inventor： Dong Tian ,  Wang Lin Lai

IPC: H04N13/00 ,  H04N11/04 ,  H04N19/597 ,  H04N19/70 ,  H04N19/30 ,  H04N19/17

CPC classification number: H04N13/161 ,  H04N19/17 ,  H04N19/30 ,  H04N19/597 ,  H04N19/70

Abstract: Methods and apparatus for coding occlusion layers, such as occlusion video data and occlusion depth data in 3D video, are disclosed. A decoding method comprising the steps of: extracting an indicator representative of an original format for received occlusion data, the original format selected from one of a sparse occlusion data format and a filled occlusion data format; arranging 2D data, which is associated with the occlusion data, at location 0 in a reference picture list; decoding the occlusion data to produce decoded occlusion data; when the indicator indicates the sparse occlusion data format for the occlusion data, filling a non-occlusion area of the occlusion data with data indicative of a defined characteristic to produce decoded occlusion data; when the indicator indicates the filled occlusion data format for the occlusion data, replacing the occlusion data in a non-occlusion area of the occlusion data with sample values from a corresponding area of associated 2D data to produce decoded occlusion data; and outputting the decoded occlusion.

Abstract translation: 公开了用于编码遮挡层的方法和装置，例如3D视频中的遮挡视频数据和遮挡深度数据。 一种解码方法，包括以下步骤：提取表示接收到的遮挡数据的原始格式的指示符，从稀疏遮挡数据格式和填充遮挡数据格式之一中选择的原始格式; 在参考图片列表中的位置0处布置与遮挡数据相关联的2D数据; 解码遮挡数据以产生解码遮挡数据; 当指示符指示遮挡数据的稀疏遮挡数据格式时，用指示定义特征的数据填充遮挡数据的非遮挡区域以产生解码遮挡数据; 当指示符指示遮挡数据的填充遮挡数据格式时，用来自相关2D数据的相应区域的采样值替换遮挡数据的非遮挡区域中的遮挡数据，以产生解码遮挡数据; 并输出解码的遮挡。

公开(公告)号：US20160316213A1

公开(公告)日：2016-10-27

申请号：US15104654

申请日：2014-12-05

Applicant: Wang-Lin LAI ,  Shan LIU ,  Tzu-Der CHUANG ,  Xiaozhong XU ,  Jing YE

Inventor： Wang-Lin LAI ,  Shan LIU ,  Tzu-Der CHUANG ,  Xiaozhong XU ,  Jing YE

IPC: H04N19/186 ,  H04N19/115 ,  H04N19/167 ,  H04N19/176

Abstract: A method and apparatus for palette prediction and sharing according to the present invention are disclosed. A method incorporating an embodiment of the present invention determines one or more palette sharing flags for the current block. A set of current palettes corresponding to the set of color components is generated according to the palette sharing flags. If a first palette sharing flag is asserted, one or more current palettes indicated by the first palette sharing flag are copied entirely from one or more reference palettes of a set of reference palettes. If the first palette sharing flag is not asserted, one or more current palettes indicated by the first palette sharing flag are derived from a bitstream associated with the video data. Encoding or decoding is then applied to the current block according to the set of current palettes.

Abstract translation: 公开了一种根据本发明的调色板预测和共享的方法和装置。 结合本发明实施例的方法确定当前块的一个或多个调色板共享标志。 根据调色板共享标志生成与该组颜色分量对应的一组当前调色板。 如果第一调色板共享标志被断言，则由第一调色板共享标志指示的一个或多个当前调色板完全从一组参考调色板的一个或多个参考调色板复制。 如果第一调色板共享标志未被确认，则由与第一调色板共享标志指示的一个或多个当前调色板从与视频数据相关联的比特流导出。 然后根据当前调色板的集合将编码或解码应用于当前块。

公开(公告)号：US20130162773A1

公开(公告)日：2013-06-27

申请号：US13822031

申请日：2011-08-31

Applicant: Dong Tian ,  Wang Lin Lai

Inventor： Dong Tian ,  Wang Lin Lai

IPC: H04N13/00

CPC classification number: H04N13/161 ,  H04N19/17 ,  H04N19/30 ,  H04N19/597 ,  H04N19/70

Abstract: Methods and apparatuses for coding occlusion layers, such as occlusion video data and occlusion depth data in 3D video, are disclosed. A decoding method comprising the steps of: extracting an indicator representative of an original format for received occlusion data , the original format selected from one of a sparse occlusion data format and a filled occlusion data format; decoding the received occlusion data to produce decoded occlusion data ; and when the indicator indicates the original format as a filled occlusion data format, converting the decoded occlusion data from a sparse occlusion data format to the filled occlusion data format , the converting further including; replacing non-occlusion area data, which is represented with a defined characteristic, by respective collocated samples from 2D data in the video data frame associated with the occlusion data ; outputting the decoded occlusion data and, when present, converted decoded occlusion data .

Abstract translation: 公开了用于编码遮挡层的方法和装置，例如3D视频中的遮挡视频数据和遮挡深度数据。 一种解码方法，包括以下步骤：提取表示接收到的遮挡数据的原始格式的指示符，从稀疏遮挡数据格式和填充遮挡数据格式之一中选择的原始格式; 解码所接收的遮挡数据以产生解码的遮挡数据; 并且当所述指示符指示原始格式为填充遮挡数据格式时，将解码的遮挡数据从稀疏遮挡数据格式转换为填充遮挡数据格式，所述转换还包括： 通过来自与遮挡数据相关联的视频数据帧中的2D数据的相应并置采样来替换用定义的特征表示的非遮挡区域数据; 输出解码的遮挡数据，当存在时，转换解码的遮挡数据。

公开(公告)号：US20120044322A1

公开(公告)日：2012-02-23

申请号：US13138956

申请日：2010-04-30

Applicant: Dong Tian ,  Wang Lin Lai

Inventor： Dong Tian ,  Wang Lin Lai

IPC: H04N13/00

CPC classification number: H04N19/30 ,  H04N19/597 ,  H04N19/70

Abstract: Several implementations relate to 3D video (3DV) coding formats. One implementation encodes multiple pictures that describe different three-dimensional (3D) information for a given view at a given time. Syntax elements are generated that indicate, for the encoded multiple pictures, how the encoded picture fits into a structure that supports 3D processing. The structure defines content types for the multiple pictures. A bitstream is generated that includes the encoded multiple pictures and the syntax elements. The inclusion of the syntax elements provides, at a coded-bitstream level, indications of relationships between the encoded multiple pictures in the structure. The syntax elements also enable efficient inter-layer coding of the 3DV content, thereby reducing the bandwidth used to transmit the 3DV content. Corresponding decoding implementations are also provided. Extraction methods are also provided from extracting pictures of interest from such a 3DV multiple pictures and the syntax elements, the video stream characterized by such a 3D structure.

Abstract translation: 几个实现涉及3D视频（3DV）编码格式。 一个实现对给定视图在给定时间描述不同三维（3D）信息的多个图像进行编码。 生成语法元素，为编码的多个图像指示编码图像如何适应于支持3D处理的结构。 该结构定义了多张图片的内容类型。 生成包括编码的多个图像和语法元素的比特流。 语法元素的包括在编码比特流级别提供结构中编码的多个图像之间的关系的指示。 语法元素还能够实现3DV内容的有效的层间编码，从而减少用于传输3DV内容的带宽。 还提供了相应的解码实现。 从这样的3DV多画面中提取感兴趣的图像和语法元素也提供了提取方法，即以这种3D结构为特征的视频流。