公开(公告)号：US08380011B2

公开(公告)日：2013-02-19

申请号：US12241106

申请日：2008-09-30

申请人： Yonghua Zhang ,  Zhiwei Xiong ,  Feng Wu

发明人： Yonghua Zhang ,  Zhiwei Xiong ,  Feng Wu

IPC分类号： G06K9/32

CPC分类号： G06T3/403

摘要： Described is a technology in which a low resolution image is processed into a high-resolution image, including by a two interpolation passes. In the first pass, missing in-block pixels, which are the pixels within a block formed by four neighboring original pixels, are given values by gradient diffusion based upon interpolation of the surrounding original pixels. In the second interpolation pass, missing on-block pixels, which are the pixels on a block edge formed by two adjacent original pixels, are given values by gradient diffusion based upon interpolation of the values of those adjacent original pixels and the previously interpolated values of their adjacent in-block pixels. Also described is a difference projection process that varies the values of the interpolated pixels according to a computed difference projection.

摘要翻译： 描述了一种技术，其中低分辨率图像被处理成高分辨率图像，包括通过两次内插遍。 在第一次通过中，通过基于周围的原始像素的内插的梯度扩散来给出由四个相邻原始像素形成的块内的像素丢失的块内像素的缺失值。 在第二插值遍中，由两个相邻的原始像素形成的块边缘上的像素的缺失的块上像素通过基于相邻原始像素的值的内插和先前的内插值 它们相邻的块内像素。 还描述了根据计算的差异投影来改变内插像素的值的差分投影处理。

公开(公告)号：US20080112626A1

公开(公告)日：2008-05-15

申请号：US11558755

申请日：2006-11-10

申请人： Xiaoyan Sun ,  Feng Wu ,  Zhiwei Xiong ,  Shipeng Li

发明人： Xiaoyan Sun ,  Feng Wu ,  Zhiwei Xiong ,  Shipeng Li

IPC分类号： G06K9/36

CPC分类号： H04N19/17 ,  G06K9/0008 ,  G06K9/00744 ,  G06T9/00 ,  H04N19/134

摘要： Systems and methods provide image compression based on parameter-assisted inpainting. In one implementation of an encoder, an image is partitioned into blocks and the blocks classified as smooth or unsmooth, based on the degree of visual edge content and chromatic variation in each block. Image content of the unsmooth blocks is compressed, while image content of the smooth blocks is summarized by parameters, but not compressed. The parameters, once obtained, may also be compressed. At a decoders the compressed image content of the unsmooth blocks and the compressed parameters of the smooth blocks are each decompressed. Each smooth block is then reconstructed by inpainting, guided by the parameters in order to impart visual detail from the original image that cannot be implied from the image content of neighboring blocks that have been decoded.

摘要翻译： 系统和方法提供基于参数辅助修复的图像压缩。 在编码器的一个实现中，基于每个块中的视觉边缘内容的程度和色度变化，将图像划分为块，并将块分类为平滑或不平滑。 不平滑块的图像内容被压缩，而平滑块的图像内容由参数汇总，但不被压缩。 一旦获得的参数也可以被压缩。 在解码器处，解压缩不平滑块的压缩图像内容和平滑块的压缩参数。 然后通过修饰重建每个平滑块，由参数引导，以便从原始图像传递不能从已经解码的相邻块的图像内容中隐含的视觉细节。

公开(公告)号：US08896594B2

公开(公告)日：2014-11-25

申请号：US13539362

申请日：2012-06-30

申请人： Zhiwei Xiong ,  Feng Wu ,  Yueyi Zhang ,  Pengyu Cong

发明人： Zhiwei Xiong ,  Feng Wu ,  Yueyi Zhang ,  Pengyu Cong

IPC分类号： G06T15/00

CPC分类号： G01B11/2513 ,  H04N13/271

摘要： An adaptive depth sensing system (ADSS) illuminates a scene with a pattern that is constructed based on an analysis of at least one prior-generated depth map. In one implementation, the pattern is a composite pattern that includes two or more component patterns associated with different depth regions in the depth map. The composite pattern may also include different illumination intensities associated with the different depth regions. By using this composite pattern, the ADSS can illuminate different objects in a scene with different component patterns and different illumination intensities, where those objects are located at different depths in the scene. This process, in turn, can reduce the occurrence of defocus blur, underexposure, and overexposure in the image information.

摘要翻译： 自适应深度感测系统（ADSS）利用基于至少一个先前生成的深度图的分析构建的图案来照亮场景。 在一个实现中，该图案是包括与深度图中的不同深度区域相关联的两个或多个分量图案的复合图案。 复合图案还可以包括与不同深度区域相关联的不同照明强度。 通过使用这种复合图案，ADSS可以照亮具有不同组件图案和不同照明强度的场景中的不同对象，其中这些对象位于场景中的不同深度。 这个过程又可以减少图像信息中散焦模糊，曝光不足和过度曝光的发生。

公开(公告)号：US08787443B2

公开(公告)日：2014-07-22

申请号：US12924836

申请日：2010-10-05

申请人： Xiaoyan Sun ,  Zhiwei Xiong ,  Feng Wu

发明人： Xiaoyan Sun ,  Zhiwei Xiong ,  Feng Wu

IPC分类号： H04B1/66 ,  H04N7/26

CPC分类号： H04N19/00909 ,  H04N19/117 ,  H04N19/14 ,  H04N19/176 ,  H04N19/51 ,  H04N19/80 ,  H04N19/86

摘要： Disclosed herein are exemplary embodiments of methods, apparatus, and systems for performing content-adaptive deblocking to improve the visual quality of video images compressed using block-based motion-predictive video coding. For instance, in certain embodiments of the disclosed technology, edge information is obtained using global orientation energy edge detection (“OEED”) techniques on an initially deblocked image. OEED detection can provide a robust partition of local directional features (“LDFs”). For a local directional feature detected in the partition, a directional deblocking filter having an orientation corresponding to the orientation of the LDF can be used. The selected filter can have a filter orientation and activation thresholds that better preserve image details while reducing blocking artifacts. In certain embodiments, for a consecutive non-LDF region, extra smoothing can be imposed to suppress the visually severe blocking artifacts.

摘要翻译： 这里公开了用于执行内容自适应解块以改善使用基于块的运动预测视频编码压缩的视频图像的视觉质量的方法，装置和系统的示例性实施例。 例如，在所公开的技术的某些实施例中，边缘信息是使用最初去块图像上的全局取向能量边缘检测（“OEED”）技术获得的。 OEED检测可以提供局部方向特征（“LDFs”）的鲁棒分区。 对于在分区中检测到的局部方向特征，可以使用具有与LDF的取向对应的取向的定向去块滤波器。 所选择的过滤器可以具有过滤器方向和激活阈值，以更好地保留图像细节，同时减少块伪影。 在某些实施例中，对于连续的非LDF区域，可以施加额外的平滑来抑制视觉上严重的块状伪影。

公开(公告)号：US20120082219A1

公开(公告)日：2012-04-05

申请号：US12924836

申请日：2010-10-05

申请人： Xiaoyan Sun ,  Zhiwei Xiong ,  Feng Wu

发明人： Xiaoyan Sun ,  Zhiwei Xiong ,  Feng Wu

IPC分类号： H04N7/32

CPC分类号： H04N19/00909 ,  H04N19/117 ,  H04N19/14 ,  H04N19/176 ,  H04N19/51 ,  H04N19/80 ,  H04N19/86

摘要： Disclosed herein are exemplary embodiments of methods, apparatus, and systems for performing content-adaptive deblocking to improve the visual quality of video images compressed using block-based motion-predictive video coding. For instance, in certain embodiments of the disclosed technology, edge information is obtained using global orientation energy edge detection (“OEED”) techniques on an initially deblocked image. OEED detection can provide a robust partition of local directional features (“LDFs”). For a local directional feature detected in the partition, a directional deblocking filter having an orientation corresponding to the orientation of the LDF can be used. The selected filter can have a filter orientation and activation thresholds that better preserve image details while reducing blocking artifacts. In certain embodiments, for a consecutive non-LDF region, extra smoothing can be imposed to suppress the visually severe blocking artifacts.

摘要翻译： 这里公开了用于执行内容自适应解块以改善使用基于块的运动预测视频编码压缩的视频图像的视觉质量的方法，装置和系统的示例性实施例。 例如，在所公开的技术的某些实施例中，边缘信息是使用最初去块图像上的全局取向能量边缘检测（“OEED”）技术获得的。 OEED检测可以提供局部方向特征（“LDFs”）的鲁棒分区。 对于在分区中检测到的局部方向特征，可以使用具有与LDF的取向对应的取向的定向去块滤波器。 所选择的过滤器可以具有过滤器方向和激活阈值，以更好地保留图像细节，同时减少块伪影。 在某些实施例中，对于连续的非LDF区域，可以施加额外的平滑来抑制视觉上严重的块状伪影。

公开(公告)号：US20140002445A1

公开(公告)日：2014-01-02

申请号：US13539362

申请日：2012-06-30

申请人： Zhiwei Xiong ,  Feng Wu ,  Yueyi Zhang ,  Pengyu Cong

发明人： Zhiwei Xiong ,  Feng Wu ,  Yueyi Zhang ,  Pengyu Cong

IPC分类号： G06T15/00

CPC分类号： G01B11/2513 ,  H04N13/271

摘要： An adaptive depth sensing system (ADSS) illuminates a scene with a pattern that is constructed based on an analysis of at least one prior-generated depth map. In one implementation, the pattern is a composite pattern that includes two or more component patterns associated with different depth regions in the depth map. The composite pattern may also include different illumination intensities associated with the different depth regions. By using this composite pattern, the ADSS can illuminate different objects in a scene with different component patterns and different illumination intensities, where those objects are located at different depths in the scene. This process, in turn, can reduce the occurrence of defocus blur, underexposure, and overexposure in the image information.

摘要翻译： 自适应深度感测系统（ADSS）利用基于至少一个先前生成的深度图的分析构建的图案来照亮场景。 在一个实现中，该图案是包括与深度图中的不同深度区域相关联的两个或多个分量图案的复合图案。 复合图案还可以包括与不同深度区域相关联的不同照明强度。 通过使用这种复合图案，ADSS可以照亮具有不同组件图案和不同照明强度的场景中的不同对象，其中这些对象位于场景中的不同深度。 这个过程又可以减少图像信息中散焦模糊，曝光不足和过度曝光的发生。

公开(公告)号：US08311347B2

公开(公告)日：2012-11-13

申请号：US11558755

申请日：2006-11-10

申请人： Xiaoyan Sun ,  Feng Wu ,  Zhiwei Xiong ,  Shipeng Li

发明人： Xiaoyan Sun ,  Feng Wu ,  Zhiwei Xiong ,  Shipeng Li

IPC分类号： G06K9/36 ,  G06K9/46

CPC分类号： H04N19/17 ,  G06K9/0008 ,  G06K9/00744 ,  G06T9/00 ,  H04N19/134

摘要： Systems and methods provide image compression based on parameter-assisted inpainting. In one implementation of an encoder, an image is partitioned into blocks and the blocks classified as smooth or unsmooth, based on the degree of visual edge content and chromatic variation in each block. Image content of the unsmooth blocks is compressed, while image content of the smooth blocks is summarized by parameters, but not compressed. The parameters, once obtained, may also be compressed. At a decoder, the compressed image content of the unsmooth blocks and the compressed parameters of the smooth blocks are each decompressed. Each smooth block is then reconstructed by inpainting, guided by the parameters in order to impart visual detail from the original image that cannot be implied from the image content of neighboring blocks that have been decoded.

摘要翻译： 系统和方法提供基于参数辅助修复的图像压缩。 在编码器的一个实现中，基于每个块中的视觉边缘内容的程度和色度变化，将图像划分为块，并将块分类为平滑或不平滑。 不平滑块的图像内容被压缩，而平滑块的图像内容由参数汇总，但不被压缩。 一旦获得的参数也可以被压缩。 在解码器处，解压缩不平滑块的压缩图像内容和平滑块的压缩参数。 然后通过修饰重建每个平滑块，由参数引导，以便从原始图像传递不能从已经被解码的相邻块的图像内容中隐含的视觉细节。

公开(公告)号：US20100080488A1

公开(公告)日：2010-04-01

申请号：US12241106

申请日：2008-09-30

申请人： Yonghua Zhang ,  Zhiwei Xiong ,  Feng Wu

发明人： Yonghua Zhang ,  Zhiwei Xiong ,  Feng Wu

IPC分类号： G06K9/54

CPC分类号： G06T3/403

摘要： Described is a technology in which a low resolution image is processed into a high-resolution image, including by a two interpolation passes. In the first pass, missing in-block pixels, which are the pixels within a block formed by four neighboring original pixels, are given values by gradient diffusion based upon interpolation of the surrounding original pixels. In the second interpolation pass, missing on-block pixels, which are the pixels on a block edge formed by two adjacent original pixels, are given values by gradient diffusion based upon interpolation of the values of those adjacent original pixels and the previously interpolated values of their adjacent in-block pixels. Also described is a difference projection process that varies the values of the interpolated pixels according to a computed difference projection.

摘要翻译： 描述了一种技术，其中低分辨率图像被处理成高分辨率图像，包括通过两次内插遍。 在第一次通过中，通过基于周围的原始像素的内插的梯度扩散来给出由四个相邻原始像素形成的块内的像素丢失的块内像素的缺失值。 在第二插值遍中，由两个相邻的原始像素形成的块边缘上的像素的缺失的块上像素通过基于相邻原始像素的值的内插和先前的内插值 它们相邻的块内像素。 还描述了根据计算的差异投影来改变内插像素的值的差分投影处理。