公开(公告)号：US10108314B2

公开(公告)日：2018-10-23

申请号：US13805185

申请日：2011-06-23

申请人： Jiefu Zhai ,  Joan Llach ,  Zhe Wang

发明人： Jiefu Zhai ,  Joan Llach ,  Zhe Wang

IPC分类号： G06F3/048 ,  G06F3/00 ,  G06K9/00 ,  G06F3/0484 ,  G06T5/00 ,  G06T5/40

摘要： A tone mapping graphical user interface (GUI) is provided that allows a video engineer to process a video using a set of tools for changing high dynamic range data into lower dynamic range data. The tone mapping GUI includes a video player region that includes the current video output section for a region-based method of performing HDR conversion, and a current video output section for a reference method that performs HDR conversion using, for example, a global process.

公开(公告)号：US09087382B2

公开(公告)日：2015-07-21

申请号：US13381224

申请日：2010-06-29

申请人： Jiefu Zhai ,  Joan Llach

发明人： Jiefu Zhai ,  Joan Llach

IPC分类号： G09G5/02 ,  G06T5/00

CPC分类号： G06T5/008 ,  G06T2207/10024 ,  G06T2207/20012 ,  G06T2207/20208

摘要： A method of tone mapping high dynamic range images for display on low dynamic range displays wherein a high dynamic range image is first accessed. The high dynamic range image is segmented into different regions such that each region is represented by a matrix, where each element of the matrix is a weight or probability of a pixel. An exposure of each region is determined or calculated and the exposure values are applied to the regions responsive to the weight or probability. The different regions are then fused together to obtain a final tone mapped image.

摘要翻译： 一种色调映射高动态范围图像的方法，用于在低动态范围显示器上显示，其中首先访问高动态范围图像。 高动态范围图像被分割成不同的区域，使得每个区域由矩阵表示，其中矩阵的每个元素是像素的权重或概率。 确定或计算每个区域的曝光，并且将曝光值应用于响应于重量或概率的区域。 然后将不同的区域融合在一起以获得最终的色调映射图像。

公开(公告)号：US20130258067A1

公开(公告)日：2013-10-03

申请号：US13991636

申请日：2010-12-08

申请人： Dong-Qing Zhang ,  Jiefu Zhai ,  Zhe Wang

发明人： Dong-Qing Zhang ,  Jiefu Zhai ,  Zhe Wang

IPC分类号： H04N13/02

CPC分类号： H04N13/25 ,  G06T7/55 ,  G06T2207/20088 ,  H04N13/243

摘要： A depth acquisition system utilizes at least three sensors with at least one sensor in a non-colinear configuration to increase depth information. This configuration provides both vertical and horizontal depth information to be combined to enhance image quality, especially in three-dimensional image gathering. Vertical sensor pairs aid in determining disparities for horizontal edges and make depth estimations for horizontal edges more accurate.

摘要翻译： 深度采集系统利用至少三个具有非共线配置中的至少一个传感器的传感器来增加深度信息。 该配置提供要组合的垂直和水平深度信息以增强图像质量，特别是在三维图像采集中。 垂直传感器对有助于确定水平边缘的差异，并使水平边缘的深度估计更准确。

公开(公告)号：US08385432B2

公开(公告)日：2013-02-26

申请号：US11920819

申请日：2006-05-03

申请人： Ying Chen ,  Jiefu Zhai ,  Kui Gao ,  Kai Xie

发明人： Ying Chen ,  Jiefu Zhai ,  Kui Gao ,  Kai Xie

IPC分类号： H04N7/12

CPC分类号： H04N19/615 ,  H04N19/103 ,  H04N19/105 ,  H04N19/13 ,  H04N19/159 ,  H04N19/172 ,  H04N19/33 ,  H04N19/59 ,  H04N19/61 ,  H04N19/63

摘要： Scalable video coding based on H.264/AVC uses motion compensation, which results in motion vectors and residual pictures. To optimize the encoding of the residual pictures of the enhancement-layer, they can be predicted from the base-layer. This requires complex encoders and decoders. Simplified residual prediction techniques are provided that focus on reducing the encoding and decoding complexity of the spatial scalable enhancement-layer with optimized coding efficiency. The method for encoding video data containing high-pass frames and low-pass frames comprises the steps of encoding the low-pass frames, wherein residual prediction may be used, splitting the high-pass frames into two interleaving frame groups, encoding the frames of the first of said frame groups, wherein residual prediction may be used, and encoding the frames of the second of the frame groups using an encoding method without residual prediction.

公开(公告)号：US20120195372A1

公开(公告)日：2012-08-02

申请号：US13018298

申请日：2011-01-31

申请人： Jiefu Zhai ,  Xiaosong Zhou ,  Hsi-Jung Wu

发明人： Jiefu Zhai ,  Xiaosong Zhou ,  Hsi-Jung Wu

IPC分类号： H04N7/32 ,  H04N7/12

CPC分类号： H04N19/156 ,  H04N19/126 ,  H04N19/146 ,  H04N19/61

摘要： A video coder employs techniques for applying frame rate adaptation and variable resolution adaptation in response to environmental coding factors present at the coding terminal. According to such techniques, a coder may estimate a coding quality level to be applied based on the environmental coding factors. The coder may retrieve from a controller table, settings for resolution and frame rate based on the estimated quality level. Optionally, the coder further may retrieve settings identifying a range of quantization parameters that may be used during coding. Prior to coding, the coder may configure input video data to match the resolution and frame rate settings retrieved from the controller table. Thereafter, the coder may code the reconfigured input video data by motion-compensation prediction constrained, as applicable, by the retrieved quantization parameter range.

摘要翻译： 视频编码器根据存在于编码终端处的环境编码因素，采用应用帧速率适配和可变分辨率自适应的技术。 根据这样的技术，编码器可以基于环境编码因素估计要应用的编码质量等级。 编码器可以根据估计的质量水平从控制器表检索分辨率和帧速率的设置。 可选地，编码器还可以检索识别可能在编码期间使用的量化参数的范围的设置。 在编码之前，编码器可以配置输入视频数据以匹配从控制器表检索的分辨率和帧率设置。 此后，编码器可以通过运动补偿预测约束（如适用）通过检索的量化参数范围对重新配置的输入视频数据进行编码。

公开(公告)号：US20130163868A1

公开(公告)日：2013-06-27

申请号：US13579401

申请日：2011-02-11

申请人： Zhe Wang ,  Jiefu Zhai

发明人： Zhe Wang ,  Jiefu Zhai

IPC分类号： G06K9/46

CPC分类号： G06T5/009 ,  G06T7/11 ,  G06T2207/10016 ,  G06T2207/20208

摘要： A method for toning mapping high dynamic range (HDR) video for display in low dynamic range display comprises accessing the HDR video; producing a luminance information for the individual frames; partitioning different consecutive groups of frames into segments responsive to the luminance information; classifying the segments into static luminance segments and transient luminance segments; producing a tone mapping parameter set for the static luminance segments; producing a tone mapping parameter set for at least one of the transient luminance segments responsive to the tone mapping parameter set of an adjacent static luminance segment; and tone mapping the static luminance segments and transient luminance segments according to the respective tone mapping parameter sets.

摘要翻译： 用于色调映射高动态范围（HDR）视频以在低动态范围显示中显示的方法包括访问HDR视频; 产生各个帧的亮度信息; 响应于亮度信息将不同连续的帧组划分成段; 将段分为静态亮度段和瞬态亮度段; 产生用于静态亮度段的色调映射参数集; 响应于相邻静态亮度段的色调映射参数集，产生针对所述瞬态亮度段中的至少一个的色调映射参数集; 以及根据各个色调映射参数组对静态亮度段和瞬态亮度段进行色调映射。

公开(公告)号：US20130141432A1

公开(公告)日：2013-06-06

申请号：US13816522

申请日：2010-08-19

申请人： Zhe Wang ,  Jiefu Zhai ,  Tao Zhang

发明人： Zhe Wang ,  Jiefu Zhai ,  Tao Zhang

IPC分类号： G09G5/06

CPC分类号： G09G5/06 ,  G09G3/003 ,  G09G2320/0209 ,  G09G2320/0606 ,  G09G2320/0666 ,  G09G2320/0686 ,  G09G2320/0693 ,  H04N13/324 ,  H04N13/327 ,  H04N13/332

摘要： A method and system for calibration and compensation of color in a three dimensional display system includes user calibration of individual color channels using a multiplicity of grey screens while viewing with three dimensional glasses. Look-up tables are generated to ease conversion of input pixels to color corrected pixels to pre-distort the color of the pixels being driven by the three dimensional display system. Input pixels are then converted using the look-up tables and color corrected frames are displayed to a user. The pre-distortion effect allows a user to perceive colors in the three dimensional system as intended with the distortions caused by the viewing glasses and other aspects of the three dimensional display system.

摘要翻译： 用于在三维显示系统中校准和补偿颜色的方法和系统包括使用多个灰色屏幕的用户校准各个颜色通道，同时用三维眼镜观看。 生成查找表以简化输入像素到颜色校正像素的转换，以预先变形由三维显示系统驱动的像素的颜色。 然后使用查找表转换输入像素，并且向用户显示颜色校正的帧。 预失真效果允许用户以三维显示系统的观看眼镜和其他方面所引起的失真的方式感知三维系统中的颜色。

公开(公告)号：US08346009B2

公开(公告)日：2013-01-01

申请号：US12803370

申请日：2010-06-25

申请人： Jiefu Zhai ,  Joan Llach ,  Zhe Wang

发明人： Jiefu Zhai ,  Joan Llach ,  Zhe Wang

IPC分类号： G06K9/36

CPC分类号： H04N5/202 ,  G09G3/2003 ,  G09G2340/0428 ,  G09G2340/06

摘要： A method for tone mapping high dynamic range images for display on low dynamic range displays wherein high dynamic range images are first accessed. The high dynamic range images are divided the into different regions such that each region is represented by a matrix, where each element of the matrix is a weight or probability of a pixel value. An exposure of each region is determined or calculated by estimating an anchor point in each region such that most pixels in each region are mapped to mid grey and the anchor points are adjusted to a key of the images to preserve overall brightness. The regions are then placed or mapped to zones and exposure values are applied to the regions responsive to the weight or probability. The regions are fused together to obtain a final tone mapped image.

摘要翻译： 一种用于将高动态范围图像进行色调映射以在低动态范围显示器上显示的方法，其中首先访问高动态范围图像。 高动态范围图像被划分成不同的区域，使得每个区域由矩阵表示，其中矩阵的每个元素是像素值的权重或概率。 通过估计每个区域中的锚点来确定或计算每个区域的曝光，使得每个区域中的大多数像素被映射到中间灰色，并且将锚点调整为图像的关键以保持整体亮度。 然后将区域放置或映射到区域，并且响应于重量或概率将曝光值应用于区域。 将这些区域融合在一起以获得最终的色调映射图像。

公开(公告)号：US20120288217A1

公开(公告)日：2012-11-15

申请号：US13574919

申请日：2011-01-25

申请人： Jiefu Zhai ,  Zhe Wang ,  Dong-Qing Zhang

发明人： Jiefu Zhai ,  Zhe Wang ,  Dong-Qing Zhang

IPC分类号： G06T5/50

CPC分类号： H04N5/235 ,  G06T5/50 ,  G06T2200/21 ,  G06T2207/20208 ,  H04N5/2355

摘要： A new high dynamic range image synthesis which can handle the local object motion, wherein an interactive graphical user interface is provided for the end user, through which one can specify the source image for separate part of the final high dynamic range image, either by creating a image mask or scribble on the image. The high dynamic range image synthesis includes the following steps: capturing low dynamic range images with different exposures; registering the low dynamic range images; estimating camera response function; converting the low dynamic range images to temporary radiance images using estimated camera response function; and fusing the temporary radiance images into a single high dynamic range (HDR) image by employing a method of layered masking.

摘要翻译： 可以处理局部对象运动的新的高动态范围图像合成，其中为最终用户提供交互式图形用户界面，通过该动态范围图像可以为最终的高动态范围图像的分离部分指定源图像，通过创建 图像掩码或图像上的涂鸦。 高动态范围图像合成包括以下步骤：捕获具有不同曝光的低动态范围图像; 注册低动态范围图像; 估计摄像机响应功能; 使用估计的相机响应函数将低动态范围图像转换成临时辐射图像; 并通过采用分层掩蔽的方法将临时辐射图像融合到单个高动态范围（HDR）图像中。

公开(公告)号：US20120195356A1

公开(公告)日：2012-08-02

申请号：US13018363

申请日：2011-01-31

申请人： Feng YI ,  Chris Y. CHUNG ,  Hsi-Jung WU ,  David CONRAD ,  Jiefu ZHAI

发明人： Feng YI ,  Chris Y. CHUNG ,  Hsi-Jung WU ,  David CONRAD ,  Jiefu ZHAI

IPC分类号： H04N7/26 ,  H04B17/00

CPC分类号： H04N19/115 ,  H04N19/103 ,  H04N19/119 ,  H04N19/132 ,  H04N19/156 ,  H04N19/172 ,  H04N19/57

摘要： A video coding system and method that dynamically controls coding parameters to satisfy a resource usage requirement. A resource controller may set parameters or parameter thresholds to change the coding complexity of the video coding system and to effectuate a change in the resource usage rate. Parameters may include the frame rate, the frame resolution, the bit rate, or pixel block sizes. A parameter or parameter threshold adjustment may be based on system resource data, for example, power consumption, CPU usage, fan speed, battery status, input video statistics, coding latency, and other video encoder internal states.

摘要翻译： 一种动态控制编码参数以满足资源使用需求的视频编码系统和方法。 资源控制器可以设置参数或参数阈值来改变视频编码系统的编码复杂度并且实现资源使用率的变化。 参数可以包括帧速率，帧分辨率，比特率或像素块大小。 参数或参数阈值调整可以基于系统资源数据，例如功耗，CPU使用率，风扇速度，电池状态，输入视频统计，编码延迟和其他视频编码器内部状态。