公开(公告)号：US08199384B2

公开(公告)日：2012-06-12

申请号：US11811717

申请日：2007-06-11

申请人： Jaewon Shin ,  Mohammad Gharavi-Alkhansari ,  Ali Tabatabai

发明人： Jaewon Shin ,  Mohammad Gharavi-Alkhansari ,  Ali Tabatabai

IPC分类号： G03F3/08

CPC分类号： G06T5/40 ,  G06T5/009 ,  G06T2207/10016 ,  G06T2207/10024

摘要： The color tone compensation method provides a simple and efficient method to compensate the color tone differences between two different sources of images. A first image sample, such as a still image, from a first image capturing source and a second image sample, such as a video frame, from a second image capturing source are aligned, and a tone-mapping estimation routine is applied to the two aligned images. The tone-mapping estimation routine uses the pixel intensity value histograms associated with the two aligned images and generates a tone mapping table. The tone mapping table includes a conversion intensity value for each intensity value in the second image. The conversion intensity value is a statistical measure, such as the mean, calculated according to the data in the corresponding pixel intensity value histogram. The tone-mapping table is applied to any image generated by the second image capturing source, thereby generating a new image with similar color tone as the first image generated by the first image capturing source.

摘要翻译： 色调补偿方法提供了一种简单有效的方法来补偿两种不同图像源之间的色调差异。 将来自第一图像捕获源的第一图像样本（例如静止图像）和来自第二图像捕获源的诸如视频帧的第二图像样本对准，并且将色调映射估计例程应用于两个 对齐图像。 色调映射估计例程使用与两个对准图像相关联的像素强度值直方图，并生成色调映射表。 色调映射表包括第二图像中每个强度值的转换强度值。 转换强度值是统计度量，如平均值，根据相应像素强度值直方图中的数据计算。 色调映射表应用于由第二图像捕获源产生的任何图像，从而生成与由第一图像捕获源生成的第一图像相似的色调的新图像。

公开(公告)号：US20120014452A1

公开(公告)日：2012-01-19

申请号：US13176124

申请日：2011-07-05

申请人： Ehsan Maani ,  Wei Liu ,  Ali Tabatabai

发明人： Ehsan Maani ,  Wei Liu ,  Ali Tabatabai

IPC分类号： H04N7/12

CPC分类号： H04N19/52 ,  H04N19/46 ,  H04N19/547 ,  H04N19/56 ,  H04N19/70

摘要： Motion Compensated Prediction (MCP) has been a key factor in most advanced video compression schemes. For further reduction in the residual signal energy in B-frames, bidirectional prediction where two motion-compensated signals are superimposed has also been utilized in most prior video coding standards such as MPEG-2 or MPEG-4/AVC. Syntax changes and appropriate motion vector prediction that allows efficient use of multi-parameter MCP is described. The prediction signal is constructed by linearly combining the motion-compensated signals from each parameter (or motion vector).

摘要翻译： 运动补偿预测（MCP）一直是大多数高级视频压缩方案的关键因素。 为了进一步降低B帧中的残留信号能量，在大多数先前的视频编码标准（例如MPEG-2或MPEG-4 / AVC）中也已经使用了叠加两个运动补偿信号的双向预测。 描述了允许有效使用多参数MCP的语法改变和适当的运动矢量预测。 通过线性组合来自每个参数（或运动矢量）的运动补偿信号来构造预测信号。

公开(公告)号：US20110249726A1

公开(公告)日：2011-10-13

申请号：US13078779

申请日：2011-04-01

申请人： Thai-Ha Nguyen ,  Yoichi Yagasaki ,  Ali Tabatabai

发明人： Thai-Ha Nguyen ,  Yoichi Yagasaki ,  Ali Tabatabai

IPC分类号： H04N7/32 ,  H04N7/12

CPC分类号： H04N19/157 ,  H04N19/129 ,  H04N19/176 ,  H04N19/61

摘要： Entropy encoding is performed in the inventive apparatus and method in response to the scanning of transform coefficients following an initial scanning pattern selected on the basis of probability statistics of non-zero coefficients for each block position. These non-zero probability statistics are ranked for a given combination of coding characteristics within the current block to arrive at an initial scanning pattern. The same initial scanning pattern selection is performed in the decoder to allow the transform coefficients to be extracted in their proper order from encoded video data. The pattern selection is applicable to both intra prediction and inter prediction. Transform coefficients are more accurately ordered in response to the invention because in adapting pattern initialization to quantization step size, high-frequency basis functions are properly taken into account.

摘要翻译： 响应于基于对于每个块位置的非零系数的概率统计选择的初始扫描模式之后的变换系数的扫描，在本发明的装置和方法中执行熵编码。 对于当前块内的编码特性的给定组合来对这些非零概率统计进行排序，以得到初始扫描模式。 在解码器中执行相同的初始扫描模式选择，以允许以编码视频数据的正确顺序提取变换系数。 模式选择适用于帧内预测和帧间预测。 响应于本发明，变换系数被更准确地排序，因为在将模式初始化适应到量化步长时，高频基函数被适当地考虑在内。

公开(公告)号：US07725593B2

公开(公告)日：2010-05-25

申请号：US11398195

申请日：2006-04-04

申请人： Mohammed Zubair Visharam ,  Ali Tabatabai

发明人： Mohammed Zubair Visharam ,  Ali Tabatabai

IPC分类号： G06F15/16

CPC分类号： G11B27/3027 ,  H04N19/30 ,  H04N19/61 ,  H04N21/234327 ,  H04N21/25808 ,  H04N21/8451 ,  H04N21/85406 ,  Y10S707/914 ,  Y10S707/99952

摘要： The currently existing ISO/AVC file format is modified by providing extensions to store and access video content currently being defined by the SVC standard. Specifically, extensions to the AVC file format are made to provide a new SVC file format that enables the storage and access of scalable video data. The scalable video data is stored as a single track within a media data section of the SVC file format. New extensions are defined for description entries and boxes within a metadata section of the SVC file format. These extensions provide means for extracting sub-streams or layers from the single track of scalable video data stored in the media data section.

摘要翻译： 通过提供扩展来修改当前存在的ISO / AVC文件格式，以存储和访问当前由SVC标准定义的视频内容。 具体来说，AVC文件格式的扩展是为了提供一种新的SVC文件格式，可以实现可扩展视频数据的存储和访问。 可扩展视频数据作为单个轨道存储在SVC文件格式的媒体数据部分内。 为SVC文件格式的元数据部分中的描述条目和框定义新的扩展。 这些扩展提供用于从存储在媒体数据部分中的可伸缩视频数据的单个轨道中提取子流或层的装置。

公开(公告)号：US20090180552A1

公开(公告)日：2009-07-16

申请号：US12235499

申请日：2008-09-22

申请人： Mohammed Z. Visharam ,  Ali Tabatabai

发明人： Mohammed Z. Visharam ,  Ali Tabatabai

IPC分类号： H04N7/26

CPC分类号： H04N19/33 ,  H04N19/12 ,  H04N19/14 ,  H04N19/154 ,  H04N19/176 ,  H04N19/187 ,  H04N19/192 ,  H04N19/513 ,  H04N19/61

摘要： An apparatus or method of efficiently coding high resolution video using texture analysis and synthesis techniques in a scalable video coding framework. A high-resolution video signal is spatially downsampled and encoded into a base-layer. Texture and structure information are extracted from the downsampled signal and base-layer for use by a texture synthesizer. The texture synthesizer is structurally and texturally aware utilizing edge information from a base-layer of the synthesizer to improve synthesis. After synthesis, a video quality assessor directs enhancement-layer coding of unacceptably synthesized areas by alternate (non-textural) coding means, such as conventional AVC or MPEG-2 coding. In one mode, the quality assessor iteratively improves synthesis of certain blocks to make them acceptable for enhancement-layer coding. The apparatus or method outputs a bit stream, or bit streams, containing both the coded base-layer and the enhancement-layer.

摘要翻译： 一种在可扩展视频编码框架中使用纹理分析和合成技术高效编码高分辨率视频的装置或方法。 高分辨率视频信号在空间上被下采样并编码成基层。 从下采样信号和基层提取纹理和结构信息以供纹理合成器使用。 纹理合成器在结构和结构上意识到利用来自合成器的基层的边缘信息来改进合成。 在合成之后，视频质量评估者通过诸如常规AVC或MPEG-2编码的交替（非结构化）编码手段指导不可接受的合成区域的增强层编码。 在一种模式中，质量评估者迭代地改进某些块的合成以使其对于增强层编码是可接受的。 该装置或方法输出包含编码的基础层和增强层两者的比特流或比特流。

公开(公告)号：US20090141810A1

公开(公告)日：2009-06-04

申请号：US11999377

申请日：2007-12-04

申请人： Ali Tabatabai ,  Mohammed Zubair Visharam

发明人： Ali Tabatabai ,  Mohammed Zubair Visharam

IPC分类号： H04B1/66

CPC分类号： H04N19/59 ,  H04N19/33 ,  H04N19/46 ,  H04N19/61 ,  H04N19/70

摘要： A codec configured to operate in a sequential mode extends the current AVC standard in order to provide support for coding high resolution still image pictures within the AVC coding of a lower resolution video. The sequential mode codec is configured according to the modified AVC standard. The codec is capable of capturing an AVC video stream while concurrently capturing high resolution still images at random intervals relative to the video stream. Each captured high resolution still image is embedded within the video stream. The video stream including the embedded high resolution still images is encoded as a single layer bit stream. Each embedded high resolution still image signals or forces the start of a new GOP in the coded video sequence. The AVC standard is extended to include new syntax for the sequence parameter sets. In one embodiment, a modified sequence parameter set defines a new profile that signals the presence of a high resolution still image in sequence with AVC video.

摘要翻译： 配置为以顺序模式操作的编解码器扩展了当前AVC标准，以便为较低分辨率视频的AVC编码中的高分辨率静止图像图像编码提供支持。 顺序模式编解码器根据修改的AVC标准进行配置。 编解码器能够捕获AVC视频流，同时以相对于视频流的随机间隔捕获高分辨率静止图像。 每个捕获的高分辨率静止图像嵌入在视频流内。 包括嵌入式高分辨率静止图像的视频流被编码为单层比特流。 每个嵌入的高分辨率静止图像在编码视频序列中发出信号或强制新GOP的开始。 AVC标准被扩展为包括序列参数集的新语法。 在一个实施例中，修改的序列参数集定义了新的简档，其根据AVC视频依次表示高分辨率静止图像的存在。

公开(公告)号：US07330584B2

公开(公告)日：2008-02-12

申请号：US10965297

申请日：2004-10-14

申请人： Wu Weiguo ,  Takayuki Yoshigahara ,  Sundar Vedula ,  Ali Tabatabai

发明人： Wu Weiguo ,  Takayuki Yoshigahara ,  Sundar Vedula ,  Ali Tabatabai

IPC分类号： G06K9/00

CPC分类号： H04N7/144 ,  G06K9/32 ,  G06T7/33

摘要： An image processing apparatus and an image processing method, applied to e.g. a TV conference system or a TV telephone system, in which an image to be transmitted or received is captured and reconstructed into a virtual view point image which may appear as if it is captured by a virtual camera. The correspondence between pixels may be taken with higher robustness and higher accuracy, while mismatch in such correspondence, otherwise caused due to disparity, may be reduced to as small a value as possible. To this end, the disparity between the images, obtained on imaging an object from different view points by at least two cameras 11a, 12a, are detected and, based on the detected disparity, each of the images is separated into plural image regions. The relation of correspondence is found of the separated each image region, in association with the object, from one pixel position on the same horizontal lines to the next. From the pixel positions and the associated luminance components, for which the relation of correspondence has been found, a virtual view point image, to be generated by a virtual camera, mounted imaginarily, is constructed.

摘要翻译： 一种图像处理装置和图像处理方法。 电视会议系统或电视电话系统，其中要发送或接收的图像被捕获并重建成虚拟视点图像，虚拟视点图像可能看起来好象被虚拟相机捕获。 可以以更高的鲁棒性和更高的精度获得像素之间的对应关系，而否则由于视差引起的这种对应关系的失配可能减小到尽可能小的值。 为此，检测由至少两个摄像机11a，12a对来自不同视点的物体成像得到的图像之间的差异，并且基于检测到的视差，将每个图像分离成多个图像区域 。 从相同水平线上的一个像素位置到下一个像素位置，找出与对象相关联的分离的每个图像区域的对应关系。 从像素位置和已经找到对应关系的相关联的亮度分量构造出由虚拟照相机生成的虚拟视点图像。

公开(公告)号：US20070016594A1

公开(公告)日：2007-01-18

申请号：US11398195

申请日：2006-04-04

申请人： Mohammed Visharam ,  Ali Tabatabai

发明人： Mohammed Visharam ,  Ali Tabatabai

IPC分类号： G06F7/00

CPC分类号： G11B27/3027 ,  H04N19/30 ,  H04N19/61 ,  H04N21/234327 ,  H04N21/25808 ,  H04N21/8451 ,  H04N21/85406 ,  Y10S707/914 ,  Y10S707/99952

摘要： The currently existing ISO/AVC file format is modified by providing extensions to store and access video content currently being defined by the SVC standard. Specifically, extensions to the AVC file format are made to provide a new SVC file format that enables the storage and access of scalable video data. The scalable video data is stored as a single track within a media data section of the SVC file format. New extensions are defined for description entries and boxes within a metadata section of the SVC file format. These extensions provide means for extracting sub-streams or layers from the single track of scalable video data stored in the media data section.

摘要翻译： 通过提供扩展来修改当前存在的ISO / AVC文件格式，以存储和访问当前由SVC标准定义的视频内容。 具体来说，AVC文件格式的扩展是为了提供一种新的SVC文件格式，可以实现可扩展视频数据的存储和访问。 可扩展视频数据作为单个轨道存储在SVC文件格式的媒体数据部分内。 为SVC文件格式的元数据部分中的描述条目和框定义新的扩展。 这些扩展提供用于从存储在媒体数据部分中的可伸缩视频数据的单个轨道中提取子流或层的装置。

公开(公告)号：US07155441B2

公开(公告)日：2006-12-26

申请号：US09904174

申请日：2001-07-11

申请人： Hawley K. Rising, III ,  Ali Tabatabai ,  Toby Walker

发明人： Hawley K. Rising, III ,  Ali Tabatabai ,  Toby Walker

IPC分类号： G06F17/30

CPC分类号： H04N21/8543 ,  H04N21/84 ,  Y10S707/99933 ,  Y10S707/99942 ,  Y10S707/99945

摘要： A method permitting compact ways to update relationships between entities in an audiovideo sequence, or serial set of sequences, the method comprising: writing a description between the entities, the description containing relations; determining the relations that may be represented by parameters, each parameter having a numerical value; and obtaining from the user, one or more of the following: (a) the numerical value for the parameter; (b) a description of the parameter containing the numerical value; and (c) a description capable of setting the parameter dynamically.

公开(公告)号：US20060233247A1

公开(公告)日：2006-10-19

申请号：US11318904

申请日：2005-12-23

申请人： Mohammed Visharam ,  Ali Tabatabai

发明人： Mohammed Visharam ,  Ali Tabatabai

IPC分类号： H04N7/12 ,  H04N11/04 ,  H04B1/66 ,  H04N11/02

CPC分类号： G11B27/3027 ,  H04N19/40 ,  H04N19/70 ,  H04N21/2353 ,  H04N21/85406

摘要： A system and method of coding (encoding and/or decoding) video content to extend file formats for storage. The system and method utilizes the concept to define additional sample group description entries. By way of example the method can comprise the steps of: (1) receiving a file with encoded media data as a scalable video codec stream; (2) extracting information identifying the various spatial resolutions, temporal resolutions, quality resolutions or combinations of spatio-temporal-quality resolutions from the media data; (3) generating new description entries and dependency grouping box; (4) populating boxes with extracted metadata; and (5) incorporating metadata into a file associated with the media data using a specific media file format.

摘要翻译： 编码（编码和/或解码）视频内容以扩展用于存储的文件格式的系统和方法。 该系统和方法利用该概念来定义附加的样本组描述条目。 作为示例，该方法可以包括以下步骤：（1）接收具有编码媒体数据的文件作为可伸缩视频编解码流; （2）从媒体数据提取识别各种空间分辨率，时间分辨率，质量分辨率或时空质量分辨率的组合的信息; （3）生成新的描述条目和依赖关系分组框; （4）用提取的元数据填充框; 和（5）使用特定媒体文件格式将元数据结合到与媒体数据相关联的文件中。