公开(公告)号：US07346106B1

公开(公告)日：2008-03-18

申请号：US10751345

申请日：2003-12-30

申请人： Wenqing Jiang ,  Jian Lu ,  Gregory K. Wallace ,  Peter Chou

发明人： Wenqing Jiang ,  Jian Lu ,  Gregory K. Wallace ,  Peter Chou

IPC分类号： H04N7/12

CPC分类号： H04N19/577 ,  H04N19/115 ,  H04N19/124 ,  H04N19/14 ,  H04N19/149 ,  H04N19/152 ,  H04N19/172 ,  H04N19/179 ,  H04N19/194 ,  H04N19/61

摘要： An encoding manager performs a first-pass encoding of a video sequence, collecting modeling data concerning the sequence in the process. The encoding manager utilizes collected data to construct a model concerning the sequence, the model including bit overhead for each frame and data concerning transitions that occur during the sequence. The encoding manager uses the data model to generate a rate profile for the video sequence, avoiding buffer underflow by allocating bits from hard to easy segments as needed. The encoding manager utilizes the rate profile to perform a second-pass encoding of the video sequence, adjusting quantization and bit rate for frames as necessary to avoid underflow and conform to the bit budget for the video sequence.

摘要翻译： 编码管理器执行视频序列的第一遍编码，收集关于该过程中的序列的建模数据。 编码管理器利用收集的数据来构建关于序列的模型，该模型包括每个帧的位开销和关于序列期间发生的转换的数据。 编码管理器使用数据模型来生成视频序列的速率分布，通过根据需要从难易分片分配比特来避免缓冲器下溢。 编码管理器利用速率分布来执行视频序列的二次编码，根据需要调整帧的量化和比特率以避免下溢，并符合视频序列的比特预算。

公开(公告)号：US20060233237A1

公开(公告)日：2006-10-19

申请号：US11108157

申请日：2005-04-15

申请人： Jian Lu ,  Wenqing Jiang ,  Gregory Wallace

发明人： Jian Lu ,  Wenqing Jiang ,  Gregory Wallace

IPC分类号： H04N11/04 ,  H04N7/12 ,  H04B1/66 ,  H04N11/02

CPC分类号： H04N19/177 ,  H04N19/124 ,  H04N19/149 ,  H04N19/15 ,  H04N19/172 ,  H04N19/176 ,  H04N19/61

摘要： Data, such as video data, is encoded by identifying a data segment to be encoded. The data segment includes multiple frames. A bit-rate profile for encoding the data segment is generated. The bit-rate profile defines a number of bits associated with each frame in the data segment. Frames are encoded using the bit-rate profile. The bit-rate profile is updated periodically to incorporate past encoding statistics and compensate for any encoding bits deviations from the initial profile.

摘要翻译： 通过识别要编码的数据段来编码诸如视频数据的数据。 数据段包括多个帧。 生成用于编码数据段的比特率简档。 比特率简档定义与数据段中的每个帧相关联的位数。 使用位速率配置文件对帧进行编码。 定期更新比特率配置文件以合并过去的编码统计信息，并补偿任何编码比特偏离初始配置文件。

公开(公告)号：US08036484B2

公开(公告)日：2011-10-11

申请号：US11872963

申请日：2007-10-16

申请人： Wenqing Jiang ,  Ying Cao ,  Li Hao ,  Weiping Pan

发明人： Wenqing Jiang ,  Ying Cao ,  Li Hao ,  Weiping Pan

IPC分类号： G06K9/40

CPC分类号： G06T3/4023

摘要： Methods, systems, and apparatuses for averaging data in packed format are provided. The data may be image data, such as data words containing color-specific data portions representative of pixels of a captured image. A first data word containing first image data is received. A second data word containing second image data is received. A logical AND of the first data word and the second data word is performed to generate a third data word. A logical exclusive OR (XOR) of the first data word and the second data word is performed to generate a fourth data word. A right shift of the fourth data word is performed. The third data word and the right shifted fourth data word are summed to generate a fifth data word that is an average of the first and second data words.

摘要翻译： 提供了以压缩格式平均数据的方法，系统和装置。 数据可以是图像数据，诸如包含表示捕获图像的像素的特定于颜色的数据部分的数据字。 接收包含第一图像数据的第一数据字。 接收包含第二图像数据的第二数据字。 执行第一数据字和第二数据字的逻辑与以产生第三数据字。 执行第一数据字和第二数据字的逻辑异或（XOR）以产生第四数据字。 执行第四数据字的右移。 将第三数据字和右移第四数据字相加以产生作为第一和第二数据字的平均值的第五数据字。

公开(公告)号：US09191675B2

公开(公告)日：2015-11-17

申请号：US13618931

申请日：2012-09-14

申请人： Wenqing Jiang ,  Weiping Pan

发明人： Wenqing Jiang ,  Weiping Pan

IPC分类号： H04N19/124 ,  H04N19/152 ,  H04N19/63 ,  H04N19/61 ,  H04N19/50

CPC分类号： H04N19/152 ,  H04N19/115 ,  H04N19/124 ,  H04N19/50 ,  H04N19/61 ,  H04N19/63

摘要： Techniques for performing rate control for encoding of video frames are provided. A first timestamp that indicates a prior video frame capture time and a second timestamp that indicates a current video frame capture time are received. A time difference between these timestamps is determined. An average video data bit encoding rate is multiplied by the determined time difference to calculate a bit budget. An indication of a number of encoded video data bits of the prior video frame and of any further video frames encoded subsequent to the prior video frame and prior to the current video frame is received. A virtual buffer fill level is adjusted based on a difference between the indicated number of encoded video bits and the calculated bit budget. A quantizer parameter is adjusted based on the adjusted virtual buffer fill level. The current video frame is encoded according to the adjusted quantizer parameter.

摘要翻译： 提供了执行视频帧编码速率控制的技术。 接收指示先前的视频帧捕获时间的第一时间戳和指示当前视频帧捕获时间的第二时间戳。 确定这些时间戳之间的时间差。 将平均视频数据比特编码率乘以确定的时间差以计算比特预算。 接收先前视频帧的编码视频数据位数以及在先前视频帧之后和当前视频帧之前编码的任何另外的视频帧的指示。 基于所指示的编码视频位数与计算的位预算之间的差异来调整虚拟缓冲器填充电平。 基于调整后的虚拟缓冲区填充级别调整量化参数。 当前视频帧根据调整后的量化参数进行编码。

公开(公告)号：US08295344B2

公开(公告)日：2012-10-23

申请号：US11876444

申请日：2007-10-22

申请人： Wenqing Jiang ,  Weiping Pan

发明人： Wenqing Jiang ,  Weiping Pan

IPC分类号： H04N7/12

CPC分类号： H04N19/152 ,  H04N19/115 ,  H04N19/124 ,  H04N19/50 ,  H04N19/61 ,  H04N19/63

摘要： Methods, systems, and apparatuses for performing rate control for encoding of video frames are provided. A first timestamp is received that indicates a capture time for a prior video frame. A second timestamp is received that indicates a capture time for a current video frame. A time difference between the second timestamp and the first timestamp is determined. An average video data bit encoding rate is multiplied by the determined time difference to calculate a bit budget. An indication of a number of video data bits that have been encoded is received. The number includes a number of encoded video data bits of the prior video frame and of any further video frames encoded subsequent to the prior video frame and prior to the current video frame. A virtual buffer fill level is adjusted based on a difference between the indicated number of video bits that have been encoded and the calculated bit budget. A quantizer parameter is adjusted based on the adjusted virtual buffer fill level. The current video frame is encoded according to the adjusted quantizer parameter.

摘要翻译： 提供了用于执行视频帧编码速率控制的方法，系统和装置。 接收到指示先前视频帧的捕获时间的第一时间戳。 接收到指示当前视频帧的捕获时间的第二时间戳。 确定第二时间戳和第一时间戳之间的时间差。 将平均视频数据比特编码率乘以确定的时间差以计算比特预算。 接收已经编码的多个视频数据位的指示。 该数量包括先前视频帧的编码视频数据位数，以及在先前视频帧之后并且在当前视频帧之前编码的任何另外的视频帧。 基于已编码的所指示的视频比特数与计算的比特预算之间的差异来调整虚拟缓冲器填充级别。 基于调整后的虚拟缓冲区填充级别调整量化参数。 当前视频帧根据调整后的量化参数进行编码。

公开(公告)号：US20090066820A1

公开(公告)日：2009-03-12

申请号：US11850962

申请日：2007-09-06

申请人： Wenqing Jiang ,  Ying Cao ,  Li Hao ,  Weiping Pan

发明人： Wenqing Jiang ,  Ying Cao ,  Li Hao ,  Weiping Pan

IPC分类号： H04N9/04

CPC分类号： H04N9/07 ,  H04N9/646

摘要： Methods, systems, and apparatuses for filtering captured image data are provided. An array of pixel data values corresponding to a captured image is received. The pixel data values in the received array are pixel data values of a first color of the captured image. A filter function is performed on a portion of the pixel data values of the array that are located in Bayer pattern pixel locations of the array for the first color. Subsequent arrays of pixel data values corresponding to further colors of the captured image may be received and filtered in a similar manner. Furthermore, further captured images in a video stream may be received and filtered in a similar manner, to generate a stream of filtered video images.

摘要翻译： 提供了用于过滤捕获的图像数据的方法，系统和装置。 接收与拍摄图像对应的像素数据值的阵列。 接收阵列中的像素数据值是捕获图像的第一颜色的像素数据值。 对位于第一颜色的阵列的拜耳图案像素位置的阵列的像素数据值的一部分执行滤波器功能。 可以以类似的方式接收和过滤与拍摄图像的更多颜色相对应的像素数据值的后续阵列。 此外，可以以类似的方式接收和过滤视频流中的进一步捕获的图像，以产生经滤波的视频图像流。

公开(公告)号：US06757343B1

公开(公告)日：2004-06-29

申请号：US09596242

申请日：2000-06-16

申请人： Antonio Ortega ,  Wenqing Jiang

发明人： Antonio Ortega ,  Wenqing Jiang

IPC分类号： H03D100

CPC分类号： G06F17/148

摘要： Techniques to overlap states for efficient multilevel wavelet decompositions to reduce memory and delay in discrete wavelet transform in a block-by-block fashion. The input data is segmented into blocks and each block is processed separately, either sequentially or in parallel. Results of partially completed computations in each block is saved and used to complete computations in an adjacent block.

摘要翻译： 重叠状态的技术用于有效的多电平小波分解，以逐块方式减少离散小波变换中的存储和延迟。 输入数据被分段为块，每个块按顺序或并行处理。 保存每个块中部分完成计算的结果，并用于完成相邻块中的计算。

公开(公告)号：US20130058398A1

公开(公告)日：2013-03-07

申请号：US13618931

申请日：2012-09-14

申请人： Wenqing Jiang ,  Weiping Pan

发明人： Wenqing Jiang ,  Weiping Pan

IPC分类号： H04N7/26

CPC分类号： H04N19/152 ,  H04N19/115 ,  H04N19/124 ,  H04N19/50 ,  H04N19/61 ,  H04N19/63

摘要： Techniques for performing rate control for encoding of video frames are provided. A first timestamp that indicates a prior video frame capture time and a second timestamp that indicates a current video frame capture time are received. A time difference between these timestamps is determined. An average video data bit encoding rate is multiplied by the determined time difference to calculate a bit budget. An indication of a number of encoded video data bits of the prior video frame and of any further video frames encoded subsequent to the prior video frame and prior to the current video frame is received. A virtual buffer fill level is adjusted based on a difference between the indicated number of encoded video bits and the calculated bit budget. A quantizer parameter is adjusted based on the adjusted virtual buffer fill level. The current video frame is encoded according to the adjusted quantizer parameter.

摘要翻译： 提供了执行视频帧编码速率控制的技术。 接收指示先前的视频帧捕获时间的第一时间戳和指示当前视频帧捕获时间的第二时间戳。 确定这些时间戳之间的时间差。 将平均视频数据比特编码率乘以确定的时间差以计算比特预算。 接收先前视频帧的编码视频数据位数以及在先前视频帧之后和当前视频帧之前编码的任何另外的视频帧的指示。 基于所指示的编码视频位数与计算的位预算之间的差异来调整虚拟缓冲器填充电平。 基于调整后的虚拟缓冲区填充级别调整量化参数。 当前视频帧根据调整后的量化参数进行编码。

公开(公告)号：US20100231797A1

公开(公告)日：2010-09-16

申请号：US12560795

申请日：2009-09-16

申请人： Wenqing Jiang ,  Zhengran Li ,  Hua Jiang ,  Li Hao

发明人： Wenqing Jiang ,  Zhengran Li ,  Hua Jiang ,  Li Hao

IPC分类号： H04N5/217

CPC分类号： H04N19/895

摘要： Techniques for video data delivery are provided. A first data stream is received that includes a plurality of video data frames. At least one corrupted video data frame is detected in the first data stream. At least one replacement video data frame is generated for the corrupted video data frame(s) based at least on a non-corrupted video data frame received in the first data stream prior to the corrupted video data frame(s). The replacement video data frame(s) include a modified form of the non-corrupted video data frame, and are configured to provide a smooth scene transition from the non-corrupted video data frame. The corrupted video data frame(s) are replaced in the first data stream with the generated replacement video data frame(s) to generate a second data stream.

摘要翻译： 提供视频数据传送技术。 接收包括多个视频数据帧的第一数据流。 在第一数据流中检测到至少一个损坏的视频数据帧。 至少对于损坏的视频数据帧，至少基于在损坏的视频数据帧之前的第一数据流中接收的未损坏的视频数据帧生成至少一个替换视频数据帧。 替换视频数据帧包括未损坏的视频数据帧的修改形式，并且被配置为从未损坏的视频数据帧提供平滑的场景转换。 损坏的视频数据帧在第一数据流中被替换为具有生成的替换视频数据帧以产生第二数据流。

公开(公告)号：US20090103609A1

公开(公告)日：2009-04-23

申请号：US11876444

申请日：2007-10-22

申请人： Wenqing Jiang ,  Weiping Pan

发明人： Wenqing Jiang ,  Weiping Pan

IPC分类号： H04N7/32

CPC分类号： H04N19/152 ,  H04N19/115 ,  H04N19/124 ,  H04N19/50 ,  H04N19/61 ,  H04N19/63

摘要： Methods, systems, and apparatuses for performing rate control for encoding of video frames are provided. A first timestamp is received that indicates a capture time for a prior video frame. A second timestamp is received that indicates a capture time for a current video frame. A time difference between the second timestamp and the first timestamp is determined. An average video data bit encoding rate is multiplied by the determined time difference to calculate a bit budget. An indication of a number of video data bits that have been encoded is received. The number includes a number of encoded video data bits of the prior video frame and of any further video frames encoded subsequent to the prior video frame and prior to the current video frame. A virtual buffer fill level is adjusted based on a difference between the indicated number of video bits that have been encoded and the calculated bit budget. A quantizer parameter is adjusted based on the adjusted virtual buffer fill level. The current video frame is encoded according to the adjusted quantizer parameter.

摘要翻译： 提供了用于执行视频帧编码速率控制的方法，系统和装置。 接收到指示先前视频帧的捕获时间的第一时间戳。 接收到指示当前视频帧的捕获时间的第二时间戳。 确定第二时间戳和第一时间戳之间的时间差。 将平均视频数据比特编码率乘以确定的时间差以计算比特预算。 接收已经编码的多个视频数据位的指示。 该数量包括先前视频帧的编码视频数据位数，以及在先前视频帧之后并且在当前视频帧之前编码的任何另外的视频帧。 基于已编码的所指示的视频比特数与计算的比特预算之间的差异来调整虚拟缓冲器填充级别。 基于调整后的虚拟缓冲区填充级别调整量化参数。 当前视频帧根据调整后的量化参数进行编码。