公开(公告)号：US07797493B2

公开(公告)日：2010-09-14

申请号：US11815981

申请日：2006-02-13

申请人： Harm Johannes Antonius Maria Peters ,  Ramanathan Sethuraman ,  Gerard Veldman ,  Patrick Peter Elizabeth Meuwissen

发明人： Harm Johannes Antonius Maria Peters ,  Ramanathan Sethuraman ,  Gerard Veldman ,  Patrick Peter Elizabeth Meuwissen

IPC分类号： G06F13/28

CPC分类号： H04N19/433 ,  G06F12/0862 ,  G06F12/0875 ,  G06F12/0897 ,  G06F2212/6022 ,  G06T7/20 ,  G06T2200/28 ,  G09G5/395 ,  G09G2320/0261 ,  G09G2360/121 ,  H04N19/436

摘要： The present invention relates to a data processing device (10) comprising a processing unit (12) and a memory unit (14), and to a method for controlling operation of a memory unit (14) of a data processing device. The memory unit (14) comprises a main memory (16), a low- level cache memory (20.2), which is directly connected to the processing unit (12) and adapted to hold all pixels of a currently active sliding search area for reading access by the processing unit (12), a high-level cache memory (18), which is connected between the low-level cache memory and the frame memory, and a first pre-fetch buffer (20.1), which is connected between the high-level cache memory and the low- level cache memory and which is adapted to hold one search-area column or one search-area line of pixel blocks, depending on the scan direction and scan order followed by the processing unit. Reading and fetching functionalities are decoupled in the memory unit (14). The fetching functionality is concentrated on the higher cache level, while the reading functionality is concentrated on the lower cache level. This way concurrent reading and fetching can be achieved, thus enhancing the performance of a data processing device.

摘要翻译： 本发明涉及包括处理单元（12）和存储单元（14）的数据处理设备（10），以及用于控制数据处理设备的存储单元（14）的操作的方法。 存储单元（14）包括主存储器（16），低级高速缓存存储器（20.2），其直接连接到处理单元（12）并且适于保持当前活动的滑动搜索区域的所有像素用于读取 处理单元（12）的访问，连接在低级缓存存储器和帧存储器之间的高级缓存存储器（18）和第一预取缓冲器（20.1），其连接在 高级缓存存储器和低级高速缓存存储器，并且其适于保持像素块的一个搜索区域列或一个搜索区域行，这取决于处理单元后面的扫描方向和扫描顺序。 读取和取出功能在存储器单元（14）中解耦。 获取功能集中在较高的缓存级别，而读取功能集中在较低的缓存级别。 这样可以实现并行读取和取出，从而提高数据处理设备的性能。

公开(公告)号：US20070019874A1

公开(公告)日：2007-01-25

申请号：US10570546

申请日：2004-08-26

申请人： Ramanathan Sethuraman ,  Fabian Ernst

发明人： Ramanathan Sethuraman ,  Fabian Ernst

IPC分类号： G06K9/36

CPC分类号： H04N19/428 ,  H04N19/39 ,  H04N21/2343 ,  H04N21/2662 ,  H04N21/4402 ,  H04N21/4621

摘要： The invention relates to content signal processing and in particular to processing of a video content signal. An apparatus (100) for content signal processing comprises a scalable encoder (101) for encoding a content signal to generate scalable encoded data comprising data associated with a plurality of compression rates. A compression processor (105) determines compression factor indicators indicating data associated with the plurality of compression rates. Thus, the compression factor indicators indicate which data of the scalable encoded data corresponds to the different compression rates. Combined data comprising the scalable encoded data and the compression factor indicators are stored in a frame memory (105). An application having a given compression factor requirement may use the compression factor indicators to access the scalable encoded data of the frame memory (105) which is required for processing. A plurality of applications may access the same frame memory (105) thereby allowing for scalable encoded data which can be used with a plurality of applications having different compression factor requirements.

摘要翻译： 本发明涉及内容信号处理，特别涉及视频内容信号的处理。 用于内容信号处理的装置（100）包括可缩放编码器（101），用于对内容信号进行编码以产生包括与多个压缩率相关联的数据的可分级编码数据。 压缩处理器（105）确定指示与多个压缩率相关联的数据的压缩因子指示符。 因此，压缩因子指示符指示可缩放编码数据的哪个数据对应于不同的压缩率。 包括可缩放编码数据和压缩因子指示符的组合数据被存储在帧存储器（105）中。 具有给定压缩因子要求的应用可以使用压缩因子指示符来访问处理所需的帧存储器（105）的可缩放编码数据。 多个应用可以访问相同的帧存储器（105），从而允许可以与具有不同压缩因子要求的多个应用使用的可缩放编码数据。

公开(公告)号：US09432679B2

公开(公告)日：2016-08-30

申请号：US12092129

申请日：2006-10-27

申请人： Aleksandar Beric ,  Ramanathan Sethuraman

发明人： Aleksandar Beric ,  Ramanathan Sethuraman

IPC分类号： H04N19/433 ,  H04N19/61 ,  H04N19/43

CPC分类号： H04N19/433 ,  H04N19/43 ,  H04N19/61

摘要： A data processing system is provided for processing video data on a window basis. At least one memory unit (L1) is provided for fetching and storing video data from an image memory (IM) according to a first window (R) in a first scanning order. At least one second memory unit (L0) is provided for fetching and storing video data from the first memory unit (L1) according to a second window in a second scanning order (SO). Furthermore, at least one processing unit (PU) is provided for performing video processing on the video data of the second window as stored in the at least one second memory unit (L0) based on the second scanning order (SO). The second scanning order (SO) is a meandering scanning order being orthogonal to the first scanning order (SO1).

摘要翻译： 提供了一种用于在窗口基础上处理视频数据的数据处理系统。 提供至少一个存储单元（L1），用于以第一扫描顺序从根据第一窗口（R）的图像存储器（IM）中提取和存储视频数据。 提供至少一个第二存储器单元（L0），用于以第二扫描顺序（SO）从根据第二窗口的第一存储器单元（L1）提取和存储视频数据。 此外，提供至少一个处理单元（PU），用于基于第二扫描顺序（SO）对存储在至少一个第二存储器单元（L0）中的第二窗口的视频数据执行视频处理。 第二扫描顺序（SO）是与第一扫描顺序（SO1）正交的曲折扫描顺序。

公开(公告)号：US08009174B2

公开(公告)日：2011-08-30

申请号：US11908965

申请日：2006-03-15

申请人： Aleksandar Beric ,  Ramanathan Sethuraman

发明人： Aleksandar Beric ,  Ramanathan Sethuraman

IPC分类号： G09G5/39 ,  G06F13/18

CPC分类号： G11C8/04 ,  G06T1/60 ,  H04N19/426 ,  H04N19/433

摘要： A data buffering device which contains an input unit adapted to sequentially receive a two-dimensional array of data structures organized by an index pair with a first index stepwise traversing first-index values in a meandering manner defined by a first and a second meandering direction. The invention further includes a data buffering method, and a data processing method and device; each of which incorporates the above described features of the data buffering device.

摘要翻译： 一种数据缓冲装置，其包含输入单元，该输入单元适于顺序地接收由索引对组织的数据结构的二维阵列，其中第一索引以由第一和第二曲折方向限定的曲折方式逐步遍历第一索引值。 本发明还包括数据缓冲方法和数据处理方法和装置; 其中的每一个都包含数据缓冲装置的上述特征。

公开(公告)号：US20080147980A1

公开(公告)日：2008-06-19

申请号：US11815981

申请日：2006-02-13

申请人： Harm Johannes Antonius Maria Peters ,  Ramanathan Sethuraman ,  Gerard Veldman ,  Patrick Peter Elizabeth Meuwissen

发明人： Harm Johannes Antonius Maria Peters ,  Ramanathan Sethuraman ,  Gerard Veldman ,  Patrick Peter Elizabeth Meuwissen

IPC分类号： G06F12/08

CPC分类号： H04N19/433 ,  G06F12/0862 ,  G06F12/0875 ,  G06F12/0897 ,  G06F2212/6022 ,  G06T7/20 ,  G06T2200/28 ,  G09G5/395 ,  G09G2320/0261 ,  G09G2360/121 ,  H04N19/436

摘要： The present invention relates to a data processing device (10) comprising a processing unit (12) and a memory unit (14), and to a method for controlling operation of a memory unit (14) of a data processing device. The memory unit (14) comprises a main memory (16), a low- level cache memory (20.2), which is directly connected to the processing unit (12) and adapted to hold all pixels of a currently active sliding search area for reading access by the processing unit (12), a high-level cache memory (18), which is connected between the low-level cache memory and the frame memory, and a first pre-fetch buffer (20.1), which is connected between the high-level cache memory and the low- level cache memory and which is adapted to hold one search-area column or one search-area line of pixel blocks, depending on the scan direction and scan Reading and fetching functionalities are decoupled in the memory unit (14). The fetching functionality is concentrated on the higher cache level, while the reading functionality is concentrated on the lower cache level. This way concurrent reading and fetching can be achieved, thus enhancing the performance of a data processing device.

摘要翻译： 本发明涉及包括处理单元（12）和存储单元（14）的数据处理设备（10），以及用于控制数据处理设备的存储单元（14）的操作的方法。 存储单元（14）包括主存储器（16），低级高速缓存存储器（20.2），其直接连接到处理单元（12）并且适于保持当前活动的滑动搜索区域的所有像素用于读取 处理单元（12）的访问，连接在低级缓存存储器和帧存储器之间的高级缓存存储器（18）和第一预取缓冲器（20.1），其连接在 高级缓存存储器和低级高速缓存存储器，其适于保持一个搜索区域列或一个搜索区域的像素块行，这取决于扫描方向和扫描读取和取出功能在存储器单元中去耦 （14）。 获取功能集中在较高的缓存级别，而读取功能集中在较低的缓存级别。 这样可以实现并行读取和取出，从而提高数据处理设备的性能。

公开(公告)号：US20180165210A1

公开(公告)日：2018-06-14

申请号：US15373682

申请日：2016-12-09

申请人： Ramanathan Sethuraman

发明人： Ramanathan Sethuraman

IPC分类号： G06F12/0875 ,  G06F12/0891 ,  G06F12/0842 ,  G06F9/30

CPC分类号： G06F12/0875 ,  G06F9/30021 ,  G06F9/30145 ,  G06F11/34 ,  G06F12/0842 ,  G06F12/0891 ,  G06F2212/452 ,  G06F2212/62 ,  Y02D10/34

摘要： In one embodiment, an apparatus includes: a storage having a plurality of entries each to store address information of an instruction and a count value of a number of executions of the instruction during execution of code including the instruction; and at least one comparator circuit to compare a count value from one of the plurality of entries to a threshold value, where the instruction is a tagged instruction of the code, the tagged instruction tagged by a static compiler prior to execution of the code. Other embodiments are described and claimed.

公开(公告)号：US20080215644A1

公开(公告)日：2008-09-04

申请号：US11908965

申请日：2006-03-15

申请人： Aleksandar Beric ,  Ramanathan Sethuraman

发明人： Aleksandar Beric ,  Ramanathan Sethuraman

IPC分类号： G06F12/02 ,  G06F17/30

CPC分类号： G11C8/04 ,  G06T1/60 ,  H04N19/426 ,  H04N19/433

摘要： The present invention relates to a data buffering device (600) particularly suited for use in a data processing device (700), which sequentially provides a two-dimensional array of data structures in a meandering manner. The data buffering device (600) comprises a circular buffer memory having a number of memory locations and a buffer-control unit, which is adapted to assign to an index pair of a current incoming data structure a write-pointer value from a pointer-value set in a periodical manner one write-pointer assignment period having -a first write-pointer assignment phase, during which the first index stepwise traverses the first index-value set in the first stepwise traverses pointer values in a first rotation direction defined within the pointer-value set, -a second write-pointer assignment phase, during which the first index value stepwise traverses the first index-value set in the second meandering direction, and the write pointer stepwise traverses pointer values in the first rotation direction, -a third write-pointer assignment phase, during which the first index stepwise traverses the first index-value set in the first meandering direction, and the write pointer stepwise traverses pointer values in a second rotation direction opposite to the first rotation direction, and a fourth write-pointer assignment phase, during which the first index value stepwise traverses the first index-value set in the second meandering direction, and the write pointer value stepwise traverses pointer values in the second rotation direction. The invention is particularly useful in the field of video processing, where a motion estimator provides a two-dimensional array of motion vectors in a meandering manner, which is used by a motion compensator having a non-meandering scan order

摘要翻译： 本发明涉及一种特别适用于数据处理设备（700）的数据缓冲设备（600），其以蜿蜒的方式依次提供数据结构的二维阵列。 数据缓冲装置（600）包括具有多个存储器位置的循环缓冲存储器和缓冲器控制单元，该缓冲器控制单元适于从当前输入数据结构的指针值分配来自指针值的写指针值 以定期方式设置一个写指针分配周期，其具有第一写指针分配阶段，在该写指针分配周期期间，第一指数逐步遍历在第一阶段中设置的第一索引值，在指针内定义的第一旋转方向上遍历指针值 - 值集合， - 第二写指针分配阶段，在该第二写指针分配阶段期间，第一索引值逐步遍历在第二曲折方向中设置的第一索引值，并且写指针逐步遍历第一旋转方向上的指针值， - 第三 写指针分配阶段，其中第一索引逐步遍历第一曲折方向中设置的第一索引值，并且写指针逐步遍历尖点 r值与第一旋转方向相反的第二旋转方向，以及第四写指针分配阶段，在该第四写指针分配阶段期间，第一指标值逐步横穿第二曲折方向设置的第一指标值，并且写指针值逐步横移 第二旋转方向上的指针值。 本发明在视频处理领域特别有用，其中运动估计器以曲折的方式提供运动矢量的二维阵列，由具有非曲折扫描顺序的运动补偿器使用

公开(公告)号：US20080204602A1

公开(公告)日：2008-08-28

申请号：US11911021

申请日：2006-03-30

申请人： Aleksandar Beric ,  Ramanathan Sethuraman

发明人： Aleksandar Beric ,  Ramanathan Sethuraman

IPC分类号： H04N5/14

CPC分类号： H04N19/436 ,  H04N19/433 ,  H04N19/56

摘要： The present invention relates to the field of motion estimation in video processing. Specifically, the invention relates to a video-processing method and device for ascertaining motion vectors for a plurality of first pixel blocks forming a currently processed image region of a currently processed image of an image sequence. The invention addresses the problem of the impact of borders between neighboring image regions in region-based motion estimation on the quality of the video output in video applications like picture-rate up conversion. The video-processing device (100) of the invention comprises a processing unit (104), which is adapted to perform motion estimation on an image according to a fragmentation of the image into a number of image regions, each image a region containing the pixel blocks shared by a first number of pixel-block lines and a second number of pixel-block columns in accordance with an adjustable value of an aspect ratio of the image region, and to set a different aspect-ratio value for processing a next image of the image sequence, such that the number of image regions per image remains constant. The dynamic change of the aspect ratio of the image regions implemented in the motion estimation device of the invention reduces the impact of the borders between neighboring image regions and thus improves the quality of region-based motion estimation.

摘要翻译： 本发明涉及视频处理中的运动估计领域。 具体地，本发明涉及一种用于确定形成图像序列的当前处理图像的当前处理图像区域的多个第一像素块的运动矢量的视频处理方法和装置。 本发明解决了基于区域的运动估计中的相邻图像区域之间的边界对视频输出在质量上的影响的问题，例如图像比率上变换。 本发明的视频处理装置（100）包括处理单元（104），该处理单元（104）适于根据图像的分段对图像执行运动估计到多个图像区域，每个图像包含像素的区域 根据图像区域的宽高比的可调整值，由第一数量的像素块行和第二数量的像素块列共享的块，并且设置用于处理图像区域的下一个图像的不同宽高比值 图像序列，使得每个图像的图像区域的数量保持不变。 在本发明的运动估计装置中实现的图像区域的纵横比的动态变化减小了相邻图像区域之间的边界的影响，从而提高了基于区域的运动估计的质量。

公开(公告)号：US20080192827A1

公开(公告)日：2008-08-14

申请号：US11910997

申请日：2006-04-04

申请人： Aleksander Beric ,  Ramanathan Sethuraman

发明人： Aleksander Beric ,  Ramanathan Sethuraman

IPC分类号： H04N7/12

CPC分类号： H04N5/145 ,  H04N19/433 ,  H04N19/56

摘要： The present invention relates to the field of motion estimation in video processing. Specifically the invention relates to a video-processing method and device for ascertaining motion vectors for a plurality of first pixel blocks forming a currently processed image region of a currently processed image of an image sequence. The invention addresses the problem of the impact of region-based motion estimation on the quality of the video output in video applications like picture-rate up conversion. The video-processing device of the invention comprises a processing unit, which is adapted to ascertain motion vectors for a plurality of first pixel blocks (C), which form a currently processed image region (200.1 to 200.14) of a currently processed image (200) of an image sequence, proceeding from image region to image region and processing a respective image region at least twice before proceeding to a next image region. Ascertaining a motion vector for a currently processed first pixel block (C) of the image region is performed by evaluating a respective set of candidate motion vectors containing at least one temporal candidate vector, which is a motion vector that was ascertained for a second pixel block (T) of a preceding image of the image sequence. The video-processing device of the invention is adapted to update, before processing a respective image region (200.2) of the currently processed image a second time, a temporal candidate vector, which was ascertained for a third pixel block located outside the currently processed image region (200.2) in the preceding image, by ascertaining a motion vector for the third pixel block (216) in the currently processed image and replacing the temporal candidate vector with it. By updating temporal motion vector candidates assigned to pixel blocks located outside the currently processed region in a first motion estimation pass, the quality of a motion estimation algorithm after the second or further motion estimation pass is improved in comparison with prior-art solutions.

公开(公告)号：US20070008342A1

公开(公告)日：2007-01-11

申请号：US10554385

申请日：2004-04-27

申请人： Ramanathan Sethuraman ,  Christiaan Varekamp ,  Fabian Ernst

发明人： Ramanathan Sethuraman ,  Christiaan Varekamp ,  Fabian Ernst

IPC分类号： G09G5/00

CPC分类号： H04N19/85 ,  G06T7/11 ,  G06T2207/10016 ,  G06T2207/20021

摘要： A method of converting of a first set (100a) of initial segments of an image into a second set of updated segments (A′,B′,C′,D′) is disclosed. The method comprises iterative updates of intermediate segments (A,B,C,D) being derived from respective initial segments. Each update comprises determining whether a pixel (300) should be moved from a first intermediate segment (A) to a second intermediate segment (B), on basis of a pixel value of the pixel, on basis of a first parameter of the intermediate segment (A) and on basis of a second parameter of the second intermediate segment (B). The iterative updates are performed on block base. That means that first a number of iterative updates are performed for pixels of a first two-dimensional block of pixels (200) of the image and after that the number of iterative updates are performed for pixels of a second two-dimensional block of pixels (204) of the image.

摘要翻译： 公开了一种将图像的初始段的第一组（100a）转换为第二组更新段（A'，B'，C'，D'）的方法。 该方法包括从相应的初始段导出的中间段（A，B，C，D）的迭代更新。 每个更新包括基于中间片段的第一参数来确定像素（300）是否应当从第一中间片段（A）移动到第二中间片段（B），基于像素的像素值 （A）并且基于第二中间段（B）的第二参数。 迭代更新以块为基础进行。 这意味着首先对图像的第一二维像素块（200）的像素执行多次迭代更新，然后针对第二二维像素块的像素执行迭代更新次数（ 204）的图像。