Digital video content fingerprinting based on scale invariant interest region detection with an array of anisotropic filters
    1.
    发明授权
    Digital video content fingerprinting based on scale invariant interest region detection with an array of anisotropic filters 有权
    基于尺度不变兴趣区域检测的数字视频内容指纹与各向异性过滤器阵列

    公开(公告)号:US09396393B2

    公开(公告)日:2016-07-19

    申请号:US14298261

    申请日:2014-06-06

    摘要: Video sequence processing is described with various filtering rules applied to extract dominant features for content based video sequence identification. Active regions are determined in video frames of a video sequence. Video frames are selected in response to temporal statistical characteristics of the determined active regions. A two pass analysis is used to detect a set of initial interest points and interest regions in the selected video frames to reduce the effective area of images that are refined by complex filters that provide accurate region characterizations resistant to image distortion for identification of the video frames in the video sequence. Extracted features and descriptors are robust with respect to image scaling, aspect ratio change, rotation, camera viewpoint change, illumination and contrast change, video compression/decompression artifacts and noise. Compact, representative signatures are generated for video sequences to provide effective query video matching and retrieval in a large video database.

    摘要翻译: 使用应用于提取用于基于内容的视频序列识别的主要特征的各种滤波规则来描述视频序列处理。 在视频序列的视频帧中确定有效区域。 响应于所确定的活动区域的时间统计特性来选择视频帧。 双通道分析用于检测所选择的视频帧中的一组初始兴趣点和感兴趣区域,以减少由复杂滤波器精化的图像的有效面积,该复杂滤波器提供抵抗图像失真的精确区域表征以识别视频帧 在视频序列中。 提取的特征和描述符在图像缩放,宽高比变化,旋转,相机视点改变,照明和对比度变化,视频压缩/解压缩伪像和噪声方面是稳健的。 为视频序列生成紧凑的代表性签名,以便在大型视频数据库中提供有效的查询视频匹配和检索。

    Methods and apparatus for motion search refinement in a SIMD array processor
    2.
    发明授权
    Methods and apparatus for motion search refinement in a SIMD array processor 有权
    SIMD阵列处理器中运动搜索精细化的方法和装置

    公开(公告)号:US09300958B2

    公开(公告)日:2016-03-29

    申请号:US14187499

    申请日:2014-02-24

    摘要: Various approaches for motion search refinement in a processing element are discussed. A k/2+L+k/2 register stores an expanded row of an L×L macro block. A k-tap filter horizontally interpolates over the expanded row generating horizontal interpolation results. A transpose storage unit stores the interpolated results generated by the k-tap filter for k/2+L+k/2 entries, wherein rows or columns of data may be read out of the transpose storage unit in pipelined register stages. A k-tap filter vertically interpolates over the pipelined register stages generating vertical interpolation results.

    摘要翻译: 讨论了处理元件中运动搜索细化的各种方法。 A k / 2 + L + k / 2寄存器存储L×L宏块的扩展行。 k抽头滤波器在扩展的行上水平内插,产生水平插值结果。 转置存储单元存储由k抽头滤波器为k / 2 + L + k / 2个条目生成的内插结果,其中数据行或列可以在流水线寄存器级中从转置存储单元中读出。 k抽头滤波器垂直内插在流水线寄存器级上,产生垂直插值结果。

    Methods and apparatus for providing a scalable deblocking filtering assist function within an array processor
    3.
    发明授权
    Methods and apparatus for providing a scalable deblocking filtering assist function within an array processor 有权
    用于在阵列处理器内提供可扩展去块滤波辅助功能的方法和装置

    公开(公告)号:US09060169B2

    公开(公告)日:2015-06-16

    申请号:US14011835

    申请日:2013-08-28

    摘要: Apparatus and methods for scalable block pixel filtering are described. A block filtering instruction is issued to a processing element (PE) to initiate block pixel filtering hardware by causing at least one command and at least one parameter be sent to a command and control function associated with the PE. A block of pixels is fetched from a PE local memory to be stored in a register file of a hardware assist module. A sub-block of pixels is processed to generate sub-block parameters and the block of pixels is filtered in a horizontal/vertical edge filtering computation pipeline using the sub-block parameters.

    摘要翻译: 描述了可扩展块像素滤波的装置和方法。 通过使至少一个命令和至少一个参数发送到与PE相关联的命令和控制功能,向处理元件(PE)发出块过滤指令以发起块像素过滤硬件。 从PE本地存储器中取出一块像素以存储在硬件辅助模块的寄存器文件中。 处理像素的子块以产生子块参数,并且使用子块参数在水平/垂直边缘滤波计算流水线中对像素块进行滤波。

    Methods And Apparatus For Motion Search Refinement In A SIMD Array Processor
    4.
    发明申请
    Methods And Apparatus For Motion Search Refinement In A SIMD Array Processor 审中-公开
    用于SIMD阵列处理器中运动搜索优化的方法和装置

    公开(公告)号:US20140314152A1

    公开(公告)日:2014-10-23

    申请号:US14187499

    申请日:2014-02-24

    IPC分类号: H04N19/433 H04N19/57

    摘要: Various approaches for motion search refinement in a processing element are discussed. A k/2+L+k/2 register stores an expanded row of an L×L macro block. A k-tap filter horizontally interpolates over the expanded row generating horizontal interpolation results. A transpose storage unit stores the interpolated results generated by the k-tap filter for k/2+L+k/2 entries, wherein rows or columns of data may be read out of the transpose storage unit in pipelined register stages. A k-tap filter vertically interpolates over the pipelined register stages generating vertical interpolation results.

    摘要翻译: 讨论了处理元件中运动搜索细化的各种方法。 A k / 2 + L + k / 2寄存器存储L×L宏块的扩展行。 k抽头滤波器在扩展的行上水平内插,产生水平插值结果。 转置存储单元存储由k抽头滤波器为k / 2 + L + k / 2个条目生成的内插结果,其中数据行或列可以在流水线寄存器级中从转置存储单元中读出。 k抽头滤波器垂直内插在流水线寄存器级上,产生垂直插值结果。

    Method for Efficient Database Formation and Search on Media Devices Acting Synchronously with Television Programming
    5.
    发明申请
    Method for Efficient Database Formation and Search on Media Devices Acting Synchronously with Television Programming 有权
    有效的数据库形成和搜索与电视节目同步的媒体设备的方法

    公开(公告)号:US20130246457A1

    公开(公告)日:2013-09-19

    申请号:US13826502

    申请日:2013-03-14

    IPC分类号: G06F17/30

    摘要: Techniques for efficient database formation and search in applications embedded in a media device are provided. The search may be performed synchronously with presentation of media programming content on a nearby media presentation device. A mobile media device captures some temporal fragments of the presented audio/video content on its microphone and camera, and then generates query fingerprints for the captured fragment. A local reference database resides on the mobile media device and a master reference database resides on a remote server with a most recent chunk of reference fingerprints transferred dynamically to the local mobile media device. A chunk of the query fingerprints generated locally on the mobile media device are searched on the local reference database for continuous content search and identification. The method presented automatically switches between the local search on the mobile media device and a remote search on an external search server.

    摘要翻译: 提供了用于在嵌入在媒体设备中的应用中有效的数据库形成和搜索的技术。 搜索可以与附近的媒体呈现设备上的媒体节目内容的呈现同步地执行。 移动媒体设备捕获其麦克风和相机上呈现的音频/视频内容的一些时间片段,然后为捕获的片段生成查询指纹。 本地参考数据库驻留在移动媒体设备上,主参考数据库驻留在远程服务器上,最近一批参考指纹被动态传输到本地移动媒体设备。 在本地参考数据库上搜索在移动媒体设备上本地生成的查询指纹的块,用于连续内容搜索和识别。 所呈现的方法自动地在移动媒体设备上的本地搜索和外部搜索服务器上的远程搜索之间进行切换。

    Methods and Apparatus for Providing a Scalable Identification of Digital Video Sequences
    6.
    发明申请
    Methods and Apparatus for Providing a Scalable Identification of Digital Video Sequences 有权
    提供数字视频序列可扩展识别的方法和装置

    公开(公告)号:US20120237129A1

    公开(公告)日:2012-09-20

    申请号:US13488568

    申请日:2012-06-05

    IPC分类号: G06K9/48

    CPC分类号: G06K9/00711

    摘要: Scaleable video sequence processing with various filtering rules is applied to extract dominant features, and generate unique set of signatures based on video content. Video sequence structuring and subsequent video sequence characterization is performed by tracking statistical changes in the content of a succession of video frames and selecting suitable frames for further treatment by region based intra-frame segmentation and contour tracing and description. Compact representative signatures are generated on the video sequence structural level as well as on the selected video frame level, resulting in an efficient video database formation and search.

    摘要翻译: 应用具有各种过滤规则的可扩展视频序列处理来提取主要特征,并且基于视频内容生成唯一的签名集合。 通过跟踪一系列视频帧的内容中的统计变化并选择合适的帧以进行基于区域的帧内分割和轮廓跟踪和描述的进一步处理来执行视频序列构造和后续视频序列表征。 在视频序列结构层面以及所选择的视频帧级别上生成紧凑的代表性签名,从而形成和搜索高效的视频数据。

    Methods and apparatus for quarter-pel refinement in a SIMD array processor
    7.
    发明授权
    Methods and apparatus for quarter-pel refinement in a SIMD array processor 有权
    SIMD阵列处理器中四分之一像素细化的方法和装置

    公开(公告)号:US08208553B2

    公开(公告)日:2012-06-26

    申请号:US11736849

    申请日:2007-04-18

    IPC分类号: H04N7/26

    摘要: An apparatus and a method for quarter-pel motion compensated search are described in the context of an array processor with tightly coupled, multi-cycle hardware assist attached to each node. A quarter-pel motion compensated search (QPMCS) instruction initiates the quarter-pel motion compensated search pipeline operation. An instruction decode and instruction operation control unit generates a starting address for a 4×4 block of a current macro block search operation indicating where to fetch the pel values. An interpolation unit determines at least eight neighboring quarter-pels per pipeline stage based on the 4×4 block of pel values. An absolute value of difference function computes the absolute value of difference values between a current macro block pel and the at least eight neighboring quarter-pels per pipeline stage. An accumulator accumulates at least eight summation values for the 4×4 block at quarter-pel positions per pipeline stage.

    摘要翻译: 在具有连接到每个节点的紧密耦合的多周期硬件辅助的阵列处理器的上下文中描述了用于四分之一像素运动补偿搜索的装置和方法。 四分之一像素运动补偿搜索(QPMCS)指令启动四分之一像素运动补偿搜索管道操作。 指令解码和指令操作控制单元产生指示在哪里获取像素值的当前宏块搜索操作的4×4块的起始地址。 内插单元基于像素值的4×4块来确定每个流水线阶段的至少八个相邻四分之一像素。 差分函数的绝对值计算当前宏块和每个流水线阶段至少八个相邻四分之一像素之间的差值的绝对值。 累加器在每个流水线阶段的四分之一像素位置累积至少八个累加值,用于4×4块。

    Methods and Apparatus for Attaching Application Specific Functions Within an Array Processor
    8.
    发明申请
    Methods and Apparatus for Attaching Application Specific Functions Within an Array Processor 有权
    在阵列处理器中附加应用程序特定功能的方法和装置

    公开(公告)号:US20110153998A1

    公开(公告)日:2011-06-23

    申请号:US13037824

    申请日:2011-03-01

    IPC分类号: G06F9/30

    摘要: A multi-node video signal processor (VSPN) is describes that tightly couples multiple multi-cycle state machines (hardware assist units) to each processor and each memory in each node of an N node scalable array processor. VSPN memory hardware assist instructions are used to initiate multi-cycle state machine functions, to pass parameters to the multi-cycle state machines, to fetch operands from a node's memory, and to control the transfer of results from the multi-cycle state machines.

    摘要翻译: 描述了一种多节点视频信号处理器(VSPN),它将多个多周期状态机(硬件辅助单元)紧密耦合到N个节点可扩展阵列处理器的每个节点的每个处理器和每个存储器。 VSPN存储器硬件辅助指令用于启动多周期状态机功能,将参数传递到多周期状态机,从节点的存储器获取操作数,并控制多循环状态机的结果传输。

    Method and Apparatus for Multi-Dimensional Content Search and Video Identification
    9.
    发明申请
    Method and Apparatus for Multi-Dimensional Content Search and Video Identification 有权
    用于多维内容搜索和视频识别的方法和装置

    公开(公告)号:US20080313140A1

    公开(公告)日:2008-12-18

    申请号:US12141337

    申请日:2008-06-18

    IPC分类号: G06F17/30

    摘要: A multi-dimensional database and indexes and operations on the multi-dimensional database are described which include video search applications or other similar sequence or structure searches. Traversal indexes utilize highly discriminative information about images and video sequences or about object shapes. Global and local signatures around keypoints are used for compact and robust retrieval and discriminative information content of images or video sequences of interest. For other objects or structures relevant signature of pattern or structure are used for traversal indexes. Traversal indexes are stored in leaf nodes along with distance measures and occurrence of similar images in the database. During a sequence query, correlation scores are calculated for single frame, for frame sequence, and video clips, or for other objects or structures.

    摘要翻译: 描述了多维数据库以及关于多维数据库的索引和操作,其包括视频搜索应用或其他类似的序列或结构搜索。 遍历索引利用关于图像和视频序列或关于对象形状的高度辨别信息。 关键点周围的全局和本地签名用于紧凑和鲁棒的检索和感兴趣的图像或视频序列的辨别信息内容。 对于其他对象或结构,模式或结构的相关签名用于遍历索引。 遍历索引与距离测量一起存储在叶节点中,并在数据库中出现类似的图像。 在序列查询期间,计算单帧,帧序列和视频剪辑或其他对象或结构的相关分数。

    Method for efficient database formation and search on media devices acting synchronously with television programming
    10.
    发明授权
    Method for efficient database formation and search on media devices acting synchronously with television programming 有权
    有效数据库形成和搜索与电视节目同步行动的媒体设备的方法

    公开(公告)号:US09367544B2

    公开(公告)日:2016-06-14

    申请号:US13826502

    申请日:2013-03-14

    IPC分类号: G06F17/30

    摘要: Techniques for efficient database formation and search in applications embedded in a media device are provided. The search may be performed synchronously with presentation of media programming content on a nearby media presentation device. A mobile media device captures some temporal fragments of the presented audio/video content on its microphone and camera, and then generates query fingerprints for the captured fragment. A local reference database resides on the mobile media device and a master reference database resides on a remote server with a most recent chunk of reference fingerprints transferred dynamically to the local mobile media device. A chunk of the query fingerprints generated locally on the mobile media device are searched on the local reference database for continuous content search and identification. The method presented automatically switches between the local search on the mobile media device and a remote search on an external search server.

    摘要翻译: 提供了用于在嵌入在媒体设备中的应用中有效的数据库形成和搜索的技术。 搜索可以与附近的媒体呈现设备上的媒体节目内容的呈现同步地执行。 移动媒体设备捕获其麦克风和相机上呈现的音频/视频内容的一些时间片段,然后为捕获的片段生成查询指纹。 本地参考数据库驻留在移动媒体设备上,主参考数据库驻留在远程服务器上,最近一批参考指纹被动态传输到本地移动媒体设备。 在本地参考数据库上搜索在移动媒体设备上本地生成的查询指纹的块,用于连续内容搜索和识别。 所呈现的方法自动地在移动媒体设备上的本地搜索和外部搜索服务器上的远程搜索之间进行切换。