公开(公告)号：US07593618B2

公开(公告)日：2009-09-22

申请号：US10471429

申请日：2002-03-15

申请人： Li-Qun Xu ,  Alan Hanjalic

发明人： Li-Qun Xu ,  Alan Hanjalic

IPC分类号： H04N5/93

CPC分类号： G06F17/30787 ,  G06F17/30811

摘要： A sequence of intensity measures is determined corresponding to each of a sequence of video frames. Such can be used for selection of videos according to user preferences and for providing highlights from a video sequence. Low level video characteristics are used which may be related to arousal and valence affects conveyed to a viewer while watching the video recording.

摘要翻译： 根据视频帧序列确定强度测量序列。 这样可以用于根据用户偏好选择视频，并用于从视频序列中提供高清。 使用低级视频特性，其可能与在观看视频记录时传送给观看者的觉醒和价值影响有关。

公开(公告)号：US20110317982A1

公开(公告)日：2011-12-29

申请号：US13203685

申请日：2010-02-26

申请人： Li-Qun Xu ,  Arasanathan Anjulan

发明人： Li-Qun Xu ,  Arasanathan Anjulan

IPC分类号： H04N9/80

CPC分类号： G06K9/6251 ,  G06F16/739 ,  G06K9/00765 ,  G06K9/6224

摘要： A method of segmenting a sequence of video images according to scene activity, the method comprising: defining a first series of nodes in a first multi-dimensional space, each node corresponding to an image of the sequence of video images; defining a transformation function that maps each of the first series of nodes to a corresponding node in a second multi-dimensional space having a lower dimensionality than the first multi-dimensional space; applying said transformation function to each of the first series of nodes to define a second series of respective nodes in the second multi-dimensional space; applying a data clustering algorithm to the second series of nodes to identify clusters of nodes within the second multi-dimensional space, the data clustering algorithm being constrained by a measure of feature distance between a pair of clusters of nodes and a measure of temporal distance between the pair of clusters of nodes; determining a representative image from each cluster of nodes and plotting each representative image with respect to a measure of the elapsed time of the sequence of video images to form an scene density curve indicating the underlying scene change activities; and segmenting the sequence of video images in accordance with local minima and/or maxima of the scene density curve.

摘要翻译： 一种根据场景活动分割视频图像序列的方法，所述方法包括：定义第一多维空间中的第一系列节点，每个节点对应于视频图像序列的图像; 定义将所述第一系列节点中的每一个映射到具有比所述第一多维空间小的维度的第二多维空间中的对应节点的变换函数; 将所述变换函数应用于所述第一系列节点中的每一个以限定所述第二多维空间中的相应节点的第二系列; 将数据聚类算法应用于第二系列节点以识别第二多维空间内的节点簇，数据聚类算法受到一对节点簇之间的特征距离的测量以及时间距离的度量 一对节点簇; 确定来自每个节点簇的代表图像，并针对所述视频图像序列的经过时间的度量来绘制每个代表图像，以形成指示下一个场景变化活动的场景密度曲线; 以及根据场景密度曲线的局部最小值和/或最大值来分割视频图像序列。

公开(公告)号：US20110307215A1

公开(公告)日：2011-12-15

申请号：US13150503

申请日：2011-06-01

申请人： Li-Qun Xu

发明人： Li-Qun Xu

IPC分类号： G06F15/00 ,  G01B21/16

CPC分类号： G01S7/40 ,  G01S13/08

摘要： A distance detection system and method for use in a hand-held electronic device is described. The distance detection system comprises an input unit used to input at least one instruction; at least one processing device having a timing element and a calculating element; at least one signal device; and an air inspecting unit. The signal device is used to transmit a signal to a detecting object in response to the instruction, and to receive a response signal from the detecting object. The timing element is used to measure an interval between transmitting the signal and receiving the response signal. The air inspecting unit is used to detect a condition of air between the hand-held electronic device and the detecting object. The data of the detected air condition can be converted into a parameter to calculate distance data corresponding to a distance from both the parameter and the measured interval.

摘要翻译： 描述了用于手持电子设备的距离检测系统和方法。 距离检测系统包括用于输入至少一条指令的输入单元; 至少一个具有定时元件和计算元件的处理装置; 至少一个信号装置; 和一个空中检查单位。 信号装置用于响应于该指令将信号发送到检测对象，并从检测对象接收响应信号。 定时元件用于测量发送信号和接收响应信号之间的间隔。 空气检查单元用于检测手持电子装置与检测对象物之间的空气状况。 可以将检测到的空气状况的数据转换为参数，以计算与参数和测量间隔两者相对应的距离的距离数据。

公开(公告)号：US07444033B2

公开(公告)日：2008-10-28

申请号：US10499680

申请日：2002-12-24

申请人： Jianmin Jiang ,  Li-Qun Xu

发明人： Jianmin Jiang ,  Li-Qun Xu

IPC分类号： G06K9/36 ,  G06K9/68 ,  G06K9/46

CPC分类号： H04N19/44 ,  H04N19/132 ,  H04N19/176 ,  H04N19/60

摘要： The luminance and chrominance values of pixels encoded according to MPEG or JPEG encoding are extracted using a forward discrete cosine transform (DCT). The forward DCT used in MPEG encoding is analyzed to derive a set of equations which directly relate a pixel value in an encoded image to one or more of the DCT coefficients obtained via the forward DCT transform in the usual image encoding process. These predetermined equations are used to allow for extremely fast and computationally efficient extraction of pixel values directly from the DCT coefficients of an encoded pixel block, without having to undergo an inverse DCT transform. Original images from MPEG and JPEG encoded versions may be extracted in a fast and efficient manner.

摘要翻译： 使用前向离散余弦变换（DCT）提取根据MPEG或JPEG编码编码的像素的亮度和色度值。 分析在MPEG编码中使用的前向DCT，以得到一组方程式，其将编码图像中的像素值直接关联到通常的图像编码处理中通过前向DCT变换获得的一个或多个DCT系数。 这些预定方程用于允许直接从编码像素块的DCT系数极大地快速且计算上有效地提取像素值，而不必进行逆DCT变换。 可以以快速有效的方式提取来自MPEG和JPEG编码版本的原始图像。

公开(公告)号：US20100150403A1

公开(公告)日：2010-06-17

申请号：US12161100

申请日：2007-01-17

申请人： Andrea Cavallaro ,  Li-Qun Xu

发明人： Andrea Cavallaro ,  Li-Qun Xu

IPC分类号： G06K9/00

CPC分类号： G08B21/0476 ,  G06K9/00778 ,  G06K9/00785 ,  G06T7/254 ,  G08B13/19613

摘要： A video signal is analysed by deriving for each frame a plurality of parameters, said parameters including (a) at least one parameter that is a function of the difference between picture elements of that frame and correspondingly positioned picture elements of a reference frame; (b) at least one parameter that is a function of the difference between picture elements of that frame and correspondingly positioned picture elements of a previous frame; and (c) at least one parameter that is a function of the difference between estimated velocities of picture elements of that frame and the estimated velocities of the correspondingly positioned elements of an earlier frame. Based on these parameters, each frame is assigned one or more of a plurality of predetermined classifications. Scene changes may then be identified as points at which changes occur in these classification assignments.

摘要翻译： 通过为每个帧导出多个参数来分析视频信号，所述参数包括（a）至少一个参数，该参数是该帧的图像元素与相应定位的参考帧的图像元素之间的差异的函数; （b）至少一个参数，其是该帧的图像元素与相应定位的先前帧的图像元素之间的差异的函数; 和（c）至少一个参数，其是该帧的图像元素的估计速度与较早帧的相应定位的元素的估计速度之差的函数。 基于这些参数，为每个帧分配多个预定分类中的一个或多个。 然后可以将场景变化确定为在这些分类分配中发生变化的点。

公开(公告)号：US20080181453A1

公开(公告)日：2008-07-31

申请号：US11886167

申请日：2006-03-01

申请人： Li-Qun Xu ,  Pere P Folch

发明人： Li-Qun Xu ,  Pere P Folch

IPC分类号： G06K9/00

CPC分类号： G06T7/277 ,  G06T7/194 ,  G06T7/215 ,  G06T7/251 ,  G06T2207/10016

摘要： A video surveillance system (10) comprises a camera (25), a personal computer (PC) (27) and a video monitor (29). Video processing software is provided on the hard disk drive of the PC (27). The software is arranged to perform a number of processing operations on video data received from the camera, the video data representing individual frames of captured video. In particular, the software is arranged to identify one or more foreground blobs in a current frame, to match the or each blob with an object identified in one or more previous frames, and to track the motion of the or each object as more frames are received. In order to maintain the identity of objects during an occlusion event, an appearance model is generated for blobs that are close to one another in terms of image position. Once occlusion takes place, the respective appearance models are used to segment the resulting group blob into regions which are classified as representing one or other of the merged objects.

摘要翻译： 视频监控系统（10）包括照相机（25），个人计算机（PC）（27）和视频监视器（29）。 在PC的硬盘驱动器上提供视频处理软件（27）。 该软件被配置为对从相机接收的视频数据执行多个处理操作，该视频数据表示所捕获的视频的各个帧。 特别地，软件被安排为识别当前帧中的一个或多个前景斑点，以使该或每个斑点与在一个或多个先前帧中标识的对象相匹配，并且当多个帧为 收到了 为了在遮挡事件期间保持对象的身份，在图像位置方面，为彼此靠近的斑点生成外观模型。 一旦发生封闭，则使用各自的外观模型将所得到的组块划分成被分类为表示合并对象中的一个或另一个的区域。

公开(公告)号：US20070092110A1

公开(公告)日：2007-04-26

申请号：US10577733

申请日：2004-11-08

申请人： Li-Qun Xu ,  Jose Landabaso

发明人： Li-Qun Xu ,  Jose Landabaso

IPC分类号： G06K9/00

CPC分类号： G06T7/248 ,  G06T7/246 ,  G06T2207/10016 ,  G06T2207/30248

摘要： This invention provides an object tracking method and system for tracking objects in video frames which takes into account the scaling and variance of each matching feature. This provides for some latitude in the choice of matching feature, whilst ensuring that as many matching features as possible can be used to determine matches between objects, thus giving increased accuracy in the matching thus determined. A parallel matching approach is used, and heuristic rules employed to account for occlusions between objects.

摘要翻译： 本发明提供了一种用于跟踪视频帧中的对象的对象跟踪方法和系统，其考虑了每个匹配特征的缩放和方差。 这提供了选择匹配特征的一些纬度，同时确保尽可能多的匹配特征可以用于确定对象之间的匹配，从而在如此确定的匹配中提高了准确性。 使用并行匹配方法，并且使用启发式规则来解释对象之间的闭塞。

公开(公告)号：US20060072663A1

公开(公告)日：2006-04-06

申请号：US10535621

申请日：2003-11-18

申请人： Yongmin Li ,  Li-Qun Xu ,  David Morrison ,  Charles Nightingale ,  Jason Morphett

发明人： Yongmin Li ,  Li-Qun Xu ,  David Morrison ,  Charles Nightingale ,  Jason Morphett

IPC分类号： H04N11/02 ,  H04N7/00 ,  H04N7/12 ,  H04N11/04 ,  H04B1/66

CPC分类号： H04N19/23 ,  H04N19/513 ,  H04N19/527

摘要： The invention relates to estimating the global motion between frames of a motion-compensated inter-frame encoded video sequence, directly from the motion vectors encoded within the frames. For any particular frame, the motion vectors are first decoded, and a finite number of sets of vectors are selected. An affine or other geometrical transform is then used to generate a motion estimation for each set, and then the least median squared error present in each motion estimation is calculated for each estimation. The motion estimation with the smallest least median squared error is then selected as being representative of the global motion in the image of the frame. A panoramic image generating method and system which makes uses of the global motion estimations thus obtained is also described

摘要翻译： 本发明涉及直接从帧内编码的运动矢量估计运动补偿帧间编码视频序列的帧之间的全局运动。 对于任何特定帧，首先对运动矢量进行解码，并选择有限数量的矢量集。 然后使用仿射或其他几何变换来为每个集合生成运动估计，然后针对每个估计计算每个运动估计中存在的最小中值平方误差。 然后选择具有最小最小中值平方误差的运动估计作为帧的图像中的全局运动的代表。 还描述了使用如此获得的全局运动估计的全景图像产生方法和系统

公开(公告)号：US20060023786A1

公开(公告)日：2006-02-02

申请号：US10535420

申请日：2003-11-18

申请人： Yongmin Li ,  Li-Qun Xu ,  David Morrison ,  Charles Nightngale

发明人： Yongmin Li ,  Li-Qun Xu ,  David Morrison ,  Charles Nightngale

IPC分类号： H04N11/02 ,  H04N7/12 ,  H04N7/00 ,  H04N11/04 ,  H04B1/66

CPC分类号： G06T3/0087 ,  G06T7/20 ,  G06T7/30 ,  H04N19/527 ,  H04N19/573 ,  H04N19/577

摘要： The invention relates to estimating the global motion between frames of a motion-compensated inter-frame encoded video sequence, directly from the motion vectors encoded within the frames. For any particular frame, a motion estimation is determined from motion vectors direct from the frame's anchor frame to the frame in question. This motion estimation is then checked against pre-determined criteria, and where the criteria are not met, re-estimation along a different route is performed, using the bi-directional motion vectors contained within B-frames. A panoramic image generating method and system which makes uses of the global motion estimations thus obtained is also described.

摘要翻译： 本发明涉及直接从帧内编码的运动矢量估计运动补偿帧间编码视频序列的帧之间的全局运动。 对于任何特定的帧，从运动矢量直接从帧的锚帧到所涉及的帧确定运动估计。 然后根据预先确定的标准检查该运动估计，并且在不满足标准的情况下，使用包含在B帧内的双向运动矢量来执行不同路由的重新估计。 还描述了使用如此获得的全局运动估计的全景图像产生方法和系统。

公开(公告)号：US20050238238A1

公开(公告)日：2005-10-27

申请号：US10521732

申请日：2003-07-09

申请人： Li-Qun Xu ,  Yongmin Li

发明人： Li-Qun Xu ,  Yongmin Li

IPC分类号： G06F17/30 ,  G06K9/62 ,  G10L15/00

CPC分类号： G06K9/00711 ,  G06F16/7834

摘要： Audio/Visual data is classified into semantic classes such as News, Sports, Music video or the like by providing class models for each class and comparing input audio visual data to the models. The class models are generated by extracting feature vectors from training samples, and then subjecting the feature vectors to kernel discriminant analysis or principal component analysis to give discriminatory basis vectors. These vectors are then used to obtain further feature vector of much lower dimension than the original feature vectors, which may then be used directly as a class model, or used to train a Gaussian Mixture Model or the like. During classification of unknown input data, the same feature extraction and analysis steps are performed to obtain the low-dimensional feature vectors, which are then fed into the previously created class models to identify the data genre.

摘要翻译： 通过为每个类提供类模型并将输入的音频视觉数据与模型进行比较，将音频/视频数据分类为诸如新闻，体育，音乐视频等的语义类别。 通过从训练样本中提取特征向量生成类模型，然后对特征向量进行核判别分析或主成分分析，给出差异性基向量。 然后使用这些向量来获得比原始特征向量更低维度的更多的特征向量，其可以直接用作类模型，或者用于训练高斯混合模型等。 在未知输入数据的分类过程中，执行相同的特征提取和分析步骤以获得低维特征向量，然后将其馈送到先前创建的类模型中以识别数据类型。