公开(公告)号：US09662022B2

公开(公告)日：2017-05-30

申请号：US13871766

申请日：2013-04-26

申请人： Xerox Corporation

发明人： Survi Kyal ,  Lalit Keshav Mestha ,  Beilei Xu

IPC分类号： A61B5/024 ,  A61B5/00 ,  A61B5/021 ,  A61B5/0295

CPC分类号： A61B5/02405 ,  A61B5/021 ,  A61B5/02416 ,  A61B5/02444 ,  A61B5/0295 ,  A61B5/7225

摘要： What is disclosed is a system and method for extracting photoplethysmographic (PPG) signal (i.e., a cardiac signal) on a continuous basis from a time-series signals obtained from video images captured of a subject being monitored for cardiac function in a non-contact remote sensing environment involves the following. First, a time-series signal obtained from video images captured of a region of exposed skin where a photoplethysmographic (PPG) signal of a subject of interest can be registered. A sliding window is then used to define consecutive sequential segments of the time-series signal for processing. Each of the consecutive time-series signal segments is detrended such that low frequency variations and non-stationary components are removed. The detrended signals are processed to obtain, for each segment, a PPG signal. The PPG signal segments are then stitched together using a stitching method, as disclosed herein, to obtain a continuous PPG signal for the subject.

公开(公告)号：US09443289B2

公开(公告)日：2016-09-13

申请号：US13923612

申请日：2013-06-21

申请人： Xerox Corporation

发明人： Beilei Xu ,  Lalit Keshav Mestha ,  Survi Kyal ,  Himanshu J. Madhu

IPC分类号： G06K9/00 ,  G06T5/00 ,  G06T5/50 ,  G06T7/00

CPC分类号： G06T5/003 ,  G06T5/50 ,  G06T7/0016 ,  G06T2207/10016 ,  G06T2207/20201 ,  G06T2207/30088

摘要： What is disclosed is a system for compensating for motion induced artifacts in a physiological signal obtained from multiple videos of a first and second region of interest a subject being monitored for a desired physiological function. At least one of the videos being of the first region and at least one of the videos being of the second region. The first region being at least one area of exposed skin where a desired signal corresponding to the physiological function can be registered by a video imaging device. The second region being an area where a movement by the subject is likely to induce motion artifacts into the signal. The videos are processed to isolate pixels associated with the first and second regions. Processed pixels of the isolated first regions to obtain a composite time-series signal. From the composite signal, a physiological signal corresponding to the physiological function is extracted.

摘要翻译： 所公开的是一种用于补偿从受感染的第一和第二感兴趣区域的多个视频获得的生理信号中的运动诱发伪影的系统，该对象被监视为期望的生理功能。 至少一个视频是第一区域，并且至少一个视频是第二区域。 第一区域是暴露皮肤的至少一个区域，其中对应于生理功能的期望信号可由视频成像装置登记。 第二区域是被摄体的移动可能引起运动伪像进入信号的区域。 处理视频以分离与第一和第二区域相关联的像素。 隔离的第一区域的处理像素以获得复合时间序列信号。 从复合信号中提取与生理功能对应的生理信号。

公开(公告)号：US09036877B2

公开(公告)日：2015-05-19

申请号：US13871728

申请日：2013-04-26

申请人： Xerox Corporation

发明人： Survi Kyal ,  Lalit Keshav Mestha ,  Beilei Xu

IPC分类号： G06K9/00 ,  A61B5/00 ,  A61B5/024

CPC分类号： A61B5/7225 ,  A61B5/0013 ,  A61B5/0077 ,  A61B5/02416 ,  A61B5/7203 ,  A61B5/7278 ,  G06F19/00 ,  G06K9/00496 ,  G06T7/0016 ,  G06T2207/30004 ,  G06T2207/30076 ,  G16H40/67

摘要： What is disclosed is a novel system and method for extracting photoplethysmographic (PPG) signals (i.e., cardiac signals) on a continuous basis from signals generated from video images captured of a subject being monitored for cardiac function in a non-contact remote sensing environment. In one embodiment, a time-series signal is received. The time-series signal is generated from video images captured of a region of exposed skin where a PPG signal of a subject of interest can be registered. The time-series signal is then divided into batches for processing, with successive batches having at least a 95% overlap with a previous batch. Each of the batches of time-series signals is processed to obtain a PPG signal from each batch. A mid-point of each of these PPG-signals is stitched together to obtain a continuous PPG signal for the subject. The continuous PPG signal for the subject can then viewed on a display device.

摘要翻译： 所公开的是一种用于从非接触式遥感环境中心脏功能监测对象被捕获的视频图像产生的信号连续提取光电体积描记术（PPG）信号（即心脏信号）的新型系统和方法。 在一个实施例中，接收时间序列信号。 时间序列信号是从可以登记感兴趣对象的PPG信号的暴露皮肤区域拍摄的视频图像产生的。 然后将时间序列信号分成批次进行处理，其中连续批次与先前批次具有至少95％的重叠。 处理每批批次的时间序列信号以从每个批次获得PPG信号。 将这些PPG信号的每一个的中点缝合在一起以获得对象的连续的PPG信号。 然后可以在显示设备上观看被摄体的连续PPG信号。

公开(公告)号：US09521954B2

公开(公告)日：2016-12-20

申请号：US13921939

申请日：2013-06-19

申请人： Xerox Corporation

发明人： Beilei Xu ,  Lalit Keshav Mestha ,  Survi Kyal ,  Himanshu J. Madhu

IPC分类号： A61B5/00 ,  A61B5/0205

CPC分类号： A61B5/0077 ,  A61B5/0205 ,  A61B5/7221 ,  A61B5/7278 ,  A61B2562/04 ,  A61B2576/00

摘要： What is disclosed is a video system and method that accounts for differences in imaging characteristics of differing video systems used to acquire video of respective regions of interest of a subject being monitored for a desired physiological function. In one embodiment, video is captured using N video imaging devices, where N≧2, of respective regions of interest of a subject being monitored for a desired physiological function (i.e., a respiratory or cardiac function). Each video imaging device is different but has complimentary imaging characteristics. A reliability factor f is determined for each of the devices in a manner more fully disclosed herein. A time-series signal is generated from each of the videos. Each time-series signal is weighted by each respective reliability factor and combined to obtain a composite signal. A physiological signal can be then extracted from the composite signal. The processed physiological signal corresponds to the desired physiological function.

摘要翻译： 公开的是一种视频系统和方法，其考虑了用于获取正在被监视的期望生理功能的被摄体的感兴趣区域的视频的不同视频系统的成像特征的差异。 在一个实施例中，使用N个视频成像装置捕获视频，其中N≥2个被监测的对象的各个感兴趣区域用于期望的生理功能（即，呼吸或心脏功能）。 每个视频成像设备是不同的，但具有互补的成像特征。 以这里更全面地公开的方式为每个设备确定可靠性因子f。 从每个视频产生时间序列信号。 每个时间序列信号由每个相应的可靠性因子加权并组合以获得复合信号。 然后可以从复合信号中提取生理信号。 经处理的生理信号对应于所需的生理功能。

公开(公告)号：US09436984B2

公开(公告)日：2016-09-06

申请号：US13923588

申请日：2013-06-21

申请人： Xerox Corporation

发明人： Beilei Xu ,  Lalit Keshav Mestha ,  Survi Kyal ,  Himanshu J. Madhu

IPC分类号： G06K9/00 ,  G06T5/50 ,  G06T5/00

CPC分类号： G06T5/50 ,  G06T5/003 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/20201 ,  G06T2207/30088

摘要： What is disclosed is a system and method for compensating for motion induce artifacts in a physiological signal obtained from a video. In one embodiment, a video of a first and second region of interest of a subject being monitored for a desired physiological function is captured by a video device. The first region is an area of exposed skin wherein a desired signal corresponding to the physiological function can be registered. The second region is an area where movement is likely to induce motion artifacts into that signal. The video is processed to isolate pixels in the image frames associated with these regions. Pixels of the first region are processed to obtain a time-series signal. A physiological signal is extracted from the time-series signal. Pixels of the second region are analyzed to identify motion. The physiological signal is processed to compensate for the identified motion.

摘要翻译： 所公开的是用于补偿从视频获得的生理信号中的运动诱发伪影的系统和方法。 在一个实施例中，由视频设备捕获被监视用于期望生理功能的被摄体的第一和第二感兴趣区域的视频。 第一区域是暴露皮肤的区域，其中可以登记对应于生理功能的期望信号。 第二区域是运动可能引起运动伪影成该信号的区域。 处理视频以隔离与这些区域相关联的图像帧中的像素。 处理第一区域的像素以获得时间序列信号。 从时间序列信号中提取生理信号。 分析第二区域的像素以识别运动。 处理生理信号以补偿所识别的运动。

公开(公告)号：US09433386B2

公开(公告)日：2016-09-06

申请号：US13937740

申请日：2013-07-09

申请人： Xerox Corporation

发明人： Lalit Keshav Mestha ,  Survi Kyal ,  Barry P. Mandel ,  Peter Johan Nystrom

IPC分类号： A61B6/00 ,  A61B5/00 ,  A61B5/024

CPC分类号： A61B5/7282 ,  A61B5/0022 ,  A61B5/0024 ,  A61B5/02427 ,  A61B5/6831 ,  A61B5/746

摘要： What is disclosed is a method for monitoring a subject for cardiac arrhythmia such as atrial fibrillation using an apparatus that can be comfortably worn by the subject around an area of exposed skin where a photoplethysmographic (PPG) signal can be registered. In one embodiment, the apparatus is a reflective or transmissive wrist-worn device with emitter/detector pairs fixed to an inner side of a band with at least one illuminator emitting source light at a specified wavelength band. The illuminator is paired to a respective photodetector comprising one or more sensors that are sensitive to a wavelength band of its paired illuminator. The photodetector measures intensity of sensed light emitted by a respective illuminator. The signal obtained by the sensors comprises a continuous PPG signal. The continuous PPG signal analyzed for peak-to-peak pulse points from which the existence of cardiac arrhythmia such as atrial fibrillation event can be determined.

摘要翻译： 所公开的是用于使用可以被注射在光体积描记术（PPM）信号的暴露皮肤区域周围的受试者舒适佩戴的装置来监测心律失常的受试者的心律失常的方法，例如心房颤动。 在一个实施例中，该装置是具有发射器/检测器对的反射或透射腕部装置，其固定到带的内侧，其中至少一个照明器发射指定波长带的光源。 照明器与包括对其成对照明器的波长带敏感的一个或多个传感器的相应光电检测器配对。 光电检测器测量由相应照明器发射的感测光的强度。 由传感器获得的信号包括连续的PPG信号。 分析连续的PPG信号，从中可以确定心律失常如心房颤动事件的存在的峰 - 峰脉冲点。

公开(公告)号：US09245338B2

公开(公告)日：2016-01-26

申请号：US14281072

申请日：2014-05-19

申请人： Xerox Corporation

发明人： Lalit Keshav Mestha ,  Survi Kyal ,  Beilei Xu

IPC分类号： G06T7/00 ,  G06K9/00 ,  G06K9/20

CPC分类号： G06T7/0016 ,  A61B5/0077 ,  G06K9/00362 ,  G06K9/0053 ,  G06K9/0055 ,  G06K9/2018 ,  G06K2009/00939 ,  G06T7/254 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/10048 ,  G06T2207/30004 ,  G06T2207/30076

摘要： What is disclosed is a system and method for increasing the accuracy of physiological signals obtained from video of a subject being monitored for a desired physiological function. In one embodiment, image frames of a video are received. Successive batches of image frames are processed. For each batch, pixels associated with an exposed body region of the subject are isolated and processed to obtain a time-series signal. If movement occurred during capture of these image frames that is below a pre-defined threshold level then parameters of a predictive model are updated using this batch's time-series signal. Otherwise, the last updated predictive model is used to generate a predicted time-series signal for this batch. The time-series signal is fused with the predicted time-series signal to obtain a fused time-series signal. The time-series signal for each batch is processed to obtain a physiological signal for the subject corresponding to the physiological function.

摘要翻译： 所公开的是用于增加从所监视的受试者的视频获得的生理信号的准确性的系统和方法，用于期望的生理功能。 在一个实施例中，接收视频的图像帧。 处理连续批量的图像帧。 对于每个批次，与对象的暴露的身体区域相关联的像素被隔离并被处理以获得时间序列信号。 如果在捕获低于预定阈值水平的图像帧的情况下发生移动，则使用该批次的时间序列信号来更新预测模型的参数。 否则，最后更新的预测模型用于生成该批次的预测时间序列信号。 时间序列信号与预测的时间序列信号融合以获得融合的时间序列信号。 处理每个批次的时间序列信号以获得与生理功能相对应的对象的生理信号。

公开(公告)号：US08976859B2

公开(公告)日：2015-03-10

申请号：US13708125

申请日：2012-12-07

申请人： Xerox Corporation

发明人： Lalit Keshav Mestha ,  Survi Kyal ,  Sohail A. Dianat

IPC分类号： H04N5/14 ,  G06T3/40 ,  H04N7/01

CPC分类号： G06T3/4007 ,  G06T3/4053 ,  H04N7/01 ,  H04N7/0135

摘要： What is disclosed is a novel video processing system and method wherein a plurality of image frames of a video captured using a video camera with a spatial resolution of (M×N) in the (x, y) direction, respectively, and a temporal resolution (T) in frames per unit of time. A first and second magnification factor f1, f2 are selected for spatial enhancement in the (x, y) direction. A third magnification factor f3 is selected for a desired temporal enhancement in (T). The video data is processed using a dictionary comprising high and low resolution patch cubes which are used to induce spatial and temporal components in the video where no data exists. A high resolution course video X0 is generated which has an enhanced spatial resolution of (f1*M)×(f2*N) and an enhanced temporal resolution of (f3*T) frames. The course high resolution video is then smoothed, when found required, to generate a smoothed high resolution video.

摘要翻译： 所公开的是一种新颖的视频处理系统和方法，其中使用在（x，y）方向上具有（M×N）的空间分辨率的摄像机捕获的视频的多个图像帧分别为（x，y） （T）以每单位时间的帧为单位。 选择第一和第二放大因子f1，f2用于（x，y）方向上的空间增强。 在（T）中为期望的时间增强选择第三放大因子f3。 使用包括高分辨率和低分辨率片段立方体的字典来处理视频数据，这些立方体用于在没有数据存在的视频中诱导空间和时间分量。 产生具有（f1 * M）×（f2 * N）的增强的空间分辨率和（f3 * T）帧的增强的时间分辨率的高分辨率过程视频X0。 当高分辨率视频被发现时需要平滑化，以产生平滑的高分辨率视频。

公开(公告)号：US09986923B2

公开(公告)日：2018-06-05

申请号：US14593271

申请日：2015-01-09

申请人： Xerox Corporation

发明人： Lalit Keshav Mestha ,  Martin Edward Hoover ,  Survi Kyal

IPC分类号： A61B5/024 ,  A61B5/00

CPC分类号： A61B5/02433 ,  A61B5/0013 ,  A61B5/7203 ,  A61B5/7225 ,  A61B5/725 ,  A61B5/748 ,  A61B2576/00

摘要： What is disclosed is a system and method for selecting a region of interest for extracting physiological parameters from a video of a subject. In one embodiment the present method involves performing the following. First, time-series signals are received which have been generated by having processing image frames of a video of a subject captured using a single band video camera with a bandpass filter with a pass band in a wavelength range of 495-565 nm and/or 800-1000 nm. The regions of interest are areas where a plethysmographic signal can be detected by the camera. Each time-series signal is associated with a different region of interest. A signal strength is then calculated for each of the time-series signals. The region associated with the time-series signal having a highest signal strength is selected. The time-series signal associated with the selected region can be processed to extract a videoplethysmographic (VPG) signal containing physiological parameters.

公开(公告)号：US09320440B2

公开(公告)日：2016-04-26

申请号：US14242322

申请日：2014-04-01

申请人： Xerox Corporation

发明人： Survi Kyal ,  Lalit Keshav Mestha ,  Jean-Philippe Couderc

IPC分类号： A61B5/02 ,  A61B5/00 ,  A61B5/0295 ,  A61B5/107

CPC分类号： A61B5/0077 ,  A61B5/0082 ,  A61B5/0295 ,  A61B5/1073

摘要： What is disclosed is a system and method for determining whether a subject is in atrial fibrillation. A video is received of a region of exposed skin of a subject. The video is acquired of a region where a videoplethysmographic (VPG) signal can be registered by at least one imaging channel of a video imaging device. For each batch of image frames, pixels associated with the region of exposed skin are isolated and processed to obtain a time-series signal. A VPG signal is extracted from the time-series signal. The power spectral density (PSD) is computed across all frequencies within the VPG signal. A pulse harmonic strength (PHS) is calculated for this VPG signal. The pulse harmonic strength is compared to a discrimination threshold, defined herein. A determination is made whether the subject in the video is in atrial fibrillation or in normal sinus rhythm.

摘要翻译： 公开的是用于确定受试者是否在心房颤动中的系统和方法。 收到受试者暴露皮肤区域的视频。 获取视频体积描记（VPG）信号的区域可以由视频成像设备的至少一个成像通道注册的视频。 对于每批图像帧，与暴露皮肤区域相关联的像素被隔离并处理以获得时间序列信号。 从时间序列信号中提取VPG信号。 在VPG信号内的所有频率上计算功率谱密度（PSD）。 为该VPG信号计算脉冲谐波强度（PHS）。 将脉冲谐波强度与本文定义的鉴别阈值进行比较。 视频中的主体是否处于心房颤动或正常窦性心律中。