公开(公告)号：US08617081B2

公开(公告)日：2013-12-31

申请号：US13247683

申请日：2011-09-28

申请人： Lalit Keshav Mestha ,  Survi Kyal ,  Gill Rafael Tsouri ,  Sohail A. Dianat ,  Beilei Xu

发明人： Lalit Keshav Mestha ,  Survi Kyal ,  Gill Rafael Tsouri ,  Sohail A. Dianat ,  Beilei Xu

IPC分类号： A61B5/02

CPC分类号： A61B5/0022 ,  A61B5/0077 ,  A61B5/024 ,  A61B2576/00 ,  G01J5/026 ,  G01J5/089 ,  G06F19/00 ,  G16H40/67

摘要： What is disclosed is a system and method for recovering a patient's cardiac pulse rate from a sequence of video images recording of that patient. In one embodiment, a reference signal of a particular frequency is generated at predetermined frequency intervals and a constrained source separation is performed on the source data to obtain an estimation of the source signal intended to be recovered. The reference signal is updated and constrained source separation is again performed. These operations are repeated for all frequencies of the reference signal. The frequency at which a minimum error is achieved is determined to be the subject's recovered cardiac pulse frequency. In such a manner, the source signal is extracted and recovered reliably from captured multi-channel RGB signals or multispectral signals. The teachings hereof find their uses in a variety of medical solutions including various military, security and telemedicine applications. Various embodiments are disclosed.

摘要翻译： 所公开的是用于从记录该患者的视频图像的序列中恢复患者心脏脉搏率的系统和方法。 在一个实施例中，以预定的频率间隔产生特定频率的参考信号，并且对源数据执行受限的源分离以获得旨在被恢复的源信号的估计。 更新参考信号并再次执行约束源分离。 对参考信号的所有频率重复这些操作。 实现最小误差的频率被确定为受试者的恢复心脏脉搏频率。 以这种方式，从捕获的多通道RGB信号或多光谱信号可靠地提取和恢复源信号。 其教学方法可用于各种医疗解决方案，包括各种军事，安全和远程医疗应用。 公开了各种实施例。

公开(公告)号：US08977347B2

公开(公告)日：2015-03-10

申请号：US13532057

申请日：2012-06-25

申请人： Lalit Keshav Mestha ,  Survi Kyal ,  Beilei Xu ,  Himanshu J. Madhu

发明人： Lalit Keshav Mestha ,  Survi Kyal ,  Beilei Xu ,  Himanshu J. Madhu

IPC分类号： A61B5/024

CPC分类号： A61B5/02405 ,  A61B5/0004 ,  A61B5/02416 ,  A61B5/7235 ,  A61B2576/00

摘要： What is disclosed is a video-based system and method for estimating heart rate variability from time-series signals generated from video images captured of a subject of interest being monitored for cardiac function. In a manner more fully disclosed herein, low frequency and high frequency components are extracted from a time-series signal obtained by processing a video of the subject being monitored. A ratio of the low and high frequency of the integrated power spectrum within these components is computed. Analysis of the dynamics of this ratio over time is used to estimate heart rate variability. The teachings hereof can be used in a continuous monitoring mode with a relatively high degree of measurement accuracy and find their uses in a variety of diverse applications such as, for instance, emergency rooms, cardiac intensive care units, neonatal intensive care units, and various telemedicine applications.

摘要翻译： 所公开的是一种基于视频的系统和方法，用于从由心脏功能监测的感兴趣对象的视频图像产生的时间序列信号估计心率变异性。 以这里更完全公开的方式，从通过处理被监视对象的视频获得的时间序列信号中提取低频和高频分量。 计算这些分量内的综合功率谱的低频和高频比。 分析这个比率随时间的动力学被用于估计心率变异性。 其教导可以以相对较高的测量精度的连续监测模式使用，并且可以在各种各样的应用中使用，例如急诊室，心脏重症监护病房，新生儿重症监护病房和各种各样的 远程医疗应用。

公开(公告)号：US08855384B2

公开(公告)日：2014-10-07

申请号：US13528307

申请日：2012-06-20

申请人： Survi Kyal ,  Lalit Keshav Mestha ,  Beilei Xu

发明人： Survi Kyal ,  Lalit Keshav Mestha ,  Beilei Xu

IPC分类号： G06K9/00

CPC分类号： G06K9/6217 ,  A61B5/024 ,  G06K9/0057 ,  G06K2209/05

摘要： What is disclosed is a computationally efficient system and method for estimating a subject's cardiac pulse rate from multi-channel source video data. In one embodiment, A time-series signal is received. A sliding window is used to define overlapping segments of the time-series signal. Signal segments are processed by performing constrained independent component analysis (cICA) until convergence to obtain an estimated source signal. A frequency of each estimated source signal obtained by the cICA at convergence is determined to be the subject's estimated cardiac pulse rate for each signal segment. A seed reference signal used by the cICA is repeatedly updated. A sliding window is shifted to define a next time-series signal segment for processing. The method repeats for each signal segment until a termination criteria is met. In such a manner, the subject's cardiac pulse rate is estimated from a video of the subject on a continuous basis.

摘要翻译： 所公开的是用于从多信道源视频数据估计被摄体的心脏脉搏率的计算有效的系统和方法。 在一个实施例中，接收时间序列信号。 滑动窗口用于定义时间序列信号的重叠段。 通过执行受约束的独立分量分析（cICA）直到收敛以获得估计的源信号来处理信号段。 将通过cICA在会聚处获得的每个估计的源信号的频率确定为每个信号段的被摄体估计的心脏脉搏率。 cICA使用的种子参考信号被重复更新。 移动滑动窗口以定义下一个时间序列信号段进行处理。 该方法对于每个信号段重复，直到满足终止标准。 以这种方式，从受试者的视频连续地估计受试者的心脏脉搏率。

公开(公告)号：US09301710B2

公开(公告)日：2016-04-05

申请号：US13529648

申请日：2012-06-21

申请人： Lalit Keshav Mestha ,  Edgar A. Bernal ,  Beilei Xu

发明人： Lalit Keshav Mestha ,  Edgar A. Bernal ,  Beilei Xu

IPC分类号： A61B5/05 ,  A61B5/107 ,  A61B5/00 ,  A61B5/08 ,  A61B5/11 ,  A61B5/113 ,  G01B11/25 ,  G06T7/00 ,  G06T7/20 ,  G06K9/00

CPC分类号： A61B5/1077 ,  A61B5/0064 ,  A61B5/0816 ,  A61B5/1128 ,  A61B5/1135 ,  G01B11/2527 ,  G06K9/0053 ,  G06T7/262 ,  G06T7/521 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/10048 ,  G06T2207/10152 ,  G06T2207/20044 ,  G06T2207/20056 ,  G06T2207/30076 ,  G09G2380/08

摘要： What is disclosed is a system and method for estimating a respiration rate by analyzing distortions in reflections of structured illumination patterns captured in a video containing a view of a subject's thoracic region. In one embodiment, a video of a target region of a body of a subject of interest is received. Video image frames are processed to estimate 3D time-series data for the target region. As more fully disclosed herein, the subject's respiration rate is estimated from the 3D time-series data. Measurements can be acquired under a diverse set of lighting conditions. The teachings hereof provide a non-contact approach to patient respiratory function monitoring that is useful for intensive care units and for monitoring at homes, and which aid in the detection of sudden deterioration of physiological conditions due to changes in respiration rates. The teachings hereof provide an effective tool for non-contact respiratory function study and analysis.

摘要翻译： 公开的是通过分析在包含受试者胸部区域的视图中捕获的结构化照明模式的反射中的失真来估计呼吸率的系统和方法。 在一个实施例中，接收感兴趣对象的身体的目标区域的视频。 处理视频图像帧以估计目标区域的3D时间序列数据。 如本文更全面地公开的，从3D时间序列数据估计对象的呼吸速率。 可以在多种照明条件下获得测量。 本文的教导为患者呼吸功能监测提供了非接触的方法，该方法对于重症监护病房有用，并且在家中进行监测，并且有助于检测呼吸速率变化引起的生理状况突然恶化。 本文的教导为非接触式呼吸功能研究和分析提供了有效的工具。

公开(公告)号：US09171196B2

公开(公告)日：2015-10-27

申请号：US13416436

申请日：2012-03-09

申请人： Yao Rong Wang ,  Lalit Keshav Mestha ,  Beilei Xu ,  Raja Bala ,  Graham Pennington

发明人： Yao Rong Wang ,  Lalit Keshav Mestha ,  Beilei Xu ,  Raja Bala ,  Graham Pennington

IPC分类号： H04N7/18 ,  G06K9/00 ,  H04N5/33 ,  G06K9/20

CPC分类号： G06K9/00255 ,  G06K9/00838 ,  G06K9/2018 ,  H04N5/33

摘要： What is disclosed is a system and method for selecting the optimal wavelength ban combination for a multi-band infrared camera system which is optimized for skin detection. An objective function is constructed specifically for this application from classified performance and the algorithm generates wavelengths by maximizing the objective function. A specific wavelength band combination is selected which maximizes the objective function. Also disclosed is a 3-band and 4-band camera system with filters each having a transmittance of one of a combination of wavelength bands optimized to detect skin in the infrared band. The camera systems disclosed herein find their intended uses in a wide array of vehicle occupancy detection systems and applications. Various embodiments are disclosed.

摘要翻译： 公开的是用于为针对皮肤检测而优化的多频带红外相机系统选择最佳波长禁止组合的系统和方法。 目标函数由分类性能专门为此应用构建，算法通过最大化目标函数生成波长。 选择使目标函数最大化的特定波段组合。 还公开了一种具有滤波器的三频带和四频带相机系统，每个滤波器具有被优化以检测红外频带中的皮肤的波长带的组合之一的透射率。 本文公开的相机系统在各种车辆占用检测系统和应用中找到其预期用途。 公开了各种实施例。

公开(公告)号：US09155475B2

公开(公告)日：2015-10-13

申请号：US13533605

申请日：2012-06-26

申请人： Beilei Xu ,  Lalit Keshav Mestha ,  Edgar A. Bernal

发明人： Beilei Xu ,  Lalit Keshav Mestha ,  Edgar A. Bernal

IPC分类号： H04N5/232 ,  A61B5/00 ,  H04N5/225 ,  H04N5/235

CPC分类号： A61B5/0077 ,  A61B5/0035 ,  A61B5/0073 ,  H04N5/2256 ,  H04N5/23296 ,  H04N5/2354

摘要： What is disclosed is a system and method for enabling hybrid video capture of a scene being illuminated with structured and unstructured illumination sources over a wavelength range of interest that significantly intersects with each other. In one embodiment, the present system comprises a video capture device for capturing video of a scene being actively illuminated by both a structured and unstructured illumination source; a controller for controlling a manipulation of at least one structured and at least one unstructured illumination sources during capture of the video by the video capture device; and a processor in communication with the controller, the processor executing machine readable program instructions effectuating the manipulation. Various embodiments are disclosed.

摘要翻译： 所公开的是一种系统和方法，用于实现在结构化和非结构化照明源上照射的场景的混合视频捕获，所述结构化和非结构化照明源在相互显着相交的感兴趣的波长范围内。 在一个实施例中，本系统包括用于捕获被结构化和非结构化照明源主动照亮的场景的视频的视频捕获设备; 控制器，用于在由所述视频捕捉设备拍摄所述视频期间控制对至少一个结构化和至少一个非结构化照明源的操纵; 以及与所述控制器通信的处理器，所述处理器执行执行所述操作的机器可读程序指令。 公开了各种实施例。

公开(公告)号：US09025024B2

公开(公告)日：2015-05-05

申请号：US13247343

申请日：2011-09-28

申请人： Beilei Xu ,  Wencheng Wu ,  Lalit Keshav Mestha ,  Graham Pennington

发明人： Beilei Xu ,  Wencheng Wu ,  Lalit Keshav Mestha ,  Graham Pennington

IPC分类号： H04N7/18 ,  G06K9/20 ,  H04N5/232 ,  H04N5/33

CPC分类号： G06K9/2018 ,  H04N5/23206 ,  H04N5/23219 ,  H04N5/332

摘要： What is disclosed is a system and method for identifying materials comprising an object captured in a video and for using the identified materials to track that object as it moves across the captured video scene. In one embodiment, a multi-spectral or hyper-spectral sensor is used to capture a spectral image of an object in an area of interest. Pixels in the spectral planes of the spectral images are analyzed to identify a material comprising objects in that area of interest. A location of each of the identified objects is provided to an imaging sensor which then proceeds to track the objects as they move through a scene. Various embodiments are disclosed.

摘要翻译： 公开的是用于识别包括在视频中捕获的对象的材料的系统和方法，并且用于当所述对象在所捕获的视频场景中移动时使用所识别的材料来跟踪该对象。 在一个实施例中，使用多光谱或超光谱传感器来捕获感兴趣区域中的对象的光谱图像。 分析光谱图像的光谱平面中的像素以识别包含该感兴趣区域中的物体的材料。 每个识别的对象的位置被提供给成像传感器，然后成像传感器在它们移动通过场景时跟踪对象。 公开了各种实施例。

公开(公告)号：US08600227B2

公开(公告)日：2013-12-03

申请号：US13239642

申请日：2011-09-22

申请人： Beilei Xu ,  Lalit Keshav Mestha ,  Yao Rong Wang ,  Peter Paul

发明人： Beilei Xu ,  Lalit Keshav Mestha ,  Yao Rong Wang ,  Peter Paul

IPC分类号： G03B11/00

CPC分类号： G06K9/209 ,  G01J3/2823 ,  G01J3/36 ,  G02B5/201 ,  G02B5/208 ,  G03B11/00 ,  G06K9/00255 ,  G06K2009/00932

摘要： A filter array for a multi-resolution multi-spectral camera system is described which not only captures 2D images at multiple wavelength bands simultaneously but also at a spatial resolution that meets the demand for spatial feature extraction. The present system optimizes filter bands that provide high image contrast at the highest possible resolution to enable spatial feature extraction and other wavelength bands at lower resolution to achieve maximum number of wavelength bands (e.g. spectral resolution) for multi-spectral analysis. After determining the required spatial resolution and number of wavelength bands for spectral analysis, multiple filters are arranged in a geometric pattern with each filter being designed to have specified wavelength and spatial resolution. Physical sizes of filters differ within each filter group. This maximizes the detector usage while optimizing the trade-off between spatial resolution and spectral resolution. Filter gaps are fixed or tuned to wavelengths of interest.

摘要翻译： 描述了用于多分辨率多光谱照相机系统的滤光器阵列，其不仅在多个波长带同时捕获2D图像，而且以满足空间特征提取需求的空间分辨率捕获。 本系统优化以最高可能分辨率提供高图像对比度的滤波器频带，以便能够以较低分辨率进行空间特征提取和其他波长带，以实现用于多光谱分析的最大数量的波段（例如光谱分辨率）。 在确定所需的空间分辨率和用于频谱分析的波长带数之后，多个滤波器以几何图形排列，每个滤波器被设计为具有指定的波长和空间分辨率。 每个过滤器组中过滤器的物理尺寸不同。 这最大限度地提高了检测器的使用率，同时优化了空间分辨率和光谱分辨率之间的折衷。 滤波器间隙固定或调谐到感兴趣的波长。

公开(公告)号：US20130215244A1

公开(公告)日：2013-08-22

申请号：US13401207

申请日：2012-02-21

申请人： Lalit Keshav MESTHA ,  Beilei Xu

发明人： Lalit Keshav MESTHA ,  Beilei Xu

IPC分类号： H04N7/18

CPC分类号： H04N7/18 ,  G06T5/002 ,  G06T5/003 ,  G06T7/194 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/10048 ,  G06T2207/20056 ,  G06T2207/20076 ,  G06T2207/30088

摘要： What is disclosed is a system and method for automatically removing undesirable periodic or random background noise from heart rate measurement signals obtained from a video camera, ambient illuminator and other unknown electromagnetic sources to improve the overall reliability of biomedical measurements. In one embodiment, a time varying video image acquired over at least one imaging channel of a subject of interest is received. The video images are then segmented into a first region comprising a localized area where plethysmographic signals of the subject can be registered and a second region comprising a localized area of the environment where the plethysmographic signals cannot be registered. Both of the regions are exposed to the same environmental factors. The segmented video signals are pre-processed and the processed signals are subtracted from each other to generate an environmentally compensated signal. The environmentally compensated signal is then communicated to a computer system.

摘要翻译： 所公开的是用于从由摄像机，环境照明器和其他未知电磁源获得的心率测量信号中自动去除不期望的周期性或随机背景噪声的系统和方法，以提高生物医学测量的整体可靠性。 在一个实施例中，接收在感兴趣对象的至少一个成像通道上获取的时变视频图像。 然后将视频图像分割成包括可以登记对象的体积描记信号的局部区域的第一区域，以及包括体积描记信号不能被登记的环境的局部区域的第二区域。 这两个地区都面临着相同的环境因素。 分段视频信号被预处理，并且处理的信号彼此相减以产生环境补偿信号。 然后将经环境补偿的信号传送到计算机系统。

公开(公告)号：US09226691B2

公开(公告)日：2016-01-05

申请号：US13486637

申请日：2012-06-01

申请人： Edgar A. Bernal ,  Lalit Keshav Mestha ,  Beilei Xu

发明人： Edgar A. Bernal ,  Lalit Keshav Mestha ,  Beilei Xu

IPC分类号： A61B5/091 ,  A61B5/00 ,  A61B5/107 ,  A61B5/11 ,  A61B5/113 ,  G01B11/25

CPC分类号： A61B5/091 ,  A61B5/0064 ,  A61B5/1077 ,  A61B5/1128 ,  A61B5/1135 ,  G01B11/2527

摘要： What is disclosed is a system and method for estimating tidal chest volume using 3D surface reconstruction based on an analysis of captured reflections of structured illumination patterns from the subject with a video camera. The imaging system hereof captures the reflection of the light patterns from a target area of the subject's thoracic region. The captured information produces a depth map and a volume is estimated from the resulting 3D map. The teachings hereof provide a non-contact approach to patient respiration monitoring that is particularly useful for infant care in a neo-natal intensive care unit (NICU), and can aid in the early detection of sudden deterioration of physiological condition due to detectable changes in respiratory function. The systems and methods disclosed herein provide an effective tool for tidal chest volume study and respiratory function analysis.

摘要翻译： 所公开的是基于使用摄像机对来自被摄体的结构化照明图案的捕获反射的分析来使用3D表面重建来估计潮汐胸部体积的系统和方法。 其成像系统捕获来自受试者胸部区域的目标区域的光图案的反射。 捕获的信息产生一个深度图，并且从所得到的3D地图估计出一个体积。 本发明的教导提供了对新生儿重症监护病房（NICU）中的婴儿护理特别有用的患者呼吸监测的非接触方法，并且可以有助于早期发现由于可检测的变化引起的生理状态突然恶化 呼吸功能。 本文公开的系统和方法为潮汐胸部体积研究和呼吸功能分析提供了有效的工具。