公开(公告)号：US09171196B2

公开(公告)日：2015-10-27

申请号：US13416436

申请日：2012-03-09

申请人： Yao Rong Wang ,  Lalit Keshav Mestha ,  Beilei Xu ,  Raja Bala ,  Graham Pennington

发明人： Yao Rong Wang ,  Lalit Keshav Mestha ,  Beilei Xu ,  Raja Bala ,  Graham Pennington

IPC分类号： H04N7/18 ,  G06K9/00 ,  H04N5/33 ,  G06K9/20

CPC分类号： G06K9/00255 ,  G06K9/00838 ,  G06K9/2018 ,  H04N5/33

摘要： What is disclosed is a system and method for selecting the optimal wavelength ban combination for a multi-band infrared camera system which is optimized for skin detection. An objective function is constructed specifically for this application from classified performance and the algorithm generates wavelengths by maximizing the objective function. A specific wavelength band combination is selected which maximizes the objective function. Also disclosed is a 3-band and 4-band camera system with filters each having a transmittance of one of a combination of wavelength bands optimized to detect skin in the infrared band. The camera systems disclosed herein find their intended uses in a wide array of vehicle occupancy detection systems and applications. Various embodiments are disclosed.

摘要翻译： 公开的是用于为针对皮肤检测而优化的多频带红外相机系统选择最佳波长禁止组合的系统和方法。 目标函数由分类性能专门为此应用构建，算法通过最大化目标函数生成波长。 选择使目标函数最大化的特定波段组合。 还公开了一种具有滤波器的三频带和四频带相机系统，每个滤波器具有被优化以检测红外频带中的皮肤的波长带的组合之一的透射率。 本文公开的相机系统在各种车辆占用检测系统和应用中找到其预期用途。 公开了各种实施例。

公开(公告)号：US08600227B2

公开(公告)日：2013-12-03

申请号：US13239642

申请日：2011-09-22

申请人： Beilei Xu ,  Lalit Keshav Mestha ,  Yao Rong Wang ,  Peter Paul

发明人： Beilei Xu ,  Lalit Keshav Mestha ,  Yao Rong Wang ,  Peter Paul

IPC分类号： G03B11/00

CPC分类号： G06K9/209 ,  G01J3/2823 ,  G01J3/36 ,  G02B5/201 ,  G02B5/208 ,  G03B11/00 ,  G06K9/00255 ,  G06K2009/00932

摘要： A filter array for a multi-resolution multi-spectral camera system is described which not only captures 2D images at multiple wavelength bands simultaneously but also at a spatial resolution that meets the demand for spatial feature extraction. The present system optimizes filter bands that provide high image contrast at the highest possible resolution to enable spatial feature extraction and other wavelength bands at lower resolution to achieve maximum number of wavelength bands (e.g. spectral resolution) for multi-spectral analysis. After determining the required spatial resolution and number of wavelength bands for spectral analysis, multiple filters are arranged in a geometric pattern with each filter being designed to have specified wavelength and spatial resolution. Physical sizes of filters differ within each filter group. This maximizes the detector usage while optimizing the trade-off between spatial resolution and spectral resolution. Filter gaps are fixed or tuned to wavelengths of interest.

摘要翻译： 描述了用于多分辨率多光谱照相机系统的滤光器阵列，其不仅在多个波长带同时捕获2D图像，而且以满足空间特征提取需求的空间分辨率捕获。 本系统优化以最高可能分辨率提供高图像对比度的滤波器频带，以便能够以较低分辨率进行空间特征提取和其他波长带，以实现用于多光谱分析的最大数量的波段（例如光谱分辨率）。 在确定所需的空间分辨率和用于频谱分析的波长带数之后，多个滤波器以几何图形排列，每个滤波器被设计为具有指定的波长和空间分辨率。 每个过滤器组中过滤器的物理尺寸不同。 这最大限度地提高了检测器的使用率，同时优化了空间分辨率和光谱分辨率之间的折衷。 滤波器间隙固定或调谐到感兴趣的波长。

公开(公告)号：US08810658B2

公开(公告)日：2014-08-19

申请号：US13364835

申请日：2012-02-02

申请人： Sandra Skaff ,  Raja Bala ,  Lalit Keshav Mestha ,  Beilei Xu

发明人： Sandra Skaff ,  Raja Bala ,  Lalit Keshav Mestha ,  Beilei Xu

IPC分类号： H04N5/33

CPC分类号： H04N5/33 ,  G06T7/90 ,  G06T2207/10048 ,  H04N5/332 ,  H04N9/045 ,  H04N9/43

摘要： What is disclosed is a system and method for estimating color for pixels in an infrared image. In one embodiment, an infrared image is received which has been captured using a N-band infrared imaging system comprising a multi-spectral camera or a hyperspectral camera. The IR image is composed of an array of pixels with N intensity values having been collected for each pixel in the image. Then, for each pixel of interest, a search metric is used to search a database of vector samples to identify a visible-IR set which is closest to the intensity values of the IR band vector collected for the pixel. A visible vector representation is then estimated for the pixel based upon the visible portion corresponding to the closest visible-IR set. Thereafter, color coordinates for this pixel are computed from the visible vector. The method repeats for all pixels of interest in the IR image.

摘要翻译： 公开的是用于估计红外图像中的像素的颜色的系统和方法。 在一个实施例中，接收使用包括多光谱相机或高光谱相机的N波段红外成像系统捕获的红外图像。 IR图像由对图像中的每个像素收集的具有N个强度值的像素阵列组成。 然后，对于感兴趣的每个像素，使用搜索度量来搜索向量样本的数据库，以识别最接近为该像素收集的IR带矢量的强度值的可见IR集合。 然后基于对应于最接近的可见IR集的可见部分，针对像素估计可见矢量表示。 此后，从可见矢量计算该像素的颜色坐标。 该方法针对IR图像中所有感兴趣的像素重复。

公开(公告)号：US09025024B2

公开(公告)日：2015-05-05

申请号：US13247343

申请日：2011-09-28

申请人： Beilei Xu ,  Wencheng Wu ,  Lalit Keshav Mestha ,  Graham Pennington

发明人： Beilei Xu ,  Wencheng Wu ,  Lalit Keshav Mestha ,  Graham Pennington

IPC分类号： H04N7/18 ,  G06K9/20 ,  H04N5/232 ,  H04N5/33

CPC分类号： G06K9/2018 ,  H04N5/23206 ,  H04N5/23219 ,  H04N5/332

摘要： What is disclosed is a system and method for identifying materials comprising an object captured in a video and for using the identified materials to track that object as it moves across the captured video scene. In one embodiment, a multi-spectral or hyper-spectral sensor is used to capture a spectral image of an object in an area of interest. Pixels in the spectral planes of the spectral images are analyzed to identify a material comprising objects in that area of interest. A location of each of the identified objects is provided to an imaging sensor which then proceeds to track the objects as they move through a scene. Various embodiments are disclosed.

摘要翻译： 公开的是用于识别包括在视频中捕获的对象的材料的系统和方法，并且用于当所述对象在所捕获的视频场景中移动时使用所识别的材料来跟踪该对象。 在一个实施例中，使用多光谱或超光谱传感器来捕获感兴趣区域中的对象的光谱图像。 分析光谱图像的光谱平面中的像素以识别包含该感兴趣区域中的物体的材料。 每个识别的对象的位置被提供给成像传感器，然后成像传感器在它们移动通过场景时跟踪对象。 公开了各种实施例。

公开(公告)号：US08790269B2

公开(公告)日：2014-07-29

申请号：US13103406

申请日：2011-05-09

申请人： Beilei Xu ,  Lalit Keshav Mestha ,  Graham Pennington

发明人： Beilei Xu ,  Lalit Keshav Mestha ,  Graham Pennington

IPC分类号： A61B5/08

CPC分类号： A61B5/015 ,  A61B5/0008 ,  A61B5/08 ,  A61B2503/04 ,  A61B2576/00

摘要： What is disclosed is a system and method for monitoring respiration of a subject or subject of interest using a thermal imaging system with single or multiple spectral bands set to a temperature range of a facial region of that person. Temperatures of extremities of the head and face are used to locate facial features in the captured thermal images, i.e., nose and mouth, which are associated with respiration. The RGB signals obtained from the camera are plotted to obtain a respiration pattern. From the respiration pattern, a rate of respiration is obtained. The system includes display and communication interfaces wherein alerts can be activated if the respiration rate falls outside a level of acceptability. The teachings hereof find their uses in an array of devices such as, for example, devices which monitor the respiration of an infant to signal the onset of a respiratory problem or failure.

摘要翻译： 公开的是使用具有设置到该人脸部区域的温度范围的单个或多个光谱带的热成像系统来监测受试者或感兴趣受试者的呼吸的系统和方法。 使用头部和脸部四肢的温度来定位与呼吸相关联的捕获的热图像即鼻子和嘴部中的面部特征。 绘制从照相机获得的RGB信号以获得呼吸模式。 从呼吸模式，获得呼吸率。 该系统包括显示和通信接口，其中如果呼吸速率落在可接受程度之外，则可以激活警报。 本发明的教导将其用于一系列装置中，例如监测婴儿的呼吸以指示呼吸问题或失败的发作的装置。

公开(公告)号：US08977347B2

公开(公告)日：2015-03-10

申请号：US13532057

申请日：2012-06-25

申请人： Lalit Keshav Mestha ,  Survi Kyal ,  Beilei Xu ,  Himanshu J. Madhu

发明人： Lalit Keshav Mestha ,  Survi Kyal ,  Beilei Xu ,  Himanshu J. Madhu

IPC分类号： A61B5/024

CPC分类号： A61B5/02405 ,  A61B5/0004 ,  A61B5/02416 ,  A61B5/7235 ,  A61B2576/00

摘要： What is disclosed is a video-based system and method for estimating heart rate variability from time-series signals generated from video images captured of a subject of interest being monitored for cardiac function. In a manner more fully disclosed herein, low frequency and high frequency components are extracted from a time-series signal obtained by processing a video of the subject being monitored. A ratio of the low and high frequency of the integrated power spectrum within these components is computed. Analysis of the dynamics of this ratio over time is used to estimate heart rate variability. The teachings hereof can be used in a continuous monitoring mode with a relatively high degree of measurement accuracy and find their uses in a variety of diverse applications such as, for instance, emergency rooms, cardiac intensive care units, neonatal intensive care units, and various telemedicine applications.

摘要翻译： 所公开的是一种基于视频的系统和方法，用于从由心脏功能监测的感兴趣对象的视频图像产生的时间序列信号估计心率变异性。 以这里更完全公开的方式，从通过处理被监视对象的视频获得的时间序列信号中提取低频和高频分量。 计算这些分量内的综合功率谱的低频和高频比。 分析这个比率随时间的动力学被用于估计心率变异性。 其教导可以以相对较高的测量精度的连续监测模式使用，并且可以在各种各样的应用中使用，例如急诊室，心脏重症监护病房，新生儿重症监护病房和各种各样的 远程医疗应用。

公开(公告)号：US08855384B2

公开(公告)日：2014-10-07

申请号：US13528307

申请日：2012-06-20

申请人： Survi Kyal ,  Lalit Keshav Mestha ,  Beilei Xu

发明人： Survi Kyal ,  Lalit Keshav Mestha ,  Beilei Xu

IPC分类号： G06K9/00

CPC分类号： G06K9/6217 ,  A61B5/024 ,  G06K9/0057 ,  G06K2209/05

摘要： What is disclosed is a computationally efficient system and method for estimating a subject's cardiac pulse rate from multi-channel source video data. In one embodiment, A time-series signal is received. A sliding window is used to define overlapping segments of the time-series signal. Signal segments are processed by performing constrained independent component analysis (cICA) until convergence to obtain an estimated source signal. A frequency of each estimated source signal obtained by the cICA at convergence is determined to be the subject's estimated cardiac pulse rate for each signal segment. A seed reference signal used by the cICA is repeatedly updated. A sliding window is shifted to define a next time-series signal segment for processing. The method repeats for each signal segment until a termination criteria is met. In such a manner, the subject's cardiac pulse rate is estimated from a video of the subject on a continuous basis.

摘要翻译： 所公开的是用于从多信道源视频数据估计被摄体的心脏脉搏率的计算有效的系统和方法。 在一个实施例中，接收时间序列信号。 滑动窗口用于定义时间序列信号的重叠段。 通过执行受约束的独立分量分析（cICA）直到收敛以获得估计的源信号来处理信号段。 将通过cICA在会聚处获得的每个估计的源信号的频率确定为每个信号段的被摄体估计的心脏脉搏率。 cICA使用的种子参考信号被重复更新。 移动滑动窗口以定义下一个时间序列信号段进行处理。 该方法对于每个信号段重复，直到满足终止标准。 以这种方式，从受试者的视频连续地估计受试者的心脏脉搏率。

公开(公告)号：US09301710B2

公开(公告)日：2016-04-05

申请号：US13529648

申请日：2012-06-21

申请人： Lalit Keshav Mestha ,  Edgar A. Bernal ,  Beilei Xu

发明人： Lalit Keshav Mestha ,  Edgar A. Bernal ,  Beilei Xu

IPC分类号： A61B5/05 ,  A61B5/107 ,  A61B5/00 ,  A61B5/08 ,  A61B5/11 ,  A61B5/113 ,  G01B11/25 ,  G06T7/00 ,  G06T7/20 ,  G06K9/00

CPC分类号： A61B5/1077 ,  A61B5/0064 ,  A61B5/0816 ,  A61B5/1128 ,  A61B5/1135 ,  G01B11/2527 ,  G06K9/0053 ,  G06T7/262 ,  G06T7/521 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/10048 ,  G06T2207/10152 ,  G06T2207/20044 ,  G06T2207/20056 ,  G06T2207/30076 ,  G09G2380/08

摘要： What is disclosed is a system and method for estimating a respiration rate by analyzing distortions in reflections of structured illumination patterns captured in a video containing a view of a subject's thoracic region. In one embodiment, a video of a target region of a body of a subject of interest is received. Video image frames are processed to estimate 3D time-series data for the target region. As more fully disclosed herein, the subject's respiration rate is estimated from the 3D time-series data. Measurements can be acquired under a diverse set of lighting conditions. The teachings hereof provide a non-contact approach to patient respiratory function monitoring that is useful for intensive care units and for monitoring at homes, and which aid in the detection of sudden deterioration of physiological conditions due to changes in respiration rates. The teachings hereof provide an effective tool for non-contact respiratory function study and analysis.

摘要翻译： 公开的是通过分析在包含受试者胸部区域的视图中捕获的结构化照明模式的反射中的失真来估计呼吸率的系统和方法。 在一个实施例中，接收感兴趣对象的身体的目标区域的视频。 处理视频图像帧以估计目标区域的3D时间序列数据。 如本文更全面地公开的，从3D时间序列数据估计对象的呼吸速率。 可以在多种照明条件下获得测量。 本文的教导为患者呼吸功能监测提供了非接触的方法，该方法对于重症监护病房有用，并且在家中进行监测，并且有助于检测呼吸速率变化引起的生理状况突然恶化。 本文的教导为非接触式呼吸功能研究和分析提供了有效的工具。

公开(公告)号：US09155475B2

公开(公告)日：2015-10-13

申请号：US13533605

申请日：2012-06-26

申请人： Beilei Xu ,  Lalit Keshav Mestha ,  Edgar A. Bernal

发明人： Beilei Xu ,  Lalit Keshav Mestha ,  Edgar A. Bernal

IPC分类号： H04N5/232 ,  A61B5/00 ,  H04N5/225 ,  H04N5/235

CPC分类号： A61B5/0077 ,  A61B5/0035 ,  A61B5/0073 ,  H04N5/2256 ,  H04N5/23296 ,  H04N5/2354

摘要： What is disclosed is a system and method for enabling hybrid video capture of a scene being illuminated with structured and unstructured illumination sources over a wavelength range of interest that significantly intersects with each other. In one embodiment, the present system comprises a video capture device for capturing video of a scene being actively illuminated by both a structured and unstructured illumination source; a controller for controlling a manipulation of at least one structured and at least one unstructured illumination sources during capture of the video by the video capture device; and a processor in communication with the controller, the processor executing machine readable program instructions effectuating the manipulation. Various embodiments are disclosed.

摘要翻译： 所公开的是一种系统和方法，用于实现在结构化和非结构化照明源上照射的场景的混合视频捕获，所述结构化和非结构化照明源在相互显着相交的感兴趣的波长范围内。 在一个实施例中，本系统包括用于捕获被结构化和非结构化照明源主动照亮的场景的视频的视频捕获设备; 控制器，用于在由所述视频捕捉设备拍摄所述视频期间控制对至少一个结构化和至少一个非结构化照明源的操纵; 以及与所述控制器通信的处理器，所述处理器执行执行所述操作的机器可读程序指令。 公开了各种实施例。

公开(公告)号：US08617081B2

公开(公告)日：2013-12-31

申请号：US13247683

申请日：2011-09-28

申请人： Lalit Keshav Mestha ,  Survi Kyal ,  Gill Rafael Tsouri ,  Sohail A. Dianat ,  Beilei Xu

发明人： Lalit Keshav Mestha ,  Survi Kyal ,  Gill Rafael Tsouri ,  Sohail A. Dianat ,  Beilei Xu

IPC分类号： A61B5/02

CPC分类号： A61B5/0022 ,  A61B5/0077 ,  A61B5/024 ,  A61B2576/00 ,  G01J5/026 ,  G01J5/089 ,  G06F19/00 ,  G16H40/67

摘要： What is disclosed is a system and method for recovering a patient's cardiac pulse rate from a sequence of video images recording of that patient. In one embodiment, a reference signal of a particular frequency is generated at predetermined frequency intervals and a constrained source separation is performed on the source data to obtain an estimation of the source signal intended to be recovered. The reference signal is updated and constrained source separation is again performed. These operations are repeated for all frequencies of the reference signal. The frequency at which a minimum error is achieved is determined to be the subject's recovered cardiac pulse frequency. In such a manner, the source signal is extracted and recovered reliably from captured multi-channel RGB signals or multispectral signals. The teachings hereof find their uses in a variety of medical solutions including various military, security and telemedicine applications. Various embodiments are disclosed.

摘要翻译： 所公开的是用于从记录该患者的视频图像的序列中恢复患者心脏脉搏率的系统和方法。 在一个实施例中，以预定的频率间隔产生特定频率的参考信号，并且对源数据执行受限的源分离以获得旨在被恢复的源信号的估计。 更新参考信号并再次执行约束源分离。 对参考信号的所有频率重复这些操作。 实现最小误差的频率被确定为受试者的恢复心脏脉搏频率。 以这种方式，从捕获的多通道RGB信号或多光谱信号可靠地提取和恢复源信号。 其教学方法可用于各种医疗解决方案，包括各种军事，安全和远程医疗应用。 公开了各种实施例。