公开(公告)号：US20130076913A1

公开(公告)日：2013-03-28

申请号：US13247343

申请日：2011-09-28

申请人： Beilei XU ,  Wencheng WU ,  Lalit Keshav MESTHA ,  Graham PENNINGTON

发明人： Beilei XU ,  Wencheng WU ,  Lalit Keshav MESTHA ,  Graham PENNINGTON

IPC分类号： G06K9/00 ,  H04N5/225

CPC分类号： G06K9/2018 ,  H04N5/23206 ,  H04N5/23219 ,  H04N5/332

摘要： What is disclosed is a system and method for identifying materials comprising an object captured in a video and for using the identified materials to track that object as it moves across the captured video scene. In one embodiment, a multi-spectral or hyper-spectral sensor is used to capture a spectral image of an object in an area of interest. Pixels in the spectral planes of the spectral images are analyzed to identify a material comprising objects in that area of interest. A location of each of the identified objects is provided to an imaging sensor which then proceeds to track the objects as they move through a scene. Various embodiments are disclosed.

摘要翻译： 公开的是用于识别包括在视频中捕获的对象的材料的系统和方法，并且用于当所述对象在所捕获的视频场景中移动时使用所识别的材料来跟踪该对象。 在一个实施例中，使用多光谱或超光谱传感器来捕获感兴趣区域中的对象的光谱图像。 分析光谱图像的光谱平面中的像素以识别包含该感兴趣区域中的物体的材料。 每个识别的对象的位置被提供给成像传感器，然后成像传感器在它们移动通过场景时跟踪对象。 公开了各种实施例。

公开(公告)号：US20130235178A1

公开(公告)日：2013-09-12

申请号：US13416436

申请日：2012-03-09

申请人： Yao Rong WANG ,  Lalit Keshav MESTHA ,  Beilei XU ,  Raja BALA ,  Graham PENNINGTON

发明人： Yao Rong WANG ,  Lalit Keshav MESTHA ,  Beilei XU ,  Raja BALA ,  Graham PENNINGTON

IPC分类号： H04N5/33 ,  G06K9/62

CPC分类号： G06K9/00255 ,  G06K9/00838 ,  G06K9/2018 ,  H04N5/33

摘要： What is disclosed is a system and method for selecting the optimal wavelength ban combination for a multi-band infrared camera system which is optimized for skin detection. An objective function is constructed specifically for this application from classified performance and the algorithm generates wavelengths by maximizing the objective function. A specific wavelength band combination is selected which maximizes the objective function. Also disclosed is a 3-band and 4-band camera system with filters each having a transmittance of one of a combination of wavelength bands optimized to detect skin in the infrared band. The camera systems disclosed herein find their intended uses in a wide array of vehicle occupancy detection systems and applications. Various embodiments are disclosed.

摘要翻译： 公开的是用于为针对皮肤检测而优化的多频带红外相机系统选择最佳波长禁止组合的系统和方法。 目标函数由分类性能专门为此应用构建，算法通过最大化目标函数生成波长。 选择使目标函数最大化的特定波段组合。 还公开了一种具有滤波器的三频带和四频带相机系统，每个滤波器具有被优化以检测红外频带中的皮肤的波长带的组合之一的透射率。 本文公开的相机系统在各种车辆占用检测系统和应用中找到其预期用途。 公开了各种实施例。

公开(公告)号：US20130079658A1

公开(公告)日：2013-03-28

申请号：US13246560

申请日：2011-09-27

申请人： George Cunha CARDOSO ,  Lalit Keshav MESTHA ,  Beilei XU

发明人： George Cunha CARDOSO ,  Lalit Keshav MESTHA ,  Beilei XU

IPC分类号： A61B5/08

CPC分类号： A61B5/0059 ,  A61B5/0037 ,  A61B5/0816 ,  A61B5/0836 ,  A61B5/7257 ,  A61B2576/00 ,  A61M2205/3313 ,  A61M2230/432 ,  G01N21/3504 ,  G01N33/497

摘要： What is disclosed is a system and method for image-based determination of carbon dioxide (CO2) concentration in exhaled breath. In one embodiment, an image of the exhaled airstream of a subject of interest is received. The image is captured using a mid-wave infrared camera system having an optical filter tuned to the infrared absorption band of CO2. The image is preprocessed to isolate a region of pixels containing the exhaled airstream and intensity values of pixels in the identified region are normalized by a value of a known radiance such as that of the subject's nose or face. The image is analyzed to determine CO2 concentration levels of the exhaled airstream using a calibration curve which relates pixel intensity to CO2 concentrations. The calibration curve is derived using a physics-based parameterized model. The CO2 concentration levels are determined and communicated to a computer workstation. Various embodiments are disclosed.

摘要翻译： 公开的是用于基于图像的测定呼出气中的二氧化碳（CO 2）浓度的系统和方法。 在一个实施例中，接收感兴趣对象的呼出气流的图像。 使用具有调谐到CO 2的红外吸收带的光学滤波器的中波红外相机系统捕获图像。 图像被预处理以隔离包含呼出气流的像素的区域，并且通过诸如被摄体的鼻子或脸部的已知辐射的值对识别的区域中的像素的强度值进行归一化。 使用将像素强度与CO2浓度相关联的校准曲线来分析图像以确定呼出气流的CO 2浓度水平。 使用基于物理的参数化模型导出校准曲线。 确定二氧化碳浓度水平并传送到计算机工作站。 公开了各种实施例。

公开(公告)号：US20130215244A1

公开(公告)日：2013-08-22

申请号：US13401207

申请日：2012-02-21

申请人： Lalit Keshav MESTHA ,  Beilei Xu

发明人： Lalit Keshav MESTHA ,  Beilei Xu

IPC分类号： H04N7/18

CPC分类号： H04N7/18 ,  G06T5/002 ,  G06T5/003 ,  G06T7/194 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/10048 ,  G06T2207/20056 ,  G06T2207/20076 ,  G06T2207/30088

摘要： What is disclosed is a system and method for automatically removing undesirable periodic or random background noise from heart rate measurement signals obtained from a video camera, ambient illuminator and other unknown electromagnetic sources to improve the overall reliability of biomedical measurements. In one embodiment, a time varying video image acquired over at least one imaging channel of a subject of interest is received. The video images are then segmented into a first region comprising a localized area where plethysmographic signals of the subject can be registered and a second region comprising a localized area of the environment where the plethysmographic signals cannot be registered. Both of the regions are exposed to the same environmental factors. The segmented video signals are pre-processed and the processed signals are subtracted from each other to generate an environmentally compensated signal. The environmentally compensated signal is then communicated to a computer system.

摘要翻译： 所公开的是用于从由摄像机，环境照明器和其他未知电磁源获得的心率测量信号中自动去除不期望的周期性或随机背景噪声的系统和方法，以提高生物医学测量的整体可靠性。 在一个实施例中，接收在感兴趣对象的至少一个成像通道上获取的时变视频图像。 然后将视频图像分割成包括可以登记对象的体积描记信号的局部区域的第一区域，以及包括体积描记信号不能被登记的环境的局部区域的第二区域。 这两个地区都面临着相同的环境因素。 分段视频信号被预处理，并且处理的信号彼此相减以产生环境补偿信号。 然后将经环境补偿的信号传送到计算机系统。

公开(公告)号：US20130079649A1

公开(公告)日：2013-03-28

申请号：US13247683

申请日：2011-09-28

申请人： Lalit Keshav MESTHA ,  Survi KYAL ,  Gill Rafael TSOURI ,  Sohail A. DIANAT ,  Beilei XU

发明人： Lalit Keshav MESTHA ,  Survi KYAL ,  Gill Rafael TSOURI ,  Sohail A. DIANAT ,  Beilei XU

IPC分类号： A61B5/02

CPC分类号： A61B5/0022 ,  A61B5/0077 ,  A61B5/024 ,  A61B2576/00 ,  G01J5/026 ,  G01J5/089 ,  G06F19/00 ,  G16H40/67

摘要： What is disclosed is a system and method for recovering a patient's cardiac pulse rate from a sequence of video images recording of that patient. In one embodiment, a reference signal of a particular frequency is generated at predetermined frequency intervals and a constrained source separation is performed on the source data to obtain an estimation of the source signal intended to be recovered. The reference signal is updated and constrained source separation is again performed. These operations are repeated for all frequencies of the reference signal. The frequency at which a minimum error is achieved is determined to be the subject's recovered cardiac pulse frequency. In such a manner, the source signal is extracted and recovered reliably from captured multi-channel RGB signals or multispectral signals. The teachings hereof find their uses in a variety of medical solutions including various military, security and telemedicine applications. Various embodiments are disclosed.

摘要翻译： 所公开的是用于从记录该患者的视频图像的序列中恢复患者心脏脉搏率的系统和方法。 在一个实施例中，以预定的频率间隔产生特定频率的参考信号，并且对源数据执行受限的源分离以获得旨在被恢复的源信号的估计。 更新参考信号并再次执行约束源分离。 对参考信号的所有频率重复这些操作。 实现最小误差的频率被确定为受试者的恢复心脏脉搏频率。 以这种方式，从捕获的多通道RGB信号或多光谱信号可靠地提取和恢复源信号。 其教学方法可用于各种医疗解决方案，包括各种军事，安全和远程医疗应用。 公开了各种实施例。

公开(公告)号：US20130077958A1

公开(公告)日：2013-03-28

申请号：US13239642

申请日：2011-09-22

申请人： Beilei XU ,  Lalit Keshav MESTHA ,  Yao Rong WANG ,  Peter PAUL

发明人： Beilei XU ,  Lalit Keshav MESTHA ,  Yao Rong WANG ,  Peter PAUL

IPC分类号： G03B11/00 ,  G02B26/00

CPC分类号： G06K9/209 ,  G01J3/2823 ,  G01J3/36 ,  G02B5/201 ,  G02B5/208 ,  G03B11/00 ,  G06K9/00255 ,  G06K2009/00932

摘要： What is disclosed is a filter array for a multi-resolution multi-spectral camera system which not only captures 2D images at multiple wavelength bands simultaneously but also at a spatial resolution that meets the demand for spatial feature extraction. The present system optimizes filter bands that provide high image contrast at the highest possible resolution to enable spatial feature extraction and other wavelength bands at lower resolution to achieve maximum number of wavelength bands (e.g. spectral resolution) for multi-spectral analysis. After determining the required spatial resolution and number of wavelength bands for spectral analysis, multiple filters are arranged in a geometric pattern with each filter being designed to have specified wavelength and spatial resolution. Physical sizes of filters differ within each filter group. This maximizes the detector usage while optimizing the trade-off between spatial resolution and spectral resolution. Filter gaps are fixed or tuned to wavelengths of interest.

摘要翻译： 公开的是用于多分辨率多光谱照相机系统的滤光器阵列，其不仅同时捕获多个波长带处的2D图像，而且以满足空间特征提取的需求的空间分辨率。 本系统优化以最高可能分辨率提供高图像对比度的滤波器频带，以便能够以较低分辨率进行空间特征提取和其他波长带，以实现用于多光谱分析的最大数量的波段（例如光谱分辨率）。 在确定所需的空间分辨率和用于频谱分析的波长带数之后，多个滤波器以几何图形排列，每个滤波器被设计为具有指定的波长和空间分辨率。 每个过滤器组中过滤器的物理尺寸不同。 这最大限度地提高了检测器的使用率，同时优化了空间分辨率和光谱分辨率之间的折衷。 滤波器间隙固定或调谐到感兴趣的波长。

公开(公告)号：US20120289850A1

公开(公告)日：2012-11-15

申请号：US13103406

申请日：2011-05-09

申请人： Beilei XU ,  Lalit Keshav MESTHA ,  Graham PENNINGTON

发明人： Beilei XU ,  Lalit Keshav MESTHA ,  Graham PENNINGTON

IPC分类号： A61B5/08

CPC分类号： A61B5/015 ,  A61B5/0008 ,  A61B5/08 ,  A61B2503/04 ,  A61B2576/00

摘要： What is disclosed is a system and method for monitoring respiration of a subject or subject of interest using a thermal imaging system with single or multiple spectral bands set to a temperature range of a facial region of that person. Temperatures of extremities of the head and face are used to locate facial features in the captured thermal images, i.e., nose and mouth, which are associated with respiration. The RGB signals obtained from the camera are plotted to obtain a respiration pattern. From the respiration pattern, a rate of respiration is obtained. The system includes display and communication interfaces wherein alerts can be activated if the respiration rate falls outside a level of acceptability. The teachings hereof find their uses in an array of devices such as, for example, devices which monitor the respiration of an infant to signal the onset of a respiratory problem or failure.

摘要翻译： 公开的是使用具有设置在该人脸部区域的温度范围的单个或多个光谱带的热成像系统来监测受试者或感兴趣受试者的呼吸的系统和方法。 使用头部和脸部四肢的温度来定位与呼吸相关联的捕获的热图像即鼻子和嘴部中的面部特征。 绘制从照相机获得的RGB信号以获得呼吸模式。 从呼吸模式，获得呼吸率。 该系统包括显示和通信接口，其中如果呼吸速率落在可接受程度之外，则可以激活警报。 本发明的教导将其用于一系列装置中，例如监测婴儿的呼吸以指示呼吸问题或失败的发作的装置。

公开(公告)号：US20130345569A1

公开(公告)日：2013-12-26

申请号：US13532128

申请日：2012-06-25

申请人： Lalit Keshav MESTHA ,  Beilei XU ,  Paul R. AUSTIN

发明人： Lalit Keshav MESTHA ,  Beilei XU ,  Paul R. AUSTIN

IPC分类号： A61B5/024 ,  A61B6/00

CPC分类号： A61B5/02416 ,  A61B5/0044 ,  A61B5/0452

摘要： What is disclosed is a system and method for processing a time-series signal generated by video images captured of a subject of interest in a non-contact, remote sensing environment such that the existence of a cardiac arrhythmia can be determined for that subject. In one embodiment, a time-series signal generated is received. The time-series signal was generated from video images captured of a region of exposed skin where photoplethysmographic (PPG) signals of a subject of interest can be registered. Signal separation is performed on the time-series signal to extract a photoplethysmographic signal for the subject. Peak-to-peak pulse points are detected in the PPG signal using an adaptive threshold technique with successive thresholds being based on variations detected in previous magnitudes of the pulse peaks. The pulse points are then analyzed to obtain peak-to-peak pulse dynamics. The existence of cardiac arrhythmias is determined for the subject based on the pulse dynamics.

摘要翻译： 所公开的是用于处理由非接触式遥感环境中感兴趣的对象捕获的视频图像产生的时间序列信号的系统和方法，从而可以确定该对象的心律失常的存在。 在一个实施例中，接收所产生的时间序列信号。 时间序列信号是从拍摄感兴趣的受试者的光学体积描记（PPG）信号可以被登记的暴露皮肤区域的视频图像产生的。 对时间序列信号执行信号分离，以提取对象的光电体积描记信号。 使用自适应阈值技术在PPG信号中检测峰峰值脉冲点，其中连续阈值基于在脉冲峰值的先前幅度中检测到的变化。 然后分析脉冲点以获得峰 - 峰脉冲动态。 基于脉搏动力学确定对象的心律失常的存在。

公开(公告)号：US20130201342A1

公开(公告)日：2013-08-08

申请号：US13364835

申请日：2012-02-02

申请人： Sandra SKAFF ,  Raja BALA ,  Lalit Keshav MESTHA ,  Beilei XU

发明人： Sandra SKAFF ,  Raja BALA ,  Lalit Keshav MESTHA ,  Beilei XU

IPC分类号： H04N5/33

CPC分类号： H04N5/33 ,  G06T7/90 ,  G06T2207/10048 ,  H04N5/332 ,  H04N9/045 ,  H04N9/43

摘要： What is disclosed is a system and method for estimating color for pixels in an infrared image. In one embodiment, an infrared image is received which has been captured using a N-band infrared imaging system comprising a multi-spectral camera or a hyperspectral camera. The IR image is composed of an array of pixels with N intensity values having been collected for each pixel in the image. Then, for each pixel of interest, a search metric is used to search a database of vector samples to identify a visible-IR set which is closest to the intensity values of the IR band vector collected for the pixel. A visible vector representation is then estimated for the pixel based upon the visible portion corresponding to the closest visible-IR set. Thereafter, color coordinates for this pixel are computed from the visible vector. The method repeats for all pixels of interest in the IR image.

摘要翻译： 公开的是用于估计红外图像中的像素的颜色的系统和方法。 在一个实施例中，接收使用包括多光谱相机或高光谱相机的N波段红外成像系统捕获的红外图像。 IR图像由对图像中的每个像素收集的具有N个强度值的像素阵列组成。 然后，对于感兴趣的每个像素，使用搜索度量来搜索向量样本的数据库，以识别最接近为该像素收集的IR带矢量的强度值的可见IR集合。 然后基于对应于最接近的可见IR集的可见部分，针对像素估计可见矢量表示。 此后，从可见矢量计算该像素的颜色坐标。 该方法针对IR图像中所有感兴趣的像素重复。

公开(公告)号：US20130051625A1

公开(公告)日：2013-02-28

申请号：US13215401

申请日：2011-08-23

申请人： Zhigang FAN ,  Abu Saeed ISLAM ,  Peter PAUL ,  Beilei XU ,  Lalit Keshav MESTHA

发明人： Zhigang FAN ,  Abu Saeed ISLAM ,  Peter PAUL ,  Beilei XU ,  Lalit Keshav MESTHA

IPC分类号： G06K9/00

CPC分类号： G06K9/00234 ,  G06K9/00838 ,  G06K9/2018

摘要： What is disclosed is a system and method for determining whether a front seat in a motor vehicle is occupied based on seat pattern recognition. The present invention takes advantage of the observation that an unoccupied seat of a motor vehicle exhibits features which are distinguishable from an occupied seat. An unoccupied motor vehicle seat typically features long contiguous horizontal line segments and curve segments, and substantially uniform areas encompassed by these segments which are not present in an occupied seat. The present method provides a long horizontal edge test which uses location information within a defined window of the image, edge linking, softness of the edge, number of lines, line/curve fitting, and other techniques to locate horizontal edges in the image which define a seat, and a uniformity step which determines whether the area bounded by the horizontal edges is relatively uniform indicating an unoccupied seat.

摘要翻译： 公开的是基于座椅图案识别来确定机动车辆中的前排座椅是否被占用的系统和方法。 本发明利用了这样的观察结果：机动车辆的空闲座椅表现出与被占用座椅不同的特征。 未占用的机动车辆座椅通常具有长的连续水平线段和曲线段，以及由这些段所包围的基本均匀的区域，其不存在于被占用的座椅中。 本方法提供了一种长的水平边缘测试，它使用图像的定义窗口内的位置信息，边缘链接，边缘柔软度，线数，线/曲线拟合以及其他技术来定位图像中的水平边缘 一个座位和一个均匀性步骤，确定由水平边缘限定的区域是否相对均匀，表示空闲的座位。