公开(公告)号：US09226691B2

公开(公告)日：2016-01-05

申请号：US13486637

申请日：2012-06-01

申请人： Edgar A. Bernal ,  Lalit Keshav Mestha ,  Beilei Xu

发明人： Edgar A. Bernal ,  Lalit Keshav Mestha ,  Beilei Xu

IPC分类号： A61B5/091 ,  A61B5/00 ,  A61B5/107 ,  A61B5/11 ,  A61B5/113 ,  G01B11/25

CPC分类号： A61B5/091 ,  A61B5/0064 ,  A61B5/1077 ,  A61B5/1128 ,  A61B5/1135 ,  G01B11/2527

摘要： What is disclosed is a system and method for estimating tidal chest volume using 3D surface reconstruction based on an analysis of captured reflections of structured illumination patterns from the subject with a video camera. The imaging system hereof captures the reflection of the light patterns from a target area of the subject's thoracic region. The captured information produces a depth map and a volume is estimated from the resulting 3D map. The teachings hereof provide a non-contact approach to patient respiration monitoring that is particularly useful for infant care in a neo-natal intensive care unit (NICU), and can aid in the early detection of sudden deterioration of physiological condition due to detectable changes in respiratory function. The systems and methods disclosed herein provide an effective tool for tidal chest volume study and respiratory function analysis.

摘要翻译： 所公开的是基于使用摄像机对来自被摄体的结构化照明图案的捕获反射的分析来使用3D表面重建来估计潮汐胸部体积的系统和方法。 其成像系统捕获来自受试者胸部区域的目标区域的光图案的反射。 捕获的信息产生一个深度图，并且从所得到的3D地图估计出一个体积。 本发明的教导提供了对新生儿重症监护病房（NICU）中的婴儿护理特别有用的患者呼吸监测的非接触方法，并且可以有助于早期发现由于可检测的变化引起的生理状态突然恶化 呼吸功能。 本文公开的系统和方法为潮汐胸部体积研究和呼吸功能分析提供了有效的工具。

公开(公告)号：US09141868B2

公开(公告)日：2015-09-22

申请号：US13533678

申请日：2012-06-26

申请人： Beilei Xu ,  Lalit Keshav Mestha ,  Edgar A. Bernal

发明人： Beilei Xu ,  Lalit Keshav Mestha ,  Edgar A. Bernal

IPC分类号： G06K9/00 ,  G06K9/36 ,  G06T7/00 ,  G01B11/25

CPC分类号： G06T7/0075 ,  G01B11/25 ,  G06K9/36 ,  G06K9/46 ,  G06T7/521 ,  G06T7/55 ,  G06T7/593 ,  G06T2207/10012 ,  G06T2207/20104 ,  G06T2207/30076

摘要： What is disclosed is system and method for contemporaneously reconstructing images of a scene illuminated with unstructured and structured illumination sources. In one embodiment, the system comprises capturing a first 2D image containing energy reflected from a scene being illuminated by a structured illumination source and a second 2D image containing energy reflected from the scene being illuminated by an unstructured illumination source. A controller effectuates a manipulation of the structured and unstructured illumination sources during capture of the video. A processor is configured to execute machine readable program instructions enabling the controller to manipulate the illumination sources, and for effectuating the contemporaneous reconstruction of a 2D intensity map of the scene using the second 2D image and of a 3D surface map of the scene using the first 2D image. The reconstruction is effectuated by manipulating the illumination sources.

摘要翻译： 公开的是同时重建用非结构化和结构化照明源照明的场景的图像的系统和方法。 在一个实施例中，系统包括捕获包含由结构化照明源照亮的场景反射的能量的第一2D图像和包含由非结构化照明源照亮的场景反射的能量的第二2D图像。 在拍摄视频期间，控制器实现对结构化和非结构化照明源的操纵。 处理器被配置为执行机器可读程序指令，使得控制器能够操纵照明源，并且使用第二2D图像和场景的3D表面图使用第一图像来实现场景的2D强度地图的同时重建 2D图像。 通过操纵照明源来实现重建。

公开(公告)号：US09019358B2

公开(公告)日：2015-04-28

申请号：US13023310

申请日：2011-02-08

申请人： Lalit Keshav Mestha ,  Beilei Xu ,  Peter Paul

发明人： Lalit Keshav Mestha ,  Beilei Xu ,  Peter Paul

IPC分类号： H04N7/18 ,  G06K9/00

CPC分类号： G06K9/0063 ,  G06K2009/00644

摘要： What is disclosed is a novel system and method for simultaneous spectral decomposition suitable for image object identification and categorization for scenes and objects under analysis. The present system captures different spectral planes simultaneously using a Fabry-Perot multi-filter grid each tuned to a specific wavelength. A method for classifying pixels in the captured image is provided. The present system and method finds its uses in a wide array of applications such as, for example, occupancy detection in a transportation management system and in medical imaging and diagnosis for healthcare management. The teachings hereof further find their uses in other applications where there is a need to capture a two dimensional view of a scene and decompose the scene into its spectral bands such that objects in the image can be appropriately identified.

摘要翻译： 所公开的是一种用于同时频谱分解的新型系统和方法，适用于分析场景和物体的图像对象识别和分类。 本系统使用每个调谐到特定波长的法布里 - 珀罗多滤波器网格同时捕获不同的频谱平面。 提供了一种用于对拍摄图像中的像素进行分类的方法。 本系统和方法在广泛的应用中发现其用途，例如在运输管理系统中的占用检测以及用于医疗管理的医学成像和诊​​断。 其中的教导进一步发现它们在其他应用中的用途，其中需要捕获场景的二维视图并将场景分解为其光谱带，使得可以适当地识别图像中的对象。

公开(公告)号：US08971985B2

公开(公告)日：2015-03-03

申请号：US13486682

申请日：2012-06-01

申请人： Edgar A. Bernal ,  Lalit Keshav Mestha ,  Beilei Xu

发明人： Edgar A. Bernal ,  Lalit Keshav Mestha ,  Beilei Xu

IPC分类号： A61B5/05 ,  G06F19/00 ,  H04N7/18 ,  A61B5/091 ,  A61B5/11 ,  A61B5/113 ,  G06T7/00

CPC分类号： G06F19/3418 ,  A61B5/091 ,  A61B5/1128 ,  A61B5/1135 ,  G06F19/00 ,  G06T7/521 ,  G06T2207/10152 ,  G06T2207/30004 ,  G06T2207/30076 ,  H04N7/181

摘要： What is disclosed is a system and method for estimating minute ventilation by analyzing distortions in reflections of structured illumination patterns captured in a video of a thoracic region of a subject of interest being monitored for respiratory function. Measurement readings can be acquired in a few seconds under a diverse set of lighting conditions and provide a non-contact approach to patient respiratory function that is particularly useful for infant care in an intensive care unit (ICU), sleep studies, and can aid in the early detection of sudden deterioration of physiological conditions due to detectable changes in chest volume. The systems and methods disclosed herein provide an effective tool for non-contact minute ventilation estimation and respiratory function analysis.

摘要翻译： 所公开的是通过分析被监测用于呼吸功能的感兴趣受试者的胸部区域的视频中捕获的结构化照明模式的反射中的失真来估计每分钟通气的系统和方法。 测量读数可以在多种照明条件下几秒钟内获得，并提供对患者呼吸功能的非接触式方法，对重症监护室（ICU），睡眠研究中的婴儿护理特别有用，并且可以帮助 早期发现由于胸部体积可检测到的生理状况突然恶化。 本文公开的系统和方法提供了用于非接触式分钟通气估计和呼吸功能分析的有效工具。

公开(公告)号：US08715202B2

公开(公告)日：2014-05-06

申请号：US13246560

申请日：2011-09-27

申请人： George Cunha Cardoso ,  Lalit Keshav Mestha ,  Beilei Xu

发明人： George Cunha Cardoso ,  Lalit Keshav Mestha ,  Beilei Xu

IPC分类号： A61B5/08 ,  G01J1/22

CPC分类号： A61B5/0059 ,  A61B5/0037 ,  A61B5/0816 ,  A61B5/0836 ,  A61B5/7257 ,  A61B2576/00 ,  A61M2205/3313 ,  A61M2230/432 ,  G01N21/3504 ,  G01N33/497

摘要： What is disclosed is a system and method for image-based determination of carbon dioxide (CO2) concentration in exhaled breath. In one embodiment, an image of the exhaled airstream of a subject of interest is received. The image is captured using a mid-wave infrared camera system having an optical filter tuned to the infrared absorption band of CO2. The image is preprocessed to isolate a region of pixels containing the exhaled airstream and intensity values of pixels in the identified region are normalized by a value of a known radiance such as that of the subject's nose or face. The image is analyzed to determine CO2 concentration levels of the exhaled airstream using a calibration curve which relates pixel intensity to CO2 concentrations. The calibration curve is derived using a physics-based parameterized model. The CO2 concentration levels are determined and communicated to a computer workstation. Various embodiments are disclosed.

摘要翻译： 公开的是用于基于图像的测定呼出气中的二氧化碳（CO 2）浓度的系统和方法。 在一个实施例中，接收感兴趣对象的呼出气流的图像。 使用具有调谐到CO 2的红外吸收带的光学滤波器的中波红外相机系统捕获图像。 图像被预处理以隔离包含呼出气流的像素的区域，并且通过诸如被摄体的鼻子或脸部的已知辐射的值对识别的区域中的像素的强度值进行归一化。 使用将像素强度与CO2浓度相关联的校准曲线来分析图像以确定呼出气流的CO 2浓度水平。 使用基于物理的参数化模型导出校准曲线。 确定二氧化碳浓度水平并传送到计算机工作站。 公开了各种实施例。

公开(公告)号：US09185353B2

公开(公告)日：2015-11-10

申请号：US13401207

申请日：2012-02-21

申请人： Lalit Keshav Mestha ,  Beilei Xu

发明人： Lalit Keshav Mestha ,  Beilei Xu

IPC分类号： H04N7/18 ,  G06T5/00

CPC分类号： H04N7/18 ,  G06T5/002 ,  G06T5/003 ,  G06T7/194 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/10048 ,  G06T2207/20056 ,  G06T2207/20076 ,  G06T2207/30088

摘要： What is disclosed is a system and method for automatically removing undesirable periodic or random background noise from heart rate measurement signals obtained from a video camera, ambient illuminator and other unknown electromagnetic sources to improve the overall reliability of biomedical measurements. In one embodiment, a time varying video image acquired over at least one imaging channel of a subject of interest is received. The video images are then segmented into a first region comprising a localized area where plethysmographic signals of the subject can be registered and a second region comprising a localized area of the environment where the plethysmographic signals cannot be registered. Both of the regions are exposed to the same environmental factors. The segmented video signals are pre-processed and the processed signals are subtracted from each other to generate an environmentally compensated signal. The environmentally compensated signal is then communicated to a computer system.

摘要翻译： 所公开的是用于从由摄像机，环境照明器和其他未知电磁源获得的心率测量信号中自动去除不期望的周期性或随机背景噪声的系统和方法，以提高生物医学测量的整体可靠性。 在一个实施例中，接收在感兴趣对象的至少一个成像通道上获取的时变视频图像。 然后将视频图像分割成包括可以登记对象的体积描记信号的局部区域的第一区域，以及包括体积描记信号不能被登记的环境的局部区域的第二区域。 这两个地区都面临着相同的环境因素。 分段视频信号被预处理，并且处理的信号彼此相减以产生环境补偿信号。 然后将经环境补偿的信号传送到计算机系统。

公开(公告)号：US08897522B2

公开(公告)日：2014-11-25

申请号：US13483992

申请日：2012-05-30

申请人： Lalit Keshav Mestha ,  Beilei Xu ,  Edgar A. Bernal

发明人： Lalit Keshav Mestha ,  Beilei Xu ,  Edgar A. Bernal

IPC分类号： G06K9/00 ,  A61B5/02

CPC分类号： G06T7/0016 ,  A61B5/0077 ,  A61B5/02 ,  A61B5/021 ,  A61B5/02416 ,  A61B5/029 ,  A61B5/489 ,  G06T2207/10024 ,  G06T2207/10048 ,  G06T2207/30076 ,  G06T2207/30101

摘要： What is disclosed is a non-contact system and method for determining cardiac function parameters from a vascular pattern identified from RGB and IR video signals captured simultaneously of a region of exposed skin of a subject of interest. In one embodiment, a video of a region of exposed skin is captured using a video camera that captures color values for pixels over visible channels and an IR camera that measures pixel intensity values in wavelength ranges of interest. Pixel intensity values are processed to generate a vascular binary mask that indicates pixel locations corresponding to the vascular pathways. The IR images are registered with corresponding data from the camera's visible channels such that pixels that correspond to the vascular pattern can be isolated in each frame of the video of visible color data. Once processed, pixels associated with the isolated vascular patterns are analyzed to determine desired cardiac function parameters.

摘要翻译： 公开的是一种非接触式系统和方法，用于根据由目标受试者的暴露皮肤区域同时捕获的RGB和IR视频信号识别的血管图案来确定心脏功能参数。 在一个实施例中，使用捕获可见信道上的像素的颜色值的摄像机和测量感兴趣的波长范围内的像素强度值的IR照相机捕获暴露皮肤区域的视频。 处理像素强度值以产生指示对应于血管通路的像素位置的血管二进制掩模。 红外图像与来自相机的可视通道的相应数据一起登记，使得与血管图案相对应的像素可以在可见颜色数据的视频的每个帧中被隔离。 一旦处理，分析与分离的血管图案相关联的像素以确定期望的心脏功能参数。

公开(公告)号：US08790269B2

公开(公告)日：2014-07-29

申请号：US13103406

申请日：2011-05-09

申请人： Beilei Xu ,  Lalit Keshav Mestha ,  Graham Pennington

发明人： Beilei Xu ,  Lalit Keshav Mestha ,  Graham Pennington

IPC分类号： A61B5/08

CPC分类号： A61B5/015 ,  A61B5/0008 ,  A61B5/08 ,  A61B2503/04 ,  A61B2576/00

摘要： What is disclosed is a system and method for monitoring respiration of a subject or subject of interest using a thermal imaging system with single or multiple spectral bands set to a temperature range of a facial region of that person. Temperatures of extremities of the head and face are used to locate facial features in the captured thermal images, i.e., nose and mouth, which are associated with respiration. The RGB signals obtained from the camera are plotted to obtain a respiration pattern. From the respiration pattern, a rate of respiration is obtained. The system includes display and communication interfaces wherein alerts can be activated if the respiration rate falls outside a level of acceptability. The teachings hereof find their uses in an array of devices such as, for example, devices which monitor the respiration of an infant to signal the onset of a respiratory problem or failure.

摘要翻译： 公开的是使用具有设置到该人脸部区域的温度范围的单个或多个光谱带的热成像系统来监测受试者或感兴趣受试者的呼吸的系统和方法。 使用头部和脸部四肢的温度来定位与呼吸相关联的捕获的热图像即鼻子和嘴部中的面部特征。 绘制从照相机获得的RGB信号以获得呼吸模式。 从呼吸模式，获得呼吸率。 该系统包括显示和通信接口，其中如果呼吸速率落在可接受程度之外，则可以激活警报。 本发明的教导将其用于一系列装置中，例如监测婴儿的呼吸以指示呼吸问题或失败的发作的装置。

公开(公告)号：US08768438B2

公开(公告)日：2014-07-01

申请号：US13532128

申请日：2012-06-25

申请人： Lalit Keshav Mestha ,  Beilei Xu ,  Paul R. Austin

发明人： Lalit Keshav Mestha ,  Beilei Xu ,  Paul R. Austin

IPC分类号： A61B6/00

CPC分类号： A61B5/02416 ,  A61B5/0044 ,  A61B5/0452

摘要： What is disclosed is a system and method for processing a time-series signal generated by video images captured of a subject of interest in a non-contact, remote sensing environment such that the existence of a cardiac arrhythmia can be determined for that subject. In one embodiment, a time-series signal generated is received. The time-series signal was generated from video images captured of a region of exposed skin where photoplethysmographic (PPG) signals of a subject of interest can be registered. Signal separation is performed on the time-series signal to extract a photoplethysmographic signal for the subject. Peak-to-peak pulse points are detected in the PPG signal using an adaptive threshold technique with successive thresholds being based on variations detected in previous magnitudes of the pulse peaks. The pulse points are then analyzed to obtain peak-to-peak pulse dynamics. The existence of cardiac arrhythmias is determined for the subject based on the pulse dynamics.

摘要翻译： 所公开的是用于处理由非接触式遥感环境中感兴趣的对象捕获的视频图像产生的时间序列信号的系统和方法，从而可以确定该对象的心律失常的存在。 在一个实施例中，接收所产生的时间序列信号。 时间序列信号是从拍摄感兴趣的受试者的光学体积描记（PPG）信号可以被登记的暴露皮肤区域的视频图像产生的。 对时间序列信号执行信号分离，以提取对象的光电体积描记信号。 使用自适应阈值技术在PPG信号中检测峰峰值脉冲点，其中连续阈值基于在脉冲峰值的先前幅度中检测到的变化。 然后分析脉冲点以获得峰 - 峰脉冲动态。 基于脉搏动力学确定对象的心律失常的存在。

公开(公告)号：US08611608B2

公开(公告)日：2013-12-17

申请号：US13215401

申请日：2011-08-23

申请人： Zhigang Fan ,  Abu Saeed Islam ,  Peter Paul ,  Beilei Xu ,  Lalit Keshav Mestha

发明人： Zhigang Fan ,  Abu Saeed Islam ,  Peter Paul ,  Beilei Xu ,  Lalit Keshav Mestha

IPC分类号： G06K9/00

CPC分类号： G06K9/00234 ,  G06K9/00838 ,  G06K9/2018

摘要： What is disclosed is a system and method for determining whether a front seat in a motor vehicle is occupied based on seat pattern recognition. The present invention takes advantage of the observation that an unoccupied seat of a motor vehicle exhibits features which are distinguishable from an occupied seat. An unoccupied motor vehicle seat typically features long contiguous horizontal line segments and curve segments, and substantially uniform areas encompassed by these segments which are not present in an occupied seat. The present method provides a long horizontal edge test which uses location information within a defined window of the image, edge linking, softness of the edge, number of lines, line/curve fitting, and other techniques to locate horizontal edges in the image which define a seat, and a uniformity step which determines whether the area bounded by the horizontal edges is relatively uniform indicating an unoccupied seat.

摘要翻译： 公开的是基于座椅图案识别来确定机动车辆中的前排座椅是否被占用的系统和方法。 本发明利用了这样的观察结果：机动车辆的空闲座椅表现出与被占用座椅不同的特征。 未占用的机动车辆座椅通常具有长的连续水平线段和曲线段，以及由这些段所包围的基本均匀的区域，其不存在于被占用的座椅中。 本方法提供了一种长的水平边缘测试，它使用图像的定义窗口内的位置信息，边缘链接，边缘柔软度，线数，线/曲线拟合以及其他技术来定位图像中的水平边缘 一个座位和一个均匀性步骤，确定由水平边缘限定的区域是否相对均匀，表示空闲的座位。