公开(公告)号：US20120296202A1

公开(公告)日：2012-11-22

申请号：US13475048

申请日：2012-05-18

申请人： Peter Mountney ,  Markus Kaiser ,  Ingmar Voigt ,  Matthias John ,  Razvan Ioan Ionasec ,  Jan Boese ,  Dorin Comaniciu

发明人： Peter Mountney ,  Markus Kaiser ,  Ingmar Voigt ,  Matthias John ,  Razvan Ioan Ionasec ,  Jan Boese ,  Dorin Comaniciu

IPC分类号： A61B6/02 ,  A61B8/12

CPC分类号： A61B6/12 ,  A61B6/4417 ,  A61B6/4441 ,  A61B6/487 ,  A61B6/503 ,  A61B6/5247 ,  A61B8/0841 ,  A61B8/0883 ,  A61B8/12 ,  A61B8/4245 ,  A61B8/4416 ,  A61B8/5261

摘要： A method and system for registering ultrasound images and physiological models to x-ray fluoroscopy images is disclosed. A fluoroscopic image and an ultrasound image, such as a Transesophageal Echocardiography (TEE) image, are received. A 2D location of an ultrasound probe is detected in the fluoroscopic image. A 3D pose of the ultrasound probe is estimated based on the detected 2D location of the ultrasound probe in the fluoroscopic image. The ultrasound image is mapped to a 3D coordinate system of a fluoroscopic image acquisition device used to acquire the fluoroscopic image based on the estimated 3D pose of the ultrasound probe. The ultrasound image can then be projected into the fluoroscopic image using a projection matrix associated with the fluoroscopic image. A patient specific physiological model can be detected in the ultrasound image and projected into the fluoroscopic image.

摘要翻译： 公开了一种用于将超声图像和生理模型记录到X射线透视图像的方法和系统。 接收透视图像和超声图像，如经食道超声心动图（TEE）图像。 在透视图像中检测超声探头的2D位置。 基于在荧光镜图像中检测到的超声波探头的2D位置来估计超声探头的3D姿态。 超声图像被映射到用于根据超声探头的估计3D姿势获取荧光镜图像的荧光镜图像采集装置的3D坐标系。 然后可以使用与透视图像相关联的投影矩阵将超声图像投影到透视图像中。 可以在超声图像中检测患者特异性生理模型并将其投影到透视图像中。

公开(公告)号：US20180276877A1

公开(公告)日：2018-09-27

申请号：US15468810

申请日：2017-03-24

申请人： Peter Mountney ,  Thomas Engel ,  Philip Mewes ,  Thomas Pheiffer

发明人： Peter Mountney ,  Thomas Engel ,  Philip Mewes ,  Thomas Pheiffer

IPC分类号： G06T15/60 ,  G06T17/10 ,  G06T15/50 ,  G06T7/70 ,  G06T19/00 ,  H04N13/02

CPC分类号： G06T15/60 ,  A61B1/00009 ,  A61B1/00045 ,  A61B34/20 ,  G06T7/70 ,  G06T15/506 ,  G06T17/10 ,  G06T19/00 ,  G06T19/006 ,  G06T2207/10028 ,  G06T2207/10068 ,  G06T2207/30204 ,  G06T2210/41 ,  G06T2215/12 ,  G06T2215/16 ,  H04N13/275

摘要： In order to improve depth perception for an image displayed during a laparoscopic surgery, a representation of a shadow of a tool included in the image and used in the laparoscopic surgery is identified and introduced into the image. A processor augments a three-dimensional (3D) model including a 3D representation of a surface of an object included in the image, and a representation of the tool by introducing a virtual light source into the 3D model to generate a virtual shadow within the 3D model. The processor subtracts the representation of the shadow out of the augmented 3D model and superimposes the representation of the shadow on the image to be displayed during the laparoscopic surgery.

公开(公告)号：US20170372474A1

公开(公告)日：2017-12-28

申请号：US15633858

申请日：2017-06-27

申请人： Jonathan Behar ,  Alexander Brost ,  Peter Mountney ,  Maria Panayiotou ,  Kawal Rhode ,  Aldo Rinaldi ,  Daniel Toth

发明人： Jonathan Behar ,  Alexander Brost ,  Peter Mountney ,  Maria Panayiotou ,  Kawal Rhode ,  Aldo Rinaldi ,  Daniel Toth

IPC分类号： G06T7/00 ,  G06T7/11

CPC分类号： G06T7/0012 ,  A61B5/0035 ,  A61B6/037 ,  A61B6/12 ,  A61B6/4266 ,  A61B6/4441 ,  A61B6/481 ,  A61B6/504 ,  A61B6/5247 ,  A61B8/5246 ,  A61B8/5261 ,  A61B2017/00243 ,  A61B2090/364 ,  A61B2090/367 ,  A61B2090/374 ,  A61B2090/376 ,  G06T7/344 ,  G06T2207/10088 ,  G06T2207/10116 ,  G06T2207/30004 ,  G06T2207/30048 ,  G06T2207/30101

摘要： A method for registering image data sets of a target region of a patient includes selecting a first anatomical structure only or at least partially only visible in the first image data set, and a second anatomical structure only or at least partially only visible in the second image data set, such that there is a known geometrical relationship between extended segments of the anatomical structures; automatically determining a first geometry information describing the geometry of at least a part of the first anatomical structure and a second geometry information describing the geometry of at least a part of the second anatomical structure, neither information being sufficient to enable registration of the image data sets on its own; automatically optimizing transformation parameters describing a rigid transformation of one of the anatomical structures with respect to the other and geometrical correspondences; and determining registration information from the optimized transformation parameters.

公开(公告)号：US09681856B2

公开(公告)日：2017-06-20

申请号：US14970189

申请日：2015-12-15

申请人： Peter Mountney ,  Sasa Grbic ,  Razvan Ioan Ionasec ,  Matthias John ,  Dorin Comaniciu

发明人： Peter Mountney ,  Sasa Grbic ,  Razvan Ioan Ionasec ,  Matthias John ,  Dorin Comaniciu

IPC分类号： G06K9/00 ,  A61B8/08 ,  G06K9/52 ,  G06T3/00 ,  G06K9/62 ,  A61B6/00 ,  A61B6/12 ,  A61B8/12 ,  G06T5/50 ,  G06T7/00 ,  A61B5/00 ,  A61B6/03

CPC分类号： A61B8/5261 ,  A61B5/0035 ,  A61B6/032 ,  A61B6/12 ,  A61B6/4441 ,  A61B6/487 ,  A61B6/503 ,  A61B6/5235 ,  A61B6/5247 ,  A61B6/582 ,  A61B8/0883 ,  A61B8/12 ,  A61B8/5223 ,  G06K9/52 ,  G06K9/6267 ,  G06T3/0056 ,  G06T5/50 ,  G06T7/33 ,  G06T7/35 ,  G06T7/77 ,  G06T2207/10121 ,  G06T2207/10132 ,  G06T2207/20076 ,  G06T2207/20081 ,  G06T2207/20221 ,  G06T2207/30048 ,  G06T2207/30056 ,  G06T2207/30101

摘要： A method for real-time fusion of a 2D cardiac ultrasound image with a 2D cardiac fluoroscopic image includes acquiring real time synchronized US and fluoroscopic images, detecting a surface contour of an aortic valve in the 2D cardiac ultrasound (US) image relative to an US probe, detecting a pose of the US probe in the 2D cardiac fluoroscopic image, and using pose parameters of the US probe to transform the surface contour of the aortic valve from the 2D cardiac US image to the 2D cardiac fluoroscopic image.

公开(公告)号：US10332253B2

公开(公告)日：2019-06-25

申请号：US15633858

申请日：2017-06-27

申请人： Jonathan Behar ,  Alexander Brost ,  Peter Mountney ,  Maria Panayiotou ,  Kawal Rhode ,  Aldo Rinaldi ,  Daniel Toth

发明人： Jonathan Behar ,  Alexander Brost ,  Peter Mountney ,  Maria Panayiotou ,  Kawal Rhode ,  Aldo Rinaldi ,  Daniel Toth

IPC分类号： G06T7/00 ,  A61B5/00 ,  A61B6/03 ,  A61B17/00 ,  A61B90/00 ,  G06T7/33

摘要： A method for registering image data sets of a target region of a patient includes selecting a first anatomical structure only or at least partially only visible in the first image data set, and a second anatomical structure only or at least partially only visible in the second image data set, such that there is a known geometrical relationship between extended segments of the anatomical structures; automatically determining a first geometry information describing the geometry of at least a part of the first anatomical structure and a second geometry information describing the geometry of at least a part of the second anatomical structure, neither information being sufficient to enable registration of the image data sets on its own; automatically optimizing transformation parameters describing a rigid transformation of one of the anatomical structures with respect to the other and geometrical correspondences; and determining registration information from the optimized transformation parameters.

公开(公告)号：US20130279780A1

公开(公告)日：2013-10-24

申请号：US13741610

申请日：2013-01-15

申请人： Sasa Grbic ,  Peter Mountney ,  Razvan Ioan Ionasec ,  Matthias John ,  Dorin Comaniciu

发明人： Sasa Grbic ,  Peter Mountney ,  Razvan Ioan Ionasec ,  Matthias John ,  Jan Boese ,  Dorin Comaniciu

IPC分类号： A61B5/00

CPC分类号： A61B5/0033 ,  A61B6/12 ,  A61B6/487 ,  A61B6/5247 ,  A61B6/5264 ,  A61B8/0883 ,  A61B8/12 ,  A61B8/4245 ,  A61B8/466 ,  A61B8/483 ,  A61B8/5261 ,  A61B8/5276 ,  G06T5/50 ,  G06T7/38 ,  G06T7/73 ,  G06T2207/10016 ,  G06T2207/10081 ,  G06T2207/10121 ,  G06T2207/10132 ,  G06T2207/20072 ,  G06T2207/20076 ,  G06T2207/20081 ,  G06T2207/20221

摘要： A method and system for model-based fusion of pre-operative image data and intra-operative fluoroscopic images is disclosed. A fluoroscopic image and an ultrasound image are received. The ultrasound image is mapped to a 3D coordinate system of a fluoroscopic image acquisition device used to acquire the fluoroscopic image. Contours of an anatomical structure are detected in the ultrasound image, and a transformation is calculated between the ultrasound image and a pre-operative CT image based on the contours and a patient-specific physiological model extracted from the pre-operative CT image. A final mapping is determined between the CT image and the fluoroscopic image based on the transformation between the ultrasound image and physiological model and the mapping of the ultrasound image to the 3D coordinate system of the fluoroscopic image acquisition device. The CT image or the physiological model can then be projected into the fluoroscopic image.

摘要翻译： 公开了一种用于术前图像数据和术中荧光透视图像的基于模型融合的方法和系统。 接收透视图像和超声图像。 超声图像被映射到用于获取透视图像的透视图像获取装置的3D坐标系。 在超声图像中检测解剖结构的轮廓，并且基于轮廓和从手术前CT图像提取的患者特异性生理模型，计算超声图像和手术前CT图像之间的变换。 基于超声图像和生理模型之间的变换以及超声图像与透视图像采集装置的3D坐标系的映射，在CT图像和荧光透视图像之间确定最终映射。 然后将CT图像或生理模型投影到透视图像中。

公开(公告)号：US10262453B2

公开(公告)日：2019-04-16

申请号：US15468810

申请日：2017-03-24

申请人： Peter Mountney ,  Thomas Engel ,  Philip Mewes ,  Thomas Pheiffer

发明人： Peter Mountney ,  Thomas Engel ,  Philip Mewes ,  Thomas Pheiffer

IPC分类号： G06T15/60 ,  G06T17/10 ,  G06T7/70 ,  H04N13/275 ,  G06T15/50 ,  G06T19/00 ,  A61B1/00 ,  A61B34/20

摘要： In order to improve depth perception for an image displayed during a laparoscopic surgery, a representation of a shadow of a tool included in the image and used in the laparoscopic surgery is identified and introduced into the image. A processor augments a three-dimensional (3D) model including a 3D representation of a surface of an object included in the image, and a representation of the tool by introducing a virtual light source into the 3D model to generate a virtual shadow within the 3D model. The processor subtracts the representation of the shadow out of the augmented 3D model and superimposes the representation of the shadow on the image to be displayed during the laparoscopic surgery.

公开(公告)号：US09687204B2

公开(公告)日：2017-06-27

申请号：US13475048

申请日：2012-05-18

申请人： Peter Mountney ,  Markus Kaiser ,  Ingmar Voigt ,  Matthias John ,  Razvan Ioan Ionasec ,  Jan Boese ,  Dorin Comaniciu

发明人： Peter Mountney ,  Markus Kaiser ,  Ingmar Voigt ,  Matthias John ,  Razvan Ioan Ionasec ,  Jan Boese ,  Dorin Comaniciu

IPC分类号： A61B6/12 ,  A61B6/00 ,  A61B8/08 ,  A61B8/00 ,  A61B8/12

CPC分类号： A61B6/12 ,  A61B6/4417 ,  A61B6/4441 ,  A61B6/487 ,  A61B6/503 ,  A61B6/5247 ,  A61B8/0841 ,  A61B8/0883 ,  A61B8/12 ,  A61B8/4245 ,  A61B8/4416 ,  A61B8/5261

摘要： A method and system for registering ultrasound images and physiological models to x-ray fluoroscopy images is disclosed. A fluoroscopic image and an ultrasound image, such as a Transesophageal Echocardiography (TEE) image, are received. A 2D location of an ultrasound probe is detected in the fluoroscopic image. A 3D pose of the ultrasound probe is estimated based on the detected 2D location of the ultrasound probe in the fluoroscopic image. The ultrasound image is mapped to a 3D coordinate system of a fluoroscopic image acquisition device used to acquire the fluoroscopic image based on the estimated 3D pose of the ultrasound probe. The ultrasound image can then be projected into the fluoroscopic image using a projection matrix associated with the fluoroscopic image. A patient specific physiological model can be detected in the ultrasound image and projected into the fluoroscopic image.

公开(公告)号：US20130259341A1

公开(公告)日：2013-10-03

申请号：US13775374

申请日：2013-02-25

申请人： Peter Mountney ,  Sasa Grbic ,  Razvan Ioan Ionasec ,  Matthias John ,  Dorin Comaniciu

发明人： Peter Mountney ,  Sasa Grbic ,  Razvan Ioan Ionasec ,  Matthias John ,  Jan Boese ,  Dorin Comaniciu

IPC分类号： A61B5/00

CPC分类号： A61B5/0035 ,  A61B6/032 ,  A61B6/12 ,  A61B6/4441 ,  A61B6/487 ,  A61B6/503 ,  A61B6/5235 ,  A61B6/5247 ,  A61B6/582 ,  A61B8/0883 ,  A61B8/12 ,  A61B8/5261 ,  G06T5/50 ,  G06T7/77 ,  G06T2207/10121 ,  G06T2207/10132 ,  G06T2207/20081 ,  G06T2207/20221 ,  G06T2207/30048

摘要： A method for real-time fusion of a 2D cardiac ultrasound image with a 2D cardiac fluoroscopic image includes acquiring real time synchronized US and fluoroscopic images, detecting a surface contour of an aortic valve in the 2D cardiac ultrasound (US) image relative to an US probe, detecting a pose of the US probe in the 2D cardiac fluoroscopic image, and using pose parameters of the US probe to transform the surface contour of the aortic valve from the 2D cardiac US image to the 2D cardiac fluoroscopic image.

摘要翻译： 用于2D心脏超声图像与2D心脏荧光镜图像的实时融合的方法包括获取实时同步的美国和透视图像，检测2D心脏超声（US）图像中的主动脉瓣相对于美国的表面轮廓 探测器，检测在2D心脏荧光透视图像中的美国探测器的姿态，以及使用美国探头的姿态参数将主动脉瓣的表面轮廓从2D心脏美国图像变换到2D心脏透视图像。