Abstract:
A method and system for calculating a volume of resected tissue from a stream of intraoperative images is disclosed. A stream of 2D/2.5D intraoperative images of resected tissue of a patient is received. The 2D/2.5D intraoperative images in the stream are acquired at different angles with respect to the resected tissue. A resected tissue surface is segmented in each of the 2D/2.5D intraoperative images. The segmented resected tissue surfaces are stitched to generate a 3D point cloud representation of the resected tissue surface. A 3D mesh representation of the resected tissue surface is generated from the 3D point cloud representation of the resected tissue surface. The volume of the resected tissue is calculated from the 3D mesh representation of the resected tissue surface.
Abstract:
A method and system for determining fractional flow reserve (FFR) for a coronary artery stenosis of a patient is disclosed. In one embodiment, medical image data of the patient including the stenosis is received, a set of features for the stenosis is extracted from the medical image data of the patient, and an FFR value for the stenosis is determined based on the extracted set of features using a trained machine-learning based mapping. In another embodiment, a medical image of the patient including the stenosis of interest is received, image patches corresponding to the stenosis of interest and a coronary tree of the patient are detected, an FFR value for the stenosis of interest is determined using a trained deep neural network regressor applied directly to the detected image patches
Abstract:
In a method for image guided prostate cancer needle biopsy, a first registration is performed to match a first image of a prostate to a second image of the prostate (210). Third images of the prostate are acquired and compounded into a three-dimensional (3D) image (220). The prostate in the compounded 3D image is segmented to show its border (230). A second registration and then a third registration different from the second registration is performed on distance maps generated from the prostate borders of the first image and the compounded 3D image, wherein the first and second registrations are based on a biomechanical property of the prostate (240). A region of interest in the first image is mapped to the compounded 3D image or a fourth image of the prostate acquired with the second modality (250).
Abstract:
A method and system for registration of 2D/2.5D laparoscopic or endoscopic image data to 3D volumetric image data is disclosed. A plurality of 2D/2.5D intra-operative images of a target organ are received, together with corresponding relative orientation measurements for the intraoperative images. A 3D medical image volume of the target organ is registered to the plurality of 2D/2.5D intra-operative images by calculating pose parameters to match simulated projection images of the 3D medical image volume to the plurality of 2D/2.5D intra-operative images, and the registration is constrained by the relative orientation measurements for the intra-operative images.
Abstract:
Systems and methods for model augmentation include receiving intra-operative imaging data of an anatomical object of interest at a deformed state. The intraoperative imaging data is stitched into an intra-operative model of the anatomical object of interest at the deformed state. The intra-operative model of the anatomical object of interest at the deformed state is registered with a pre-operative model of the anatomical object of interest at an initial state by deforming the pre-operative model of the anatomical object of interest at the initial state based on a biomechanical model. Texture information from the intra-operative model of the anatomical object of interest at the deformed state is mapped to the deformed pre-operative model to generate a deformed, texture-mapped pre-operative model of the anatomical object of interest.
Abstract:
A method and system for scene parsing and model fusion in laparoscopic and endoscopic 2D/2.5D image data is disclosed. A current frame of an intra-operative image stream including a 2D image channel and a 2.5D depth channel is received. A 3D pre-operative model of a target organ segmented in pre-operative 3D medical image data is fused to the current frame of the intra-operative image stream. Semantic label information is propagated from the pre-operative 3D medical image data to each of a plurality of pixels in the current frame of the intra-operative image stream based on the fused pre-operative 3D model of the target organ, resulting in a rendered label map for the current frame of the intra-operative image stream. A semantic classifier is trained based on the rendered label map for the current frame of the intra-operative image stream.
Abstract:
A method and system for semantic segmentation laparoscopic and endoscopic 2D/2.5D image data is disclosed. Statistical image features that integrate a 2D image channel and a 2.5D depth channel of a 2D/2.5 laparoscopic or endoscopic image are extracted for each pixel in the image. Semantic segmentation of the laparoscopic or endoscopic image is then performed using a trained classifier to classify each pixel in the image with respect to a semantic object class of a target organ based on the extracted statistical image features. Segmented image masks resulting from the semantic segmentation of multiple frames of a laparoscopic or endoscopic image sequence can be used to guide organ specific 3D stitching of the frames to generate a 3D model of the target organ.
Abstract:
A method and system for simulating patient-specific cardiac electrophysiology including the effect of the electrical conduction system of the heart is disclosed. A patient-specific anatomical heart model is generated from cardiac image data of a patient. The electrical conduction system of the heart of the patient is modeled by determining electrical diffusivity values of cardiac tissue based on a distance of the cardiac tissue from the endocardium. A distance field from the endocardium surface is calculated with sub-grid accuracy using a nested-level set approach. Cardiac electrophysiology for the patient is simulated using a cardiac electrophysiology model with the electrical diffusivity values determined to model the Purkinje network of the patient.
Abstract:
A method and system for interactive patient-specific simulation of liver tumor ablation is disclosed. A patient-specific anatomical model of the liver and circulatory system of the liver is estimated from 3D medical image data of a patient. A computational domain is generated from the patient-specific anatomical model of the liver. Blood flow in the liver and the circulatory system of the liver is simulated based on the patient-specific anatomical model. Heat diffusion due to ablation is simulated based on a virtual ablation probe position and the simulated blood flow in the liver and the circulatory system of the liver by solving a bio-heat equation for each node on the level-set representation using a Lattice-Boltzmann method (LBM) implementation. Cellular necrosis in the liver is computed based on the simulated heat diffusion. Visualizations of a computed necrosis region and temperature maps of the liver are generated. A user input is interactively received to modify the position of the virtual ablation probe, the heat diffusion and cellular necrosis is re-simulated based on the user input, and the visualizations of the computed necrosis region and the temperature maps are updated
Abstract:
A system operating in a plurality of modes to provide an integrated analysis of molecular data, imaging data, and clinical data associated with a patient includes a multi-scale model, a molecular model, and a linking component. The multi-scale model is configured to generate one or more estimated multi-scale parameters based on the clinical data and the imaging data when the system operates in a first mode, and generate a model of organ functionality based on one or more inferred multi-scale parameters when the system operates in a second mode. The molecular model is configured to generate one or more first molecular findings based on a molecular network analysis of the molecular data, wherein the molecular model is constrained by the estimated parameters when the system operates in the first mode. The linking component, which is operably coupled to the multi-scale model and the molecular model, is configured to transfer the estimated multi-scale parameters from the multi-scale model to the molecular model when the system operates in the first mode, and generate, using a machine learning process, the inferred multi-scale parameters based on the molecular findings when the system operates in the second mode.