摘要:
A method for performing cellular classification includes extracting a plurality of local feature descriptors from a set of input images and applying a coding process to covert each of the plurality of local feature descriptors into a multi-dimensional code. A feature pooling operation is applied on each of the plurality of local feature descriptors to yield a plurality of image representations and each image representation is classified as one of a plurality of cell types.
摘要:
The invention relates to a method for the automatic creation of two- or three-dimensional building models, consisting of at least one digital aerial image, and for automatic provision with semantic building information, and comprises, inter alia , the following steps: generating training data on the basis of cadastral data and/or geoinformation data as a two-dimensional first vector model comprising semantic information, and thereby training a classifier; generating a second two- or three-dimensional vector model from the segmented and classified aerial image; and transferring semantic information into the second vector model from the first vector model by comparison with the latter.
摘要:
A method and system for calculating a volume of resected tissue from a stream of intraoperative images is disclosed. A stream of 2D/2.5D intraoperative images of resected tissue of a patient is received. The 2D/2.5D intraoperative images in the stream are acquired at different angles with respect to the resected tissue. A resected tissue surface is segmented in each of the 2D/2.5D intraoperative images. The segmented resected tissue surfaces are stitched to generate a 3D point cloud representation of the resected tissue surface. A 3D mesh representation of the resected tissue surface is generated from the 3D point cloud representation of the resected tissue surface. The volume of the resected tissue is calculated from the 3D mesh representation of the resected tissue surface.
摘要:
A method and system for scene parsing and model fusion in laparoscopic and endoscopic 2D/2.5D image data is disclosed. A current frame of an intra-operative image stream including a 2D image channel and a 2.5D depth channel is received. A 3D pre-operative model of a target organ segmented in pre-operative 3D medical image data is fused to the current frame of the intra-operative image stream. Semantic label information is propagated from the pre-operative 3D medical image data to each of a plurality of pixels in the current frame of the intra-operative image stream based on the fused pre-operative 3D model of the target organ, resulting in a rendered label map for the current frame of the intra-operative image stream. A semantic classifier is trained based on the rendered label map for the current frame of the intra-operative image stream.
摘要:
Intraoperative camera data is registered with medical scan data. The same salient features are located in both the medical scan data and the model from the camera data. The features are specifically labeled rather than just being represented by the data. At least an initial rigid registration is performed using the salient features. The coordinate systems of the camera and the medical scan data are aligned without external positions sensors for the intraoperative camera.
摘要:
Systems and methods for model augmentation include receiving intra-operative imaging data of an anatomical object of interest at a deformed state. The intra-operative imaging data is stitched into an intra-operative model of the anatomical object of interest at the deformed state. The intra-operative model of the anatomical object of interest at the deformed state is registered with a pre-operative model of the anatomical object of interest at an initial state by deforming the pre-operative model of the anatomical object of interest at the initial state based on a biomechanical model. Texture information from the intra-operative model of the anatomical object of interest at the deformed state is mapped to the deformed pre-operative model to generate a deformed, texture-mapped pre-operative model of the anatomical object of interest.
摘要:
A method and system for semantic segmentation laparoscopic and endoscopic 2D/2.5D image data is disclosed. Statistical image features that integrate a 2D image channel and a 2.5D depth channel of a 2D/2.5 laparoscopic or endoscopic image are extracted for each pixel in the image. Semantic segmentation of the laparoscopic or endoscopic image is then performed using a trained classifier to classify each pixel in the image with respect to a semantic object class of a target organ based on the extracted statistical image features. Segmented image masks resulting from the semantic segmentation of multiple frames of a laparoscopic or endoscopic image sequence can be used to guide organ specific 3D stitching of the frames to generate a 3D model of the target organ.
摘要:
The invention relates to a method for image-based alteration recognition for three-dimensional objects and/or surface sections. In this case, a three-dimensional model for an object is generated (2) from a plurality of photographs for a particular time, and a reference model or comparison model for the object is also provided. A visual focus on the three-dimensional model of the object is then defined and a 2.5D view of the object is derived (3) for this visual focus - in the form of a Cartesian data record. In this data record, at least besides two-dimensional coordinate values, a colour value derived from the three-dimensional model and a depth value derived from the three-dimensional model are also recorded (4) as data attributes for the respective data point. The respective data attributes of the respective data point are then compared (5) with the corresponding data from the reference model in order to establish discrepancies and/or changes. In this way, the method according to the invention very easily reduces complexity for recognition or ascertainment of alterations and/or differences between three-dimensional object photographs that are available in the form of what are known as point clouds. The data records, which comprise both geometric and colour information for the respective data points, allow very easy recognition of alterations in a three-dimensional object.