摘要:
For three-dimensional rendering (32), a machine-learnt model is trained (14) to generate representation vectors for rendered images formed with different rendering parameter settings. The distances between representation vectors of the images to a reference are used to select (36) the rendered image and corresponding rendering parameters that provides a consistency with the reference. In an additional or different embodiment, optimized pseudorandom sequences are used for physically-based rendering (52). The random number generator seed is selected (46) to improve the convergence speed of the renderer and to provide higher quality images, such as providing images more rapidly for training compared to using non-optimized seed selection.
摘要:
Systems and methods are provided for identifying pathological changes in follow up medical images. Reference image data is acquired. Follow up image data is acquired. A deformation field is generated for the reference image data and the follow up data using a machine-learned network trained to generate deformation fields describing healthy, anatomical deformation between input reference image data and input follow up image data. The reference image data and the follow up image data are aligned using the deformation field. The co-aligned reference image data and follow up image data are analyzed for changes due to pathological phenomena.
摘要:
Methods and apparatus for cross-domain medical image analysis and cross-domain medical image synthesis using deep image-to-image networks and adversarial networks are disclosed. In a method for cross-domain medical image analysis a medical image of a patient from a first domain is received. The medical image is input to a first encoder of a cross-domain deep image-to-image network (DI2IN) that includes the first encoder for the first domain, a second encoder for a second domain, and a decoder. The first encoder converts the medical image to a feature map and the decoder generates an output image that provides a result of a medical image analysis task from the feature map. The first encoder and the second encoder are trained together at least in part based on a similarity of feature maps generated by the first encoder from training images from the first domain and feature maps generated by the second encoder from training images from the second domain, and the decoder is trained to generate output images from feature maps generated by the first encoder or the second encoder.
摘要:
For three-dimensional rendering (32), a machine-learnt model is trained (14) to generate representation vectors for rendered images formed with different rendering parameter settings. The distances between representation vectors of the images to a reference are used to select (36) the rendered image and corresponding rendering parameters that provides a consistency with the reference. In an additional or different embodiment, optimized pseudorandom sequences are used for physically-based rendering (52). The random number generator seed is selected (46) to improve the convergence speed of the renderer and to provide higher quality images, such as providing images more rapidly for training compared to using non-optimized seed selection.
摘要:
Methods and systems for image registration using an intelligent artificial agent are disclosed. In an intelligent artificial agent based registration method, a current state observation of an artificial agent is determined based on the medical images to be registered and current transformation parameters. Action-values are calculated for a plurality of actions available to the artificial agent based on the current state observation using a machine learning based model, such as a trained deep neural network (DNN). The actions correspond to predetermined adjustments of the transformation parameters. An action having a highest action-value is selected from the plurality of actions and the transformation parameters are adjusted by the predetermined adjustment corresponding to the selected action. The determining, calculating, and selecting steps are repeated for a plurality of iterations, and the medical images are registered using final transformation parameters resulting from the plurality of iterations.
摘要:
A computer-implemented method of determining a correspondence between a source image and a reference image includes holding, in a memory: a generative model corresponding to a prior probability distribution of deformation fields, each deformation field corresponding to a respective co-ordinate transformation; and a conditional model for generating a style transfer probability distribution of reference images, given a source image and a deformation field. The method includes receiving first image data comprising the source image, receiving second image data comprising the reference image, determining an initial first deformation field, and iteratively performing an update process, until convergence, to update the first deformation field, to generate a converged deformation field representing the correspondence between the source image and the reference image. The update process includes: determining a change in one or more characteristics of the first deformation field to increase a posterior probability density associated with the first deformation field, given the source image and reference image; and changing the one or more characteristics in accordance with the determined change. The posterior probability density is based on a prior probability density associated with the first deformation field, the prior probability density determined using the generative model, and also a style transfer probability density associated with the reference image, given the source image and the first deformation field, the style transfer probability density determined using the conditional model.
摘要:
Methods and apparatus for cross-domain medical image analysis and cross-domain medical image synthesis using deep image-to-image networks and adversarial networks are disclosed. In a method for cross-domain medical image analysis a medical image of a patient from a first domain is received. The medical image is input to a first encoder of a cross-domain deep image-to-image network (DI2IN) that includes the first encoder for the first domain, a second encoder for a second domain, and a decoder. The first encoder converts the medical image to a feature map and the decoder generates an output image that provides a result of a medical image analysis task from the feature map. The first encoder and the second encoder are trained together at least in part based on a similarity of feature maps generated by the first encoder from training images from the first domain and feature maps generated by the second encoder from training images from the second domain, and the decoder is trained to generate output images from feature maps generated by the first encoder or the second encoder.