公开(公告)号：US20160027178A1

公开(公告)日：2016-01-28

申请号：US14339352

申请日：2014-07-23

Applicant: Sony Corporation

Inventor： Liangyin Yu ,  Ming-Chang Liu

IPC: G06T7/00 ,  A61B6/03 ,  A61B6/00 ,  A61B5/055

CPC classification number: A61B5/055 ,  A61B6/032 ,  A61B6/037 ,  A61B6/463 ,  A61B6/5235 ,  A61B6/5247 ,  G06T7/0012 ,  G06T7/33 ,  G06T2200/04 ,  G06T2207/10072 ,  G06T2207/30004 ,  G06T2207/30016 ,  G06T2219/2004

Abstract: An image registration system, and a method of operation of an image registration system thereof, including: an imaging unit for obtaining a pre-operation non-invasive imaging volume and for obtaining an intra-operation non-invasive imaging volume; and a processing unit including: a rigid registration module for generating a rigid registered volume based on the pre-operation non-invasive imaging volume, a region of interest module for isolating a region of interest from the intra-operation non-invasive imaging volume, a point generation module, coupled to the region of interest module, for determining feature points of the region of interest, an optimization module, coupled to the point generation module, for matching the feature points with corresponding points of the rigid registered volume for generating a matched point cloud, and an interpolation module, coupled to the optimization module, for generating a non-rigid registered volume based on the matched point cloud for display on a display interface.

Abstract translation: 一种图像配准系统及其图像配准系统的操作方法，包括：用于获得术前非侵入性成像体积并用于获得手术中的非侵入性成像体积的成像单元; 以及处理单元，其包括：刚性配准模块，用于基于所述预先操作的非侵入性成像体积产生刚性登记体积;感兴趣区域模块，用于将所述感兴趣区域与所述手术中的非侵入性成像体积隔离; 耦合到感兴趣区域模块的点生成模块，用于确定感兴趣区域的特征点，耦合到点生成模块的优化模块，用于使特征点与刚性登记体积的对应点匹配，以产生 匹配点云，以及耦合到优化模块的插值模块，用于基于匹配点云生成非刚性注册卷，以在显示界面上显示。

公开(公告)号：US10413364B1

公开(公告)日：2019-09-17

申请号：US16058502

申请日：2018-08-08

Applicant: SONY CORPORATION

Inventor： Liangyin Yu

IPC: G06K9/00 ,  A61B34/10 ,  G06K9/62 ,  G06T7/90 ,  G06T7/40 ,  G06T19/20 ,  H04N5/445 ,  A61B1/313 ,  A61B1/04 ,  A61B5/00 ,  A61B34/20 ,  G06T7/73 ,  A61B90/00

Abstract: An apparatus and method for localization of an internal organ of a subject to provide assistance during surgery, includes capture of a sequence of video frames of one or more internal organs in a body of a subject by insertion of an image capture device in a body of the subject. The apparatus further includes circuitry that computes appearance data of an internal organ of interest in a test video frame selected from the captured sequence of video frames. Orientation data of the internal organ of interest is determined within the body of the subject based on a known orientation of the image capture device and a maximum correlation of the test video frame with a specified anatomical template for the internal organ of interest. Supplemental information is generated to localize at least a portion of the internal organ of interest of the subject in the surgery.

公开(公告)号：US10832422B2

公开(公告)日：2020-11-10

申请号：US16025949

申请日：2018-07-02

Applicant: Sony Corporation

Inventor： Liangyin Yu

IPC: G06T7/33 ,  G06T7/73 ,  G06T7/80 ,  H04N13/25 ,  A61B1/313 ,  A61B6/03 ,  A61B6/00 ,  G06T3/00 ,  G06T7/00 ,  G06T11/00

Abstract: A method for automatic registration of landmarks in 3D and 2D images of an organ comprises: using a first set of coordinates of identified first, second and third landmarks of the organ, derived from a 3D surface representation of the organ, and a second set of coordinates of the landmarks, derived from 2D laparoscopic images of the organ, to register the three landmarks as identified in the 3D surface representation with the three landmarks as identified in the 2D images. The third landmark comprises a plurality of points defining a path between two points characterizing the first and second landmarks The identification of the first, second and third landmarks in the 3D representation and the 2D images, the derivation of the first and second sets of coordinates, and the registration, based on the derived first and second sets of coordinates, are performed automatically.

公开(公告)号：US20200005473A1

公开(公告)日：2020-01-02

申请号：US16025949

申请日：2018-07-02

Applicant: Sony Corporation

Inventor： Liangyin Yu

IPC: G06T7/33 ,  G06T3/00 ,  G06T7/00 ,  H04N13/25 ,  G06T7/80 ,  G06T11/00 ,  G06T7/73 ,  A61B6/03 ,  A61B6/00 ,  A61B1/313

Abstract: A method for automatic registration of landmarks in 3D and 2D images of an organ comprises: using a first set of coordinates of identified first, second and third landmarks of the organ, derived from a 3D surface representation of the organ, and a second set of coordinates of the landmarks, derived from 2D laparoscopic images of the organ, to register the three landmarks as identified in the 3D surface representation with the three landmarks as identified in the 2D images. The third landmark comprises a plurality of points defining a path between two points characterizing the first and second landmarks The identification of the first, second and third landmarks in the 3D representation and the 2D images, the derivation of the first and second sets of coordinates, and the registration, based on the derived first and second sets of coordinates, are performed automatically.

公开(公告)号：US10292769B1

公开(公告)日：2019-05-21

申请号：US16056883

申请日：2018-08-07

Applicant: SONY CORPORATION

Inventor： Liangyin Yu

IPC: A61B34/10 ,  A61B90/00 ,  A61B5/00 ,  G06T7/00 ,  G06T7/593 ,  A61B34/20

Abstract: Various aspects of a surgical assistive device and method to provide assistance in neurosurgery are disclosed herein. The surgical assistive device includes circuitry that determines initial positional shift in the anatomical portion of a subject caused by an incision into a protective portion. A first depth value is estimated based on the plurality of stereo images that are captured from different specified positions of the surgical image capture device to capture views of the anatomical surface of the anatomical portion through the incision. A residual shift in a position of a surgical region of interest is determined with respect to the estimated first depth value. Surgical guidance information is generated to indicate a correct depth of the surgical region of interest in a surgical cavity, based on the determined residual shift. Display of the generated surgical guidance information is controlled on a display screen coupled to the surgical assistive device.

公开(公告)号：US10002424B2

公开(公告)日：2018-06-19

申请号：US15273287

申请日：2016-09-22

Applicant: SONY CORPORATION

Inventor： Liangyin Yu ,  Ming-Chang Liu

IPC: G06K9/00 ,  G06T7/00 ,  G06T19/20 ,  G06T5/00 ,  G06T19/00

CPC classification number: G06T7/11 ,  G06T7/593 ,  G06T2207/30004

Abstract: Various aspects of an image-processing system and method to reconstruct a three-dimensional (3D) anatomical surface of an anatomical portion are disclosed herein. The system includes an image-processing device configured to receive a plurality of stereo images of the anatomical portion. A first set of key points with a point density greater than a threshold value is identified. A second set of key points is determined based on filtration of one or more outlier key points from the identified first set of key points. A 3D anatomical surface of the anatomical portion is reconstructed based on disparity of one or more matched key points in the determined second set of key points and a smoothing operation performed on the disparity.

公开(公告)号：US08942447B2

公开(公告)日：2015-01-27

申请号：US13671143

申请日：2012-11-07

Applicant: Sony Corporation

Inventor： Liangyin Yu ,  Ming-Chang Liu

IPC: G06K9/00

CPC classification number: G06K9/0014

Abstract: Certain aspects of an apparatus and method for method and apparatus for tissue region identification may include segmenting the image into a plurality of regions, filtering out regions in the plurality of regions which are curvilinear, and isolating a target area where the tissue sample is identified as the plurality of regions not filtered.

Abstract translation: 用于组织区域识别的方法和装置的装置和方法的某些方面可以包括将图像分割成多个区域，滤出多个区域中的曲线区域，并且将组织样本被识别的目标区域分离为 多个区域未被过滤。

公开(公告)号：US10467497B2

公开(公告)日：2019-11-05

申请号：US15049870

申请日：2016-02-22

Applicant: SONY CORPORATION

Inventor： Liangyin Yu ,  Bi Song ,  Ming-Chang Liu

IPC: G06K9/62 ,  A61B5/055 ,  A61B5/00 ,  A61B90/00 ,  G06T7/33 ,  G06T3/00 ,  G06F17/50 ,  A61B8/08 ,  G06T7/00

Abstract: Various aspects of a system and a method to provide assistance in a surgery in presence of tissue deformation are disclosed herein. In accordance with an embodiment, the system includes an electronic device that receives one or more tissue material properties of a plurality of surface structures of an anatomical portion. One or more boundary conditions associated with the anatomical portion may also be received. Surface displacement of the anatomical portion may be determined by matching a first surface of the anatomical portion before deformation with a corresponding second surface of the anatomical portion after the deformation. The volume displacement field of the anatomical portion may be computed based on the determined surface displacement, the received one or more tissue material properties, and the received one or more boundary conditions.

公开(公告)号：US10426372B2

公开(公告)日：2019-10-01

申请号：US14339352

申请日：2014-07-23

Applicant: Sony Corporation

Inventor： Liangyin Yu ,  Ming-Chang Liu

IPC: A61B5/055 ,  A61B6/03 ,  A61B6/00 ,  G06T7/00 ,  G06T7/33

Abstract: An image registration system, and a method of operation of an image registration system thereof, including: an imaging unit for obtaining a pre-operation non-invasive imaging volume and for obtaining an intra-operation non-invasive imaging volume; and a processing unit including: a rigid registration module for generating a rigid registered volume based on the pre-operation non-invasive imaging volume, a region of interest module for isolating a region of interest from the intra-operation non-invasive imaging volume, a point generation module, coupled to the region of interest module, for determining feature points of the region of interest, an optimization module, coupled to the point generation module, for matching the feature points with corresponding points of the rigid registered volume for generating a matched point cloud, and an interpolation module, coupled to the optimization module, for generating a non-rigid registered volume based on the matched point cloud for display on a display interface.

公开(公告)号：US09934586B2

公开(公告)日：2018-04-03

申请号：US15017021

申请日：2016-02-05

Applicant: SONY CORPORATION

Inventor： Liangyin Yu ,  Ming-Chang Liu

IPC: G06K9/00 ,  G06T7/33 ,  G06T7/12 ,  G06T7/149

CPC classification number: G06T7/337 ,  G06T7/12 ,  G06T7/149 ,  G06T2207/10084 ,  G06T2207/20036

Abstract: Various aspects of a system and a method to process multimodal images are disclosed herein. In accordance with an embodiment, the system includes an image-processing device that generates a structured point cloud, which represents edge points of an anatomical portion. The structured point cloud is generated based on shrink-wrapping of an unstructured point cloud to a boundary of the anatomical portion. Diffusion filtering is performed to dilate edge points that correspond to the structured point cloud to mutually connect the edge points on the structured point cloud. A mask is created for the anatomical portion based on the diffusion filtering.