公开(公告)号：US20220019069A1

公开(公告)日：2022-01-20

申请号：US17295353

申请日：2019-10-31

Applicant: GOOGLE LLC

Inventor： Jason Hipp ,  Martin Stumpe

IPC: G02B21/32 ,  G02B21/36 ,  G06N20/00 ,  G06F3/16

Abstract: An augmented reality (AR) subsystem including one or more machine learning models, automatically overlays an augmented reality image, e.g., a border or outline, that identifies cells of potential interest, in the field of view of the specimen as seen through the eyepiece of an LCM microscope. The operator does not have to manually identify the cells of interest for subsequent LCM, e.g, on a workstation monitor, as in the prior art. The operator is provided with a switch, operator interface tool or other mechanism to select the identification of the cells, that is, indicate approval of the identification of the cells, while they view the specimen through the eyepiece. Activation of the switch or other mechanism invokes laser excising and capture of the cells of interest via a known and conventional LCM subsystem.

公开(公告)号：US11994664B2

公开(公告)日：2024-05-28

申请号：US17295353

申请日：2019-10-31

Applicant: GOOGLE LLC

Inventor： Jason Hipp ,  Martin Stumpe

IPC: G02B21/32 ,  G02B21/36 ,  G06F3/16 ,  G06N20/00

CPC classification number: G02B21/32 ,  G02B21/365 ,  G06F3/167 ,  G06N20/00

Abstract: An augmented reality (AR) subsystem including one or more machine learning models, automatically overlays an augmented reality image, e.g., a border or outline, that identifies cells of potential interest, in the field of view of the specimen as seen through the eyepiece of an LCM microscope. The operator does not have to manually identify the cells of interest for subsequent LCM, e.g, on a workstation monitor, as in the prior art. The operator is provided with a switch, operator interface tool or other mechanism to select the identification of the cells, that is, indicate approval of the identification of the cells, while they view the specimen through the eyepiece. Activation of the switch or other mechanism invokes laser excising and capture of the cells of interest via a known and conventional LCM subsystem.

公开(公告)号：US11379516B2

公开(公告)日：2022-07-05

申请号：US16978102

申请日：2018-03-29

Applicant: GOOGLE LLC

Inventor： Lily Peng ,  Martin Stumpe ,  Daniel Smilkov ,  Jason Hipp

IPC: G06F16/532 ,  G06F16/55 ,  G06F16/583 ,  G06F16/538 ,  G06F16/2457 ,  G16H30/20 ,  G16H50/20 ,  G06K9/62 ,  G06V10/75

Abstract: A system for searching for similar medical images includes a reference library in the form of a multitude of medical images, at least some of which are associated with metadata including clinical information relating to the specimen or patient associated with the medical images. A computer system is configured as a search tool for receiving an input image query from a user. The computer system is trained to find one or more similar medical images in the reference library system which are similar to the input image. The reference library is represented as an embedding of each of the medical images projected in a feature space having a plurality of axes, wherein the embedding is characterized by two aspects of a similarity ranking: (1) visual similarity, and (2) semantic similarity such that neighboring images in the feature space are visually similar and semantic information is represented by the axes of the feature space. The computer system supports additional queries from a user to thereby further refine a search for medical images similar to the input image within a search space consisting of the one or more similar medical images.