Deep 3D attention long short-term memory for video-based action recognition

    公开(公告)号:US10296793B2

    公开(公告)日:2019-05-21

    申请号:US15479408

    申请日:2017-04-05

    Abstract: A method, a computer program product, and a system are provided for video based action recognition. The system includes a processor. One or more frames from one or more video sequences are received. A feature vector for each patch of the one or more frames is generated using a deep convolutional neural network. An attention factor for the feature vectors is generated based on a within-frame attention and a between-frame attention. A target action is identified using a multi-layer deep long short-term memory process applied to the attention factor, said target action representing at least one of the one or more video sequences. An operation of a processor-based machine is controlled to change a state of the processor-based machine, responsive to the at least one of the one or more video sequences including the identified target action.

    Generic Object Detection on Fixed Surveillance Video
    15.
    发明申请
    Generic Object Detection on Fixed Surveillance Video 有权
    固定监控视频的通用对象检测

    公开(公告)号:US20160300111A1

    公开(公告)日:2016-10-13

    申请号:US15088530

    申请日:2016-04-01

    Inventor: Eric Cosatto

    CPC classification number: G06K9/00718 G06K9/00771 G06K9/6254

    Abstract: Systems and methods are disclosed for computer vision and object detection by extracting tracks of moving objects on a set of video sequences; selecting a subset of tracks for training; rendering a composite of each selected track into a single image; labeling tracks using the rendered images; training a track classifier by supervised machine learning using the labeled tracks; applying the trained track classifier to the remainder of the tracks; and selecting tracks classified with a low confidence by the classifier.

    Abstract translation: 通过提取一组视频序列上的移动物体的轨迹,公开了用于计算机视觉和物体检测的系统和方法; 选择训练的轨道子集; 将每个所选轨道的复合渲染成单个图像; 使用渲染图像标记轨迹; 通过使用标记轨迹的监督机器学习训练轨道分类器; 将经训练的轨道分类器应用于轨道的其余部分; 并选择由分类器以低置信度分类的轨道。

    MODEL RETRAINING FOR DIFFERENT HISTOLOGICAL STAININGS

    公开(公告)号:US20240354953A1

    公开(公告)日:2024-10-24

    申请号:US18616983

    申请日:2024-03-26

    Inventor: Eric Cosatto

    CPC classification number: G06T7/0014 G01N1/30 G06T2207/20081 G06T2207/20084

    Abstract: Methods and systems for training a model include performing color deconvolution on a set of training images, stained according to a first staining process, to generate channels that correspond to dyes used in the first staining process and dyes used in a second staining process. A channel is selected corresponds to a dye used in the second staining process. A machine learning model is trained, using the selected channel of the set of training images, to function with images stained according to the first staining process and images stained according to the second staining process.

    APPROACH TO UNSUPERVISED DATA LABELING

    公开(公告)号:US20220319156A1

    公开(公告)日:2022-10-06

    申请号:US17711667

    申请日:2022-04-01

    Abstract: Systems and methods for labelling data is provided. The method includes receiving data at a detector, and identifying a set of objects and features in the data using a neural network. The method further includes annotating the data based on the identified set of objects and features, and receiving a query from a user. The method further includes transforming the query into a representation that can be processed by a symbolic engine, and receiving the annotated data and a transformed query at the symbolic engine. The method further includes matching the transformed query with the annotated data, and presenting the annotated data that matches the transformed query to the user in a labelling interface. The method further includes applying new labels received from the user for the annotated data that matches the transformed query, recursively utilizing the newly annotated data to refine the detector.

    TUMOR CELL ISOLINES
    18.
    发明申请

    公开(公告)号:US20220319002A1

    公开(公告)日:2022-10-06

    申请号:US17711475

    申请日:2022-04-01

    Inventor: Eric Cosatto

    Abstract: Methods and systems for processing a scanned tissue section include locating cells within a scanned tissue. Cells in the scanned tissue are classified using a classifier model. A tumor-cell ratio (TCR) map is generated based on classified normal cells and tumor cells. A TCR isoline is generated for a target TCR value using the TCR map, marking areas of the tissue section where a TCR is at or above the target TCR value. Dissection is performed on the tissue sample to isolate an area identified by the isoline.

    MULTI-SCALE TUMOR CELL DETECTION AND CLASSIFICATION

    公开(公告)号:US20220028068A1

    公开(公告)日:2022-01-27

    申请号:US17380207

    申请日:2021-07-20

    Abstract: Methods and systems for training a machine learning model include generating pairs of training pixel patches from a dataset of training images, each pair including a first patch representing a part of a respective training image, and a second patch, centered at the same location as the first, representing a larger part of the training image, being resized to a same size of as the first patch. A detection model is trained using the first pixel patches, to detect and locate cells in the images. A classification model is trained using the first pixel patches, to classify cells according to whether the detected cells are cancerous, based on cell location information generated by the detection model. A segmentation model is trained using the second pixel patches, to locate and classify cancerous arrangements of cells in the images.

Patent Agency Ranking