User interface for visual diagnosis of image misclassification by machine learning

    公开(公告)号:US12182227B2

    公开(公告)日:2024-12-31

    申请号:US18155024

    申请日:2023-01-16

    Abstract: Computer systems and associated methods are disclosed to implement a model development environment (MDE) that allows a team of users to perform iterative model experiments to develop machine learning (ML) media models. In embodiments, the MDE implements a media data management interface that allows users to annotate and manage training data for models. In embodiments, the MDE implements a model experimentation interface that allows users to configure and run model experiments, which include a training run and a test run of a model. In embodiments, the MDE implements a model diagnosis interface that displays the model's performance metrics and allows users to visually inspect media samples that were used during the model experiment to determine corrective actions to improve model performance for later iterations of experiments. In embodiments, the MDE allows different types of users to collaborate on a series of model experiments to build an optimal media model.

    Collaborative dataset management system for machine learning data

    公开(公告)号:US11176154B1

    公开(公告)日:2021-11-16

    申请号:US16268382

    申请日:2019-02-05

    Abstract: Computer systems and associated methods are disclosed to implement a collaborative dataset management system (CDMS) for machine learning (ML) data. In embodiments, CDMS allows many users to create, review, and collaboratively evolve ML datasets. In embodiments, dataset owners may make their datasets available to other users on CDMS for a fee and under specified licensing conditions. CDMS users can search for other users' datasets on the system to use in their own ML tasks. CDMS users may also create child datasets from existing datasets on the system. Parent and child datasets may be linked so that changes to one dataset are provided to the other via merge requests. A dataset owner may use CDMS to review an incoming merge request using one or more audit jobs before approving the request. In this manner, CDMS provides a shared repository and collaboration system for managing high-quality datasets to power machine learning processes.

    System for visually diagnosing machine learning models

    公开(公告)号:US11537506B1

    公开(公告)日:2022-12-27

    申请号:US16172637

    申请日:2018-10-26

    Abstract: Computer systems and associated methods are disclosed to implement a model development environment (MDE) that allows a team of users to perform iterative model experiments to develop machine learning (ML) media models. In embodiments, the MDE implements a media data management interface that allows users to annotate and manage training data for models. In embodiments, the MDE implements a model experimentation interface that allows users to configure and run model experiments, which include a training run and a test run of a model. In embodiments, the MDE implements a model diagnosis interface that displays the model's performance metrics and allows users to visually inspect media samples that were used during the model experiment to determine corrective actions to improve model performance for later iterations of experiments. In embodiments, the MDE allows different types of users to collaborate on a series of model experiments to build an optimal media model.

    Fast annotation of samples for machine learning model development

    公开(公告)号:US11556746B1

    公开(公告)日:2023-01-17

    申请号:US16172614

    申请日:2018-10-26

    Abstract: Computer systems and associated methods are disclosed to implement a model development environment (MDE) that allows a team of users to perform iterative model experiments to develop machine learning (ML) media models. In embodiments, the MDE implements a media data management interface that allows users to annotate and manage training data for models. In embodiments, the MDE implements a model experimentation interface that allows users to configure and run model experiments, which include a training run and a test run of a model. In embodiments, the MDE implements a model diagnosis interface that displays the model's performance metrics and allows users to visually inspect media samples that were used during the model experiment to determine corrective actions to improve model performance for later iterations of experiments. In embodiments, the MDE allows different types of users to collaborate on a series of model experiments to build an optimal media model.

Patent Agency Ranking