MODEL ML REGISTRY AND MODEL SERVING
    1.
    发明公开

    公开(公告)号:US20240152496A1

    公开(公告)日:2024-05-09

    申请号:US18512028

    申请日:2023-11-17

    CPC classification number: G06F16/219 G06F16/955 G06N5/022

    Abstract: A system includes an interface, a processor, and a memory. The interface is configured to receive a version of a model from a model registry. The processor is configured to store the version of the model, start a process running the version of the model, and update a proxy with version information associated with the version of the model, wherein the updated proxy indicates to redirect an indication to invoke the version of the model to the process. The memory is coupled to the processor and configured to provide the processor with instructions.

    RESOURCE MANAGEMENT WITH INTERMEDIARY NODE IN KUBERNETES ENVIRONMENT

    公开(公告)号:US20250094195A1

    公开(公告)日:2025-03-20

    申请号:US18368919

    申请日:2023-09-15

    Abstract: A resource management configuration may receive an API request from an API server. The API request specifies task information from a plurality of tenants. The configuration transmits status information of a plurality of VMs to the API server to assign tasks to one or more VMs based on the task information and the status information. Tasks assigned to a VM of the plurality of VMs are for one tenant of the plurality of tenants. The configuration configures on an untrusted network, network security groups for managing communications of tenants such that a network security group configured for a tenant permits communications between VMs assigned to the same tenant but prevents communications between VMs assigned to different tenants. The configuration pins each assigned VM of the one or more assigned VMs to perform the task based on the task information of the corresponding tenant.

    MODEL ML REGISTRY AND MODEL SERVING

    公开(公告)号:US20250021536A1

    公开(公告)日:2025-01-16

    申请号:US18885322

    申请日:2024-09-13

    Abstract: A system includes an interface, a processor, and a memory. The interface is configured to receive a version of a model from a model registry. The processor is configured to store the version of the model, start a process running the version of the model, and update a proxy with version information associated with the version of the model, wherein the updated proxy indicates to redirect an indication to invoke the version of the model to the process. The memory is coupled to the processor and configured to provide the processor with instructions.

    MODEL ML REGISTRY AND MODEL SERVING

    公开(公告)号:US20220092043A1

    公开(公告)日:2022-03-24

    申请号:US17324907

    申请日:2021-05-19

    Abstract: A system includes an interface, a processor, and a memory. The interface is configured to receive a version of a model from a model registry. The processor is configured to store the version of the model, start a process running the version of the model, and update a proxy with version information associated with the version of the model, wherein the updated proxy indicates to redirect an indication to invoke the version of the model to the process. The memory is coupled to the processor and configured to provide the processor with instructions.

    Reducing cluster start up time
    5.
    发明授权

    公开(公告)号:US12248818B1

    公开(公告)日:2025-03-11

    申请号:US17514988

    申请日:2021-10-29

    Abstract: The present application discloses a method, system, and computer system for starting up and maintaining a cluster in a warmed up state, and/or allocating clusters from a warmed up state. The method includes instantiating a set of virtual machines, wherein instantiating the set of virtual machines includes setting a temporary security credential for each virtual machine of the set of virtual machines, receiving a virtual machine allocation request associated with a workspace, a customer, or a tenant, in response to the virtual machine allocation request: allocating a virtual machine, wherein allocating the virtual machine comprises replacing the temporary security credential with a security credential associated with the workspace, the customer, or the tenant.

    Model ML registry and model serving

    公开(公告)号:US11853277B2

    公开(公告)日:2023-12-26

    申请号:US18162579

    申请日:2023-01-31

    CPC classification number: G06F16/219 G06F16/955 G06N5/022

    Abstract: A system includes an interface, a processor, and a memory. The interface is configured to receive a version of a model from a model registry. The processor is configured to store the version of the model, start a process running the version of the model, and update a proxy with version information associated with the version of the model, wherein the updated proxy indicates to redirect an indication to invoke the version of the model to the process. The memory is coupled to the processor and configured to provide the processor with instructions.

    Model ML registry and model serving

    公开(公告)号:US11693837B2

    公开(公告)日:2023-07-04

    申请号:US17324907

    申请日:2021-05-19

    CPC classification number: G06F16/219 G06F16/955 G06N5/022

    Abstract: A system includes an interface, a processor, and a memory. The interface is configured to receive a version of a model from a model registry. The processor is configured to store the version of the model, start a process running the version of the model, and update a proxy with version information associated with the version of the model, wherein the updated proxy indicates to redirect an indication to invoke the version of the model to the process. The memory is coupled to the processor and configured to provide the processor with instructions.

    Checkpoint and restore based startup of executor nodes of a distributed computing engine for processing queries

    公开(公告)号:US12229137B1

    公开(公告)日:2025-02-18

    申请号:US18412438

    申请日:2024-01-12

    Abstract: A system performs efficient startup of executors of a distributed computing engine used for processing queries, for example, database queries. The system starts an executor node and processes a set of queries using the executor node to warm up the executor node. The system performs a checkpoint of the warmed-up executor node to create an image. The image is restored in the target executor nodes. The system may store a checkpoint image for each configuration of an executor node. The configuration is determined based on various factors including the hardware of the executor node, memory allocation of the processes, and so on. The user or restore based on checkpoint images improves efficiency of execution of the startup of executor nodes.

    Model ML registry and model serving

    公开(公告)号:US12117983B2

    公开(公告)日:2024-10-15

    申请号:US18512028

    申请日:2023-11-17

    CPC classification number: G06F16/219 G06F16/955 G06N5/022

    Abstract: A system includes an interface, a processor, and a memory. The interface is configured to receive a version of a model from a model registry. The processor is configured to store the version of the model, start a process running the version of the model, and update a proxy with version information associated with the version of the model, wherein the updated proxy indicates to redirect an indication to invoke the version of the model to the process. The memory is coupled to the processor and configured to provide the processor with instructions.

    Model ML Registry and Model Serving
    10.
    发明公开

    公开(公告)号:US20230177031A1

    公开(公告)日:2023-06-08

    申请号:US18162579

    申请日:2023-01-31

    CPC classification number: G06F16/219 G06F16/955 G06N5/022

    Abstract: A system includes an interface, a processor, and a memory. The interface is configured to receive a version of a model from a model registry. The processor is configured to store the version of the model, start a process running the version of the model, and update a proxy with version information associated with the version of the model, wherein the updated proxy indicates to redirect an indication to invoke the version of the model to the process. The memory is coupled to the processor and configured to provide the processor with instructions.

Patent Agency Ranking