DISTRIBUTED ARTIFICIAL INTELLIGENCE RUNTIME AT THE NETWORK EDGE AS A SERVICE

    公开(公告)号:US20240054318A1

    公开(公告)日:2024-02-15

    申请号:US17888379

    申请日:2022-08-15

    CPC classification number: G06N3/04 G06N3/10

    Abstract: This disclosure describes techniques and mechanisms for enabling a user and third party applications to dynamically partition and place heavy deep learning workloads on standard edge networks to optimize the overall inference throughput of the network while meeting Service Level Objective(s) (SLOs). The techniques may include profiling, partitioning, and splitting of the deep learning workloads, which may be hidden from the user and/or third party application. The user may user interact with a pre-deployed service through a simple SDK that resembles those used for hardware acceleration, such that the current techniques may be easily inserted into their code.

    Eventually-Consistent Message Delivery System for Edge Applications

    公开(公告)号:US20250080615A1

    公开(公告)日:2025-03-06

    申请号:US18665320

    申请日:2024-05-15

    Abstract: In one embodiment, a method by a site router agent at an edge site includes receiving a first message from a message router at an edge backend, where a destination field of the first message includes a destination information, determining that the first message is destined to a first application instance by comparing a first unique identifying information associated with the first application instance with the destination information, storing the first message into a storage communicatively connected to the site router agent, establishing a network connection with the first application instance, and sending the first message to the first application instance upon establishing the network connection.

    Compliant node identification
    3.
    发明授权

    公开(公告)号:US12149564B2

    公开(公告)日:2024-11-19

    申请号:US17877508

    申请日:2022-07-29

    Abstract: In one embodiment, a device may obtain an identifier of a proof of location process (PLP) and an identifier of a node where the PLP is executed. The device may receive a query from a compliance engine for a proof of location of the node where the PLP is executed. The device may identify, based on the identifier of the PLP and the identifier of the node, a physical location of the node. The device may provide, to the compliance engine, a response to the query that is indicative of the physical location of the node, wherein the compliance engine enforces one or more data compliance policies with respect to a workload executed by the node and based on the physical location of the node.

    Edge Application Processing Interface Exporter

    公开(公告)号:US20250053466A1

    公开(公告)日:2025-02-13

    申请号:US18366860

    申请日:2023-08-08

    Abstract: In one embodiment, a method may receive a first notification message associated with an instance of an edge application at an edge site of an edge network. The method may receive a subset of a unique identifier associated with the instance of the edge application from an application processing interface (API) router agent associated with the edge application. The method may use the subset of the unique identifier to determine a complete unique identifier associated with the instance of the edge application. The method may generate a second notification message corresponding to an API call using the complete unique identifier. The method may determine a network connection with the API router agent associated with the edge application. In response to determining the network connection is stable, the method may expose the second notification message to the API router agent associated with the edge application.

    Eventually-consistent message delivery system for edge applications

    公开(公告)号:US12015673B1

    公开(公告)日:2024-06-18

    申请号:US18457640

    申请日:2023-08-29

    CPC classification number: H04L67/141 H04L67/10

    Abstract: In one embodiment, a method by a site router agent at an edge site comprises determining that a first application instance becomes running on the edge site, where the first application instance is associated with a first unique identifying information, sending a report to a control plane of an edge backend indicating that the first application instance becomes available at the edge site, retrieving a first message from a message router at the edge backend, determining that the first message is destined to the first application instance based on a destination field of the first message, storing the first message into a storage communicatively connected to the site router agent, establishing a network connection with the first application instance, and sending the first message to the first application instance upon establishing the network connection.

    Eventually-consistent message delivery system for edge applications

    公开(公告)号:US12278872B2

    公开(公告)日:2025-04-15

    申请号:US18665320

    申请日:2024-05-15

    Abstract: In one embodiment, a method by a site router agent at an edge site includes receiving a first message from a message router at an edge backend, where a destination field of the first message includes a destination information, determining that the first message is destined to a first application instance by comparing a first unique identifying information associated with the first application instance with the destination information, storing the first message into a storage communicatively connected to the site router agent, establishing a network connection with the first application instance, and sending the first message to the first application instance upon establishing the network connection.

    Managing Edge Application Permissions

    公开(公告)号:US20250055854A1

    公开(公告)日:2025-02-13

    申请号:US18366924

    申请日:2023-08-08

    Abstract: In one embodiment, a method may access a first description of a plurality of edge applications and a cluster level security policy on an edge site of an Internet of Things (IoT) network. The method may receive a second description of a storage related operation associated with an edge application to be deployed on the edge site. The method may determine a permission level for the storage related operation based on the first and second descriptions. The method may determine, using the cluster level security policy and the permission level, an updated cluster level security policy. In response to determining the permission level is privileged, the method may perform, using a first secure agent, an edge cluster, and the updated clustered level security policy, the storage related operation associated with the edge application on the edge site of the IoT network.

    SYMBIOTIC NETWORK ORCHESTRATOR FOR COMPUTING NETWORKS

    公开(公告)号:US20250055753A1

    公开(公告)日:2025-02-13

    申请号:US18732182

    申请日:2024-06-03

    Abstract: A method for providing a symbiotic network orchestrator utilized to automatically commission edge computing devices on corporate computing networks and edge site computing networks is presented. The method includes receiving an indication of a potential connection of an edge computing device to one or more computing networks associated with the orchestrator. The one or more computing networks includes a corporate computing network and an edge site computing network. The method further includes determining, based on the corporate computing network, the edge site computing network, and a predetermined set of rules, an intent for commissioning the edge computing device, reconfiguring, based on the intent, the corporate computing network and the edge site computing network, and commissioning the edge computing device on one or more of the corporate computing network or the edge site computing network in accordance with the reconfiguring.

    Reconfiguring Edge Applications At Runtime

    公开(公告)号:US20250053425A1

    公开(公告)日:2025-02-13

    申请号:US18446201

    申请日:2023-08-08

    Abstract: In one embodiment, a method by a runtime configuration service at an edge site comprises receiving a registration request from a particular application comprising a particular identifier associated with the particular application, establishing a connection to a control plane application programming interface (API) gateway located in an edge backend, sending a state request message to the API gateway comprising a site identifier and the particular identifier, receiving a state response message from the API gateway comprising a desired state for the particular application, storing a desired state for the particular application, and sending a notification to the particular application indicating an updated desired state for the particular application is available.

    Compliant data transfers
    10.
    发明授权

    公开(公告)号:US12225052B2

    公开(公告)日:2025-02-11

    申请号:US17877989

    申请日:2022-07-31

    Abstract: In one embodiment, a device may determine a compliance status of a communication of a type of data between a first workload and a second workload based on a data compliancy policy and a verified node location of at least one of the first workload and the second workload. The device may send, based on the compliance status of the communication, an instruction for handling the communication to at least one of a node executing the first workload and a node executing the second workload.

Patent Agency Ranking