CROSS-PLATFORM COMPUTATIONAL GRAPH IMPORTING, CUSTOMIZATION AND EXECUTION

    公开(公告)号:US20240345894A1

    公开(公告)日:2024-10-17

    申请号:US18636172

    申请日:2024-04-15

    CPC classification number: G06F9/5061 G06F9/4881

    Abstract: System and methods for importing, converting, optimizing and/or executing a computational graph or AST at an endpoint target. The system includes accessing an input computational graph corresponding to a trained machine-learning (ML) model; converting the input computational graph into an internal computational graph; based on determined characteristics of the internal computational graph, optimizing the internal computational graph to generate an optimized computational graph by applying one or more of at least a graph element reordering operation, a graph element fusing operation, or a graph element creation operation; converting the optimized computational graph to executable instructions enabled to be executed on an endpoint associated with a backend and a platform; generating associated scheduling instructions; and executing the executable instructions on the endpoint based on the scheduling instructions. The executable instructions can forgo references to the input, internal or optimized computational graphs, and/or be reused by other systems, engines or applications.

    Dynamic subtask creation and execution in processing platforms

    公开(公告)号:US12086647B2

    公开(公告)日:2024-09-10

    申请号:US18083127

    申请日:2022-12-16

    CPC classification number: G06F9/5061 G06F9/48 G06F9/4806

    Abstract: A method for dynamically generating and executing tasks can include includes executing a worker execution stream, where the worker execution stream includes multiple execution threads associated with a workflow of the workflow service, receiving, by the worker execution stream, from a workflow service, a definition of a task, and responsive to determining that the definition of the task satisfies a predefined criterion, dividing the task into a set of sub-tasks. The method further includes generating a definition of a sub-task workflow for the set of sub-tasks, and causing the workflow service to distribute, based on the definition of the sub-task workflow, the sub-tasks of the set to one or more workers for execution.

Patent Agency Ranking