公开(公告)号：US20230333879A1

公开(公告)日：2023-10-19

申请号：US18133632

申请日：2023-04-12

Applicant: SambaNova Systems, Inc.

Inventor： Arnav GOEL ,  Ravinder KUMAR ,  Qi ZHENG ,  Milad SHARIF ,  Jiayu BAI ,  Neal SANGHVI

IPC: G06F9/48 ,  G06F9/445 ,  G06F9/50

CPC classification number: G06F9/4843 ,  G06F9/44505 ,  G06F9/5016

Abstract: A data processing system is presented that is configured as a server in a client-server configuration for executing applications that a client in the client-server configuration can offload as execution tasks for execution on the server. The data processing system includes a reconfigurable processor, a storage device that stores configuration files for the applications, and a host processor that is coupled to the storage device and to the reconfigurable processor. The host processor is configured to receive an execution task of the execution tasks with an identifier of an application from the client, retrieve a configuration file that is associated with the application from the storage device using the identifier of the application, configure the reconfigurable processor with the configuration file, and start execution of the application on the reconfigurable processor, whereby the reconfigurable processor provides output data of the execution of the application to the client.

公开(公告)号：US20230388373A1

公开(公告)日：2023-11-30

申请号：US18200311

申请日：2023-05-22

Applicant: SambaNova Systems, Inc.

Inventor： Milad SHARIF ,  Ravinder KUMAR ,  Qi ZHENG ,  Neal SANGHVI ,  Jiayu BAI ,  Arnav GOEL

IPC: H04L67/1014 ,  H04L67/1097

CPC classification number: H04L67/1014 ,  H04L67/1097

Abstract: A data processing system is presented in a client-server configuration for executing first and second applications that a client in the client-server configuration can offload for execution onto the data processing system. The data processing system includes a server and a pool of reconfigurable data flow resources that is configured to execute the first application in a first runtime context and the second application in a second runtime context. The server is configured to establish a session with the client, receive first and second execution requests for executing the first application and the second application from the client, start respective first and second execution of the first and second applications in the respective first and second runtime contexts in response to receiving the first and second execution requests, and balance a first load from the first execution with a second load from the second execution.

公开(公告)号：US20230259823A1

公开(公告)日：2023-08-17

申请号：US18109080

申请日：2023-02-13

Applicant: SambaNova Systems, Inc.

Inventor： Greg DYKEMA ,  Fansheng CHENG ,  Kuan ZHOU ,  Arnav GOEL ,  Subhra MAZUMDAR ,  Milad SHARIF ,  Po-Yu WU ,  Bowen YANG ,  Qi ZHENG

IPC: G06N20/00

CPC classification number: G06N20/00

Abstract: In a method an orchestrator of a computing system determines that results of Machine Learning model computations are available and dispatches a worker to perform model computations that include computing gradients of the results. The orchestrator determines that a set of gradients of the results is available and dispatches a gradient worker to compute a sum of the gradients. The orchestrator determines that a second set of gradients of the results is available and dispatches a second gradient worker to compute a sum of the second set of gradients. The orchestrator determines that the sums of the first and second gradients are available and dispatches a third gradient worker to compute synchronized gradients. The gradient workers compute the sums and synchronized gradients concurrent with training workers computing additional model computations results and/or gradients. A computer program product can include the method and a computing system can include the orchestrator.

公开(公告)号：US20240273057A1

公开(公告)日：2024-08-15

申请号：US18635114

申请日：2024-04-15

Applicant: SambaNova Systems, Inc.

Inventor： Greg DYKEMA ,  Maran WILSON ,  Guoyao FENG ,  Kuan ZHOU ,  Tianyu SUN ,  Taylor LEE ,  Kin Hing LEUNG ,  Arnav GOEL ,  Conrad Alexander TURLIK ,  Milad SHARIF

IPC: G06F15/80 ,  G06F8/41 ,  G06F15/78

CPC classification number: G06F15/8038 ,  G06F8/443 ,  G06F8/447 ,  G06F8/45 ,  G06F15/7867 ,  G06F15/80

Abstract: A host system for executing an application on first and/or second reconfigurable processors is presented. The host system is operatively coupled to the first and second reconfigurable processors, whereby the first reconfigurable processors have a first architecture, and the second reconfigurable processors have a second architecture that is different than the first architecture. The host system allocates reconfigurable processors of the first and/or second reconfigurable processors for executing the application and includes an auto-discovery module that is configured to determine whether the allocated reconfigurable processors include at least one of the first reconfigurable processors.

公开(公告)号：US20240231903A1

公开(公告)日：2024-07-11

申请号：US18614639

申请日：2024-03-23

Applicant: SambaNova Systems, Inc.

Inventor： Qi ZHENG ,  Arnav GOEL ,  Conrad Alexander TURLIK ,  Guoyao FENG ,  Joshua Earle POLZIN ,  Fansheng CHENG ,  Ravinder KUMAR ,  Greg DYKEMA ,  Subhra MAZUMDAR ,  Milad SHARIF ,  Jiayu BAI ,  Neal SANGHVI ,  Arjun SABNIS ,  Letao CHEN

IPC: G06F9/48 ,  G06F9/38

CPC classification number: G06F9/4881 ,  G06F9/3877

Abstract: In a computer-implemented method a Dynamic Transfer Engine (DTE) included in a computing system receives a dynamic stimulus associated with transfer of stage data during execution of a dataflow application by the system. The DTE determines, based on source and destination devices of the transfer, a transfer method and a transfer channel to transfer the stage data between memories coupled to the source and destination devices. The DTE acquires, hardware resources of the computing system to transfer the stage using the channel and, initiates the transfer. A computer program product can cause one or more processors to perform the method. A computing system can comprise source and destination processors and memories, hardware channels to transfer data between the memories, a resource manager, and a DTE configured to perform the method.

公开(公告)号：US20230297527A1

公开(公告)日：2023-09-21

申请号：US18121224

申请日：2023-03-14

Applicant: SambaNova Systems, Inc.

Inventor： Conrad Alexander TURLIK ,  Sudhakar DINDUKURTI ,  Anand MISRA ,  Arjun SABNIS ,  Milad SHARIF ,  Ravinder KUMAR ,  Joshua Earle POLZIN ,  Arnav GOEL ,  Steven DAI

IPC: G06F13/28

CPC classification number: G06F13/28 ,  G06F2213/3808

Abstract: A system is presented that includes two data processing systems that are coupled via a network, each data processing system including a reconfigurable processor with a reconfigurable processor memory, a host that is coupled to the reconfigurable processor and that includes a host processor and a host memory that is coupled to the host processor, and a network interface controller (NIC) that is operatively coupled to the reconfigurable processor and to the host processor. The reconfigurable processor of one of the data processing systems is configured to implement a virtual function that uses a virtual address for a memory access operation. An application programming interface (API) in the host processor translates the virtual address into a physical address, and the NIC uses the physical address to initiate a direct memory access operation at the reconfigurable processor memory or the host memory of the other data processing system.