公开(公告)号：US08489967B2

公开(公告)日：2013-07-16

申请号：US13438227

申请日：2012-04-03

申请人： Ravi K. Arimilli ,  Piyush Chaudhary

发明人： Ravi K. Arimilli ,  Piyush Chaudhary

IPC分类号： H03M13/00

CPC分类号： H04L1/1841 ,  G06F9/546 ,  H04L69/14

摘要： Mechanisms are provided for processing streaming data at high sustained data rates. These mechanisms receive a plurality of data elements over a plurality of non-sequential communication channels and write the plurality of data elements directly to the file system of the data processing system in an unassembled manner. The mechanisms determining whether to perform a data scrubbing operation or not based on history information indicative of whether data elements in the plurality of data elements are being received in a substantially sequential manner. The mechanisms perform a data scrubbing operation, in response to a determination to perform data scrubbing, to identify any missing data elements in the plurality of data elements written to the file system and assemble the plurality of data elements into a plurality of data streams in response to results of the data scrubbing indicating that there are no missing data elements.

摘要翻译： 提供了用于以高持续数据速率处理流数据的机制。 这些机制通过多个非顺序通信信道接收多个数据元素，并以未组装的方式将多个数据元素直接写入数据处理系统的文件系统。 基于表示多个数据元素中的数据元素是否以大致顺序的方式被接收的历史信息，确定是否执行数据擦除操作的机制。 响应于执行数据擦除的确定，机构执行数据擦除操作以识别写入文件系统的多个数据元素中的任何丢失的数据元素，并将多个数据元素组合成多个数据流以作为响应 到数据清理的结果，表明没有丢失的数据元素。

公开(公告)号：US08370855B2

公开(公告)日：2013-02-05

申请号：US12342616

申请日：2008-12-23

申请人： Ravi K. Arimilli ,  Piyush Chaudhary

发明人： Ravi K. Arimilli ,  Piyush Chaudhary

IPC分类号： G06F9/52

CPC分类号： G06F9/545 ,  G06F9/547

摘要： A mechanism is provided for managing a process-to-process intra-cluster communication request. A call from a first application is received in a first operating system in a first data processing system. The first operating system passes the call from the first operating system to a first host fabric interface controller in the first data processing system without processing the call. The first host fabric interface controller processes the call without intervention by the first operating system to determine a second data processing system in the plurality of data processing systems with which the call is associated. The first host fabric interface controller initiates an intra-cluster connection to a second host fabric interface controller in the second data processing system. The first host fabric interface controller then transfers the call to the second host fabric interface controller in the second data processing system via the intra-cluster connection.

摘要翻译： 提供了一种用于管理流程到流程的群集内通信请求的机制。 在第一数据处理系统中的第一操作系统中接收来自第一应用的呼叫。 第一操作系统将呼叫从第一操作系统传递到第一数据处理系统中的第一主机结构接口控制器，而不处理该呼叫。 所述第一主机结构接口控制器处理所述呼叫而不用所述第一操作系统进行干预以确定所述呼叫与之相关联的所述多个数据处理系统中的第二数据处理系统。 第一主机结构接口控制器在第二数据处理系统中发起到第二主机结构接口控制器的集群内连接。 第一主机接口控制器然后经由集群内连接将呼叫转移到第二数据处理系统中的第二主机结构接口控制器。

公开(公告)号：US08335238B2

公开(公告)日：2012-12-18

申请号：US12342193

申请日：2008-12-23

申请人： Ravi K. Arimilli ,  Piyush Chaudhary

发明人： Ravi K. Arimilli ,  Piyush Chaudhary

IPC分类号： H04J3/00

CPC分类号： G06F11/106 ,  H04L65/80 ,  H04L69/14 ,  H04N5/765 ,  H04N5/782 ,  H04N21/234318 ,  H04N21/4347 ,  H04N21/44016 ,  H04N21/631 ,  H04N21/8453 ,  H04N21/8547

摘要： Mechanisms are provided for processing streaming data at high sustained data rates. These mechanisms receive a plurality of data elements over a plurality of non-sequential communication channels and write the plurality of data elements directly to the file system of the data processing system in an unassembled manner. The mechanisms further perform a data scrubbing operation to determine if there are any missing data elements that are not present in the plurality of data elements written to the file system and assemble the plurality of data elements into a plurality of data streams associated with the plurality of non-sequential communication channels in response to results of the data scrubbing indicating that there are no missing data elements. In addition, the mechanisms release the assembled plurality of data streams for access via the file system.

摘要翻译： 提供了用于以高持续数据速率处理流数据的机制。 这些机制通过多个非顺序通信信道接收多个数据元素，并以未组装的方式将多个数据元素直接写入数据处理系统的文件系统。 所述机构还执行数据擦除操作以确定是否存在写入所述文件系统的所述多个数据元素中不存在的丢失的数据元素，并将所述多个数据元素组合成与所述多个数据元素相关联的多个数据流 响应于指示没有丢失数据元素的数据擦除的结果的非顺序通信信道。 此外，这些机制释放组合的多个数据流以便经由文件系统访问。

公开(公告)号：US08302109B2

公开(公告)日：2012-10-30

申请号：US12391373

申请日：2009-02-24

申请人： Lakshminarayana Arimilli ,  Claude Basso ,  Piyush Chaudhary ,  Bernard C. Drerup ,  Jody B. Joyner ,  Jan-Bernd Themann ,  Christoph Raisch ,  Colin B. Verrilli

发明人： Lakshminarayana Arimilli ,  Claude Basso ,  Piyush Chaudhary ,  Bernard C. Drerup ,  Jody B. Joyner ,  Jan-Bernd Themann ,  Christoph Raisch ,  Colin B. Verrilli

IPC分类号： G06F3/03

CPC分类号： G06F9/545 ,  G06F9/546

摘要： A synchronization optimized queuing method and device to minimize software/hardware interaction in network interface hardware during an end-of-initiative process, including network adapter queue implementations for network interface hardware for optimized communication in a computer system. An end-of-initiative procedure to ensure that the network interface hardware has received an interrupt enable and to recheck the interrupt queue is unnecessary in the present invention.

摘要翻译： 一种同步优化的排队方法和设备，用于最大程度地减少网络接口硬件中的软件/硬件交互，包括用于计算机系统中优化通信的网络接口硬件的网络适配器队列实现。 在本发明中，确保网络接口硬件已经接收到中断使能并重新检查中断队列的最终主动性过程是不必要的。

公开(公告)号：US20100268755A1

公开(公告)日：2010-10-21

申请号：US12424852

申请日：2009-04-16

申请人： Ravi Kumar Arimilli ,  Piyush Chaudhary

发明人： Ravi Kumar Arimilli ,  Piyush Chaudhary

IPC分类号： G06F15/76 ,  G06F9/06 ,  G06F15/16 ,  G06F13/00

CPC分类号： H04L12/6418

摘要： Disclosed are a method, a system and a computer program product for dynamically allocating and/or de-allocating resources and/or partitions that provide I/O and/or active storage access services in a supercomputing system. The supercomputing system can include multiple compute nodes, high performance computing (HPC) switches coupled to the compute nodes, and active non-volatile storage devices coupled to the compute nodes. Each of the compute nodes can be configured to communicate with another compute node through at least one of the HPC switches. In one or more embodiments, each of at least two compute nodes includes a storage controller and is configured to dynamically allocate and de-allocate a storage controller partition to provide storage services to the supercomputing system, and each of at least two compute nodes includes an I/O controller and is configured to dynamically allocate and de-allocate an I/O controller partition to provide I/O services to the supercomputing system.

摘要翻译： 公开了一种用于在超级计算系统中动态分配和/或去分配提供I / O和/或主动存储访问服务的资源和/或分区的方法，系统和计算机程序产品。 超级计算系统可以包括多个计算节点，耦合到计算节点的高性能计算（HPC）交换机以及耦合到计算节点的主动非易失性存储设备。 可以将每个计算节点配置成通过至少一个HPC交换机与另一个计算节点进行通信。 在一个或多个实施例中，至少两个计算节点中的每一个包括存储控制器，并且被配置为动态分配和解除分配存储控制器分区以向超级计算系统提供存储服务，并且至少两个计算节点中的每一个包括 I / O控制器并配置为动态分配和分配I / O控制器分区，以向超级计算系统提供I / O服务。

公开(公告)号：US20100217905A1

公开(公告)日：2010-08-26

申请号：US12391373

申请日：2009-02-24

申请人： Lakshminarayana Arimilli ,  Claude Basso ,  Piyush Chaudhary ,  Benard C. Drerup ,  Jody B. Joyner ,  Jan-Bernd Themann ,  Christoph Raisch ,  Colin B. Verrilli

发明人： Lakshminarayana Arimilli ,  Claude Basso ,  Piyush Chaudhary ,  Benard C. Drerup ,  Jody B. Joyner ,  Jan-Bernd Themann ,  Christoph Raisch ,  Colin B. Verrilli

IPC分类号： G06F13/24 ,  G06F9/54

CPC分类号： G06F9/545 ,  G06F9/546

摘要： A synchronization optimized queuing method and device to minimize software/hardware interaction in network interface hardware during an end-of-initiative process, including network adapter queue implementations for network interface hardware for optimized communication in a computer system. An end-of-initiative procedure to ensure that the network interface hardware has received an interrupt enable and to recheck the interrupt queue is unnecessary in the present invention.

摘要翻译： 一种同步优化的排队方法和设备，用于最大程度地减少网络接口硬件中的软件/硬件交互，包括用于计算机系统中优化通信的网络接口硬件的网络适配器队列实现。 在本发明中，确保网络接口硬件已经接收到中断使能并重新检查中断队列的最终主动性过程是不必要的。

公开(公告)号：US20090198953A1

公开(公告)日：2009-08-06

申请号：US12024773

申请日：2008-02-01

申请人： Ravi K. Arimilli ,  Claude Basso ,  Jean L. Calvignac ,  Piyush Chaudhary ,  Edward J. Seminaro

发明人： Ravi K. Arimilli ,  Claude Basso ,  Jean L. Calvignac ,  Piyush Chaudhary ,  Edward J. Seminaro

IPC分类号： G06F12/10

CPC分类号： G06F12/10 ,  G06F12/1081 ,  H04L29/12018 ,  H04L61/10

摘要： An addressing model is provided where devices, including I/O devices, are addressed with internet protocol (IP) addresses, which are considered part of the virtual address space. A task, such as an application, may be assigned an effective address range, which corresponds to addresses in the virtual address space. The virtual address space is expanded to include Internet protocol addresses. Thus, the page frame tables are also modified to include entries for IP addresses and additional properties for devices and I/O. Thus, a processing element, such as an I/O adapter or even a printer, for example, may also be addressed using IP addresses without the need for library calls, device drivers, pinning memory, and so forth. This addressing model also provides full virtualization of resources across an IP interconnect, allowing a process to access an I/O device across a network.

摘要翻译： 提供了一种寻址模型，其中包括I / O设备在内的设备通过互联网协议（IP）地址进行寻址，这些地址被认为是虚拟地址空间的一部分。 可以为任务（例如应用程序）分配与虚拟地址空间中的地址对应的有效地址范围。 虚拟地址空间被扩展为包括互联网协议地址。 因此，页框表也被修改为包括用于设备和I / O的IP地址和附加属性的条目。 因此，例如，诸如I / O适配器或甚至打印机的处理元件也可以使用IP地址来寻址，而不需要库调用，设备驱动器，固定存储器等。 该寻址模型还可以跨IP互连提供资源的完全虚拟化，从而允许进程通过网络访问I / O设备。

公开(公告)号：US07478138B2

公开(公告)日：2009-01-13

申请号：US11017355

申请日：2004-12-20

申请人： Fu Chung Chang ,  Piyush Chaudhary ,  Jason E. Goscinski ,  John S. Houston ,  Steven J. Martin

发明人： Fu Chung Chang ,  Piyush Chaudhary ,  Jason E. Goscinski ,  John S. Houston ,  Steven J. Martin

IPC分类号： G06F13/14

CPC分类号： H04L69/16 ,  H04L69/166

摘要： In a multinode data processing system in which nodes exchange information over a network or through a switch, the mechanism which enables out-of-order data transfer via Remote Direct Memory Access (RDMA) also provides a corresponding ability to carry out broadcast operations, multicast operations, third party operations and conditional RDMA operations. In a broadcast operation a source node transfers data packets in RDMA fashion to a plurality of destination nodes. Multicast operation works similarly except that distribution is selective. In third party operations a single central node in a cluster or network manages the transfer of data in RDMA fashion between other nodes or creates a mechanism for allowing a directed distribution of data between nodes. In conditional operation mode the transfer of data is conditioned upon one or more events occurring in either the source node or in the destination node.

摘要翻译： 在节点通过网络交换信息或通过交换机交换信息的多节点数据处理系统中，通过远程直接存储器访问（RDMA）实现无序数据传输的机制也提供了相应的能力来执行广播操作，组播 操作，第三方操作和有条件的RDMA操作。 在广播操作中，源节点以RDMA方式将数据分组传送到多个目的节点。 组播操作的工作方式类似，除了分发是有选择性的。 在第三方操作中，集群或网络中的单个中央节点以RDMA方式在其他节点之间管理数据传输，或者创建一种允许在节点之间定向分发数据的机制。 在条件操作模式中，数据的传输是在源节点或目标节点中发生的一个或多个事件的条件。

公开(公告)号：US07430615B2

公开(公告)日：2008-09-30

申请号：US11017456

申请日：2004-12-20

申请人： Robert S. Blackmore ,  Piyush Chaudhary ,  Jason E. Goscinski ,  Leonard W. Helmer, Jr. ,  John S. Houston ,  Steven J. Martin

发明人： Robert S. Blackmore ,  Piyush Chaudhary ,  Jason E. Goscinski ,  Leonard W. Helmer, Jr. ,  John S. Houston ,  Steven J. Martin

IPC分类号： G06F15/16 ,  G06F17/00

CPC分类号： H04L67/1097 ,  H04L67/12 ,  H04L69/14 ,  H04L69/326

摘要： In remote direct memory access (RDMA) transfers in a multinode data processing system in which the nodes communicate with one another through communication adapters coupled to a switch or network, there is a need for the system to ensure efficient memory protection mechanisms across jobs. A method is thus desired for addressing virtual memory on local and remote servers that is independent of the process ID on the local and/or remote node. The use of global Translation Control Entry (TCE) tables that are accessed/owned by RDMA jobs and are managed by a device driver in conjunction with a Protocol Virtual Offset (PVO) address format solves this problem.

摘要翻译： 在多节点数据处理系统中的远程直接存储器访问（RDMA）传输中，其中节点通过耦合到交换机或网络的通信适配器彼此通信，所以系统需要确保跨作业的有效的存储器保护机制。 因此，需要一种方法来解决本地和远程服务器上与本地和/或远程节点上的进程ID无关的虚拟内存。 使用由RDMA作业访问/拥有并由设备驱动程序与协议虚拟偏移（PVO）地址格式一起管理的全局翻译控制条目（TCE）表解决了此问题。

公开(公告)号：US20060047771A1

公开(公告)日：2006-03-02

申请号：US11017456

申请日：2004-12-20

申请人： Robert Blackmore ,  Piyush Chaudhary ,  Jason Goscinski ,  Leonard Helmer ,  John Houston ,  Steven Martin

发明人： Robert Blackmore ,  Piyush Chaudhary ,  Jason Goscinski ,  Leonard Helmer ,  John Houston ,  Steven Martin

IPC分类号： G06F15/16

CPC分类号： H04L67/1097 ,  H04L67/12 ,  H04L69/14 ,  H04L69/326

摘要： In remote direct memory access (RDMA) transfers in a multinode data processing system in which the nodes communicate with one another through communication adapters coupled to a switch or network, there is a need for the system to ensure efficient memory protection mechanisms across jobs. A method is thus desired for addressing virtual memory on local and remote servers that is independent of the process ID on the local and/or remote node. The use of global Translation Control Entry (TCE) tables that are accessed/owned by RDMA jobs and are managed by a device driver in conjunction with a Protocol Virtual Offset (PVO) address format solves this problem.

摘要翻译： 在多节点数据处理系统中的远程直接存储器访问（RDMA）传输中，其中节点通过耦合到交换机或网络的通信适配器彼此通信，所以系统需要确保跨作业的有效的存储器保护机制。 因此，需要一种方法来解决本地和远程服务器上与本地和/或远程节点上的进程ID无关的虚拟内存。 使用由RDMA作业访问/拥有并由设备驱动程序与协议虚拟偏移（PVO）地址格式一起管理的全局翻译控制条目（TCE）表解决了此问题。