公开(公告)号：US20120259889A1

公开(公告)日：2012-10-11

申请号：US13528064

申请日：2012-06-20

申请人： Darpan Dinker ,  Andrew David Eckhardt ,  Darryl Manabu Ouye ,  Brian Walter O'Krafka ,  Earl T. Cohen ,  Thomas M. McWilliams

发明人： Darpan Dinker ,  Andrew David Eckhardt ,  Darryl Manabu Ouye ,  Brian Walter O'Krafka ,  Earl T. Cohen ,  Thomas M. McWilliams

IPC分类号： G06F17/30

CPC分类号： G06F12/0842 ,  G06F12/0866 ,  G06F17/30575 ,  G06F2212/2022 ,  Y02D10/13

摘要： A distributed database system has multiple compute nodes each running an instance of a database management system (DBMS) program that accesses database records in a local buffer cache. Records are persistently stored in distributed flash memory on multiple storage nodes. A Sharing Data Fabric (SDF) is a middleware layer between the DBMS programs and the storage nodes and has API functions called by the DBMS programs when a requested record is not present in the local buffer cache. The SDF fetches the requested record from flash memory and loads a copy into the local buffer cache. The SDF has threads on a home storage node that locate database records using a node map. A global cache directory locks and pins records to local buffer caches for updating by a node's DBMS program. DBMS operations are grouped into transactions that are committed or aborted together as a unit.

摘要翻译： 分布式数据库系统具有多个计算节点，每个运行节点都运行数据库管理系统（DBMS）程序的实例，该程序访问本地缓冲区高速缓存中的数据库记录。 记录永久存储在多个存储节点上的分布式闪存中。 共享数据结构（SDF）是DBMS程序和存储节点之间的中间件层，当本地缓冲区高速缓存中不存在所请求的记录时，具有由DBMS程序调用的API函数。 SDF从闪存中提取所请求的记录，并将副本加载到本地缓冲区高速缓存中。 SDF在家用存储节点上具有使用节点映射定位数据库记录的线程。 全局缓存目录锁定和引导记录到本地缓冲区高速缓存，以便由节点的DBMS程序进行更新。 DBMS操作被分组为作为一个单元一起提交或中止的事务。

公开(公告)号：US08229945B2

公开(公告)日：2012-07-24

申请号：US12276540

申请日：2008-11-24

申请人： Darpan Dinker ,  Andrew David Eckhardt ,  Darryl Manabu Ouye ,  Brian Walter O'Krafka ,  Earl T. Cohen ,  Thomas M. McWilliams

发明人： Darpan Dinker ,  Andrew David Eckhardt ,  Darryl Manabu Ouye ,  Brian Walter O'Krafka ,  Earl T. Cohen ,  Thomas M. McWilliams

IPC分类号： G06F7/00 ,  G06F17/30

CPC分类号： G06F12/0842 ,  G06F12/0866 ,  G06F17/30575 ,  G06F2212/2022 ,  Y02D10/13

摘要： A distributed database system has multiple compute nodes each running an instance of a database management system (DBMS) program that accesses database records in a local buffer cache. Records are persistently stored in distributed flash memory on multiple storage nodes. A Sharing Data Fabric (SDF) is a middleware layer between the DBMS programs and the storage nodes and has API functions called by the DBMS programs when a requested record is not present in the local buffer cache. The SDF fetches the requested record from flash memory and loads a copy into the local buffer cache. The SDF has threads on a home storage node that locate database records using a node map. A global cache directory locks and pins records to local buffer caches for updating by a node's DBMS program. DBMS operations are grouped into transactions that are committed or aborted together as a unit.

摘要翻译： 分布式数据库系统具有多个计算节点，每个运行节点都运行数据库管理系统（DBMS）程序的实例，该程序访问本地缓冲区高速缓存中的数据库记录。 记录永久存储在多个存储节点上的分布式闪存中。 共享数据结构（SDF）是DBMS程序和存储节点之间的中间件层，当本地缓冲区高速缓存中不存在所请求的记录时，具有由DBMS程序调用的API函数。 SDF从闪存中提取所请求的记录，并将副本加载到本地缓冲区高速缓存中。 SDF在家用存储节点上具有使用节点映射定位数据库记录的线程。 全局缓存目录锁定和引导记录到本地缓冲区高速缓存，以便由节点的DBMS程序进行更新。 DBMS操作被分组为作为一个单元一起提交或中止的事务。

公开(公告)号：US08005979B2

公开(公告)日：2011-08-23

申请号：US10281543

申请日：2002-10-28

申请人： Darpan Dinker ,  Pramod Gopinath ,  Mahesh Kannan

发明人： Darpan Dinker ,  Pramod Gopinath ,  Mahesh Kannan

IPC分类号： G06F15/173 ,  G06F9/46

CPC分类号： H04L29/12207 ,  H04L29/12009 ,  H04L29/12783 ,  H04L61/20 ,  H04L61/35 ,  H04L67/42

摘要： Entities within a cluster are uniquely identified with a node ID and an engine ID. The node ID uniquely identifies a node within a cluster of nodes and the engine ID uniquely identifies one of several engines included in the node. Entities may be further identified with a cluster ID, an engine type ID, and/or a virtual server ID. At least some of these IDs may be included in communications received from clients and used to route the communications to the cluster entity identified by the included IDs.

摘要翻译： 集群内的实体使用节点ID和引擎ID进行唯一标识。 节点ID唯一地标识节点簇内的节点，并且引擎ID唯一地标识节点中包括的几个引擎之一。 可以使用集群ID，引擎类型ID和/或虚拟服务器ID进一步识别实体。 这些ID中的至少一些可以包括在从客户端接收的通信中，并用于将通信路由到由所包括的ID标识的集群实体。

公开(公告)号：US08001142B2

公开(公告)日：2011-08-16

申请号：US10405760

申请日：2003-04-02

申请人： Pramod Gopinath ,  Darpan Dinker ,  Mahesh Kannan ,  Suveen R. Nadipalli

发明人： Pramod Gopinath ,  Darpan Dinker ,  Mahesh Kannan ,  Suveen R. Nadipalli

IPC分类号： G06F17/30 ,  G06F7/00

CPC分类号： G06F17/30575

摘要： A system may include a client and a distributed data manager coupled to the client. The distributed data manager may include a data store storing a data object that includes several sub-elements. The client is configured to update a portion of the data object by sending a message to the distributed data manager. The message specifies one of the sub-elements of the data object to be updated and includes a new value of that sub-element but does not include a new value of the entire data object. The distributed data manager is configured to perform updates to the data object in the data store dependent on which of the sub-elements of the data object are specified by the client.

摘要翻译： 系统可以包括耦合到客户端的客户端和分布式数据管理器。 分布式数据管理器可以包括存储包括几个子元素的数据对象的数据存储。 客户端被配置为通过向分布式数据管理器发送消息来更新数据对象的一部分。 消息指定要更新的数据对象的一个​​子元素，并包含该子元素的新值，但不包括整个数据对象的新值。 分布式数据管理器被配置为根据数据对象的哪些子元素由客户端指定来执行对数据存储器中的数据对象的更新。

公开(公告)号：US20090240664A1

公开(公告)日：2009-09-24

申请号：US12276540

申请日：2008-11-24

申请人： Darpan Dinker ,  Andrew David Eckhardt ,  Darryl Manabu Ouye ,  Brian Walter O'Krafka ,  Earl T. Cohen ,  Thomas M. McWilliams

发明人： Darpan Dinker ,  Andrew David Eckhardt ,  Darryl Manabu Ouye ,  Brian Walter O'Krafka ,  Earl T. Cohen ,  Thomas M. McWilliams

IPC分类号： G06F7/06 ,  G06F17/30

CPC分类号： G06F12/0842 ,  G06F12/0866 ,  G06F17/30575 ,  G06F2212/2022 ,  Y02D10/13

摘要： A distributed database system has multiple compute nodes each running an instance of a database management system (DBMS) program that accesses database records in a local buffer cache. Records are persistently stored in distributed flash memory on multiple storage nodes. A Sharing Data Fabric (SDF) is a middleware layer between the DBMS programs and the storage nodes and has API functions called by the DBMS programs when a requested record is not present in the local buffer cache. The SDF fetches the requested record from flash memory and loads a copy into the local buffer cache. The SDF has threads on a home storage node that locate database records using a node map. A global cache directory locks and pins records to local buffer caches for updating by a node's DBMS program. DBMS operations are grouped into transactions that are committed or aborted together as a unit.

摘要翻译： 分布式数据库系统具有多个计算节点，每个运行节点都运行数据库管理系统（DBMS）程序的实例，该程序访问本地缓冲区高速缓存中的数据库记录。 记录永久存储在多个存储节点上的分布式闪存中。 共享数据结构（SDF）是DBMS程序和存储节点之间的中间件层，当本地缓冲区高速缓存中不存在所请求的记录时，具有由DBMS程序调用的API函数。 SDF从闪存中提取所请求的记录，并将副本加载到本地缓冲区高速缓存中。 SDF在家用存储节点上具有使用节点映射定位数据库记录的线程。 全局缓存目录锁定和引导记录到本地缓冲区高速缓存，以便由节点的DBMS程序进行更新。 DBMS操作被分组为作为一个单元一起提交或中止的事务。

公开(公告)号：US07139925B2

公开(公告)日：2006-11-21

申请号：US10134782

申请日：2002-04-29

申请人： Darpan Dinker ,  Mahesh Kannan ,  Pramod Gopinath

发明人： Darpan Dinker ,  Mahesh Kannan ,  Pramod Gopinath

IPC分类号： G06F11/00

CPC分类号： H04L67/1034 ,  H04L41/12 ,  H04L45/02 ,  H04L45/22 ,  H04L45/28 ,  H04L45/46 ,  H04L67/1002

摘要： A distributed system provides for separate management of dynamic cluster membership and distributed data. Nodes of the distributed system may include a state manager and a topology manager. A state manager handles data access from the cluster. A topology manager handles changes to the dynamic cluster topology. The topology manager enables operation of the state manager by handling topology changes, such as new nodes to join the cluster and node members to exit the cluster. A topology manager may follow a static topology description when handling cluster topology changes. Data replication and recovery functions may be implemented, for example to provide high availability.

公开(公告)号：US07035858B2

公开(公告)日：2006-04-25

申请号：US10134961

申请日：2002-04-29

申请人： Darpan Dinker ,  Mahesh Kannan ,  Pramod Gopinath

发明人： Darpan Dinker ,  Mahesh Kannan ,  Pramod Gopinath

IPC分类号： G06F17/30

CPC分类号： H04L41/12 ,  G06F17/30575 ,  H04L41/0681 ,  H04L41/0893 ,  H04L43/0811 ,  H04L67/1097 ,  Y10S707/99945

摘要： A distributed system provides for separate management of dynamic cluster membership and distributed data. Nodes of the distributed system may include a state manager and a topology manager. A state manager handles data access from the cluster. A topology manager handles changes to the dynamic cluster topology. The topology manager enables operation of the state manager by handling topology changes, such as new nodes to join the cluster and node members to exit the cluster. A topology manager may follow a static topology description when handling cluster topology changes. Data replication and recovery functions may be implemented, for example to provide high availability.

公开(公告)号：US09135064B2

公开(公告)日：2015-09-15

申请号：US13413814

申请日：2012-03-07

申请人： Darpan Dinker

发明人： Darpan Dinker

IPC分类号： G06F9/46 ,  G06F9/50 ,  G06F9/48

CPC分类号： G06F9/50 ,  G06F9/4881 ,  G06F9/5011 ,  G06F2209/504 ,  Y02D10/22

摘要： Approaches for throttling backgrounds processes to a high degree of precision. The utilization of a shared resource that is used by one or more background processes is monitored. A frequency at which the one or more background processes are executed is dynamically adjusted based on the current utilization of the shared resource without adjusting the frequency in which one or more foreground processes are executed to ensure that the utilization of the shared resource does not exceed a threshold value. The monitoring of the utilization of the shared resource may be performed more often than the adjusted of the frequency at which the background processes are executed, and the utilization of the shared resources may be performed many times a second. Consequently, the utilization of the shared resource may be above a certain level (such as 65%) and less than another level, such as 90%, when background processes are executing.

摘要翻译： 节流背景的方法要高度精确。 监视由一个或多个后台进程使用的共享资源的利用。 基于共享资源的当前利用率来动态地调整执行一个或多个后台进程的频率，而不调整执行一个或多个前台进程的频率，以确保共享资源的利用不超过 阈值。 共享资源的利用率的监视可以比经过后台处理的频率的调整更频繁地进行，并且可以每秒多次执行共享资源的利用。 因此，当后台进程正在执行时，共享资源的利用可能高于一定水平（例如65％）并小于另一个级别，例如90％。

公开(公告)号：US09047351B2

公开(公告)日：2015-06-02

申请号：US13084502

申请日：2011-04-11

申请人： Thomas A. Riddle ,  Darpan Dinker ,  Andrew D. Eckhardt ,  Michael J. Koster

发明人： Thomas A. Riddle ,  Darpan Dinker ,  Andrew D. Eckhardt ,  Michael J. Koster

IPC分类号： G06F17/30

CPC分类号： G06F17/30557 ,  G06F17/30519

摘要： Approaches for a distributed storage system that comprises a plurality of nodes. Each node, of the plurality of nodes, executes one or more application processes which are capable of accessing persistent shared memory. The persistent shared memory is implemented by solid state devices physically maintained on each of the plurality of nodes. Each the one or more application processes, maintained on a particular node, of the plurality of nodes, communicates with a shared data fabric (SDF) to access the persistent shared memory. The persistent shared memory comprises a scoreboard implemented in shared DRAM memory that is mapped to a persistent storage. The scoreboard provides a crash tolerant mechanism for enabling application processes to communicate with the shared data fabric (SDF).

摘要翻译： 包括多个节点的分布式存储系统的方法。 多个节点中的每个节点执行能够访问持久共享存储器的一个或多个应用进程。 永久共享存储器由物理上保持在多个节点中的每个节点上的固态设备来实现。 维护在多个节点的特定节点上的每一个应用进程与共享数据结构（SDF）进行通信以访问持久共享存储器。 永久共享存储器包括被映射到持久存储器的共享DRAM存储器中实现的记分板。 记分板提供容错机制，使应用程序进程能够与共享数据结构（SDF）进行通信。

公开(公告)号：US08700842B2

公开(公告)日：2014-04-15

申请号：US12983762

申请日：2011-01-03

申请人： Darpan Dinker

发明人： Darpan Dinker

IPC分类号： G06F12/00

CPC分类号： G06F3/067 ,  G06F3/0613 ,  G06F3/0667 ,  G06F3/0679 ,  G06F3/0685 ,  G06F11/1446 ,  G06F11/1474 ,  G06F11/2023 ,  G06F11/2071 ,  G06F11/2082 ,  G06F12/08 ,  G06F17/30345 ,  G06F17/30519

摘要： Approaches for minimizing the amount of write transactions issued to an object store maintained on a solid state device (SSD). Transactions requested against an object store maintained on a SSD may be committed once transaction information for the transaction is durably stored in a non-volatile dynamic random access memory (DRAM), which may be maintained in a HDD controller. Further, data blocks stored in a volatile cache of a database server that issues write requests to an object store maintained on one or more SSDs may be considered persistent stored once confirmation is received that the data blocks are written to a double-write buffer stored on a non-volatile medium, such as NV RAM in a HDD controller. Additionally, any data blocks that are to be written over in a non-volatile DRAM are first ensured to be no longer present within the volatile write cache maintained a the solid state device.

摘要翻译： 用于最小化发送到固态设备（SSD）上的对象商店的写入事务量的方法。 对于保存在SSD上的对象商店所请求的交易，一旦事务的交易信息被持久地存储在可以在HDD控制器中维护的非易失性动态随机存取存储器（DRAM）中，则可能会被提交。 此外，存储在数据库服务器的易失性高速缓存中的数据块，其向在一个或多个SSD上保存的对象存储区发出写入请求的数据块可以被认为是一旦接收到确认被写入存储在双写缓冲器上的数据块就被持久存储 非易失性介质，例如HDD控制器中的NV RAM。 此外，首先确保在非易失性DRAM中写入的任何数据块不再存在于保持固态设备的易失性写入高速缓存中。