公开(公告)号：US08224800B2

公开(公告)日：2012-07-17

申请号：US13048015

申请日：2011-03-15

申请人： Jeremy Branscome ,  Michael Corwin ,  Liuxi Yang ,  Joseph I. Chamdani

发明人： Jeremy Branscome ,  Michael Corwin ,  Liuxi Yang ,  Joseph I. Chamdani

IPC分类号： G06F7/00 ,  G06F17/30

CPC分类号： G06F17/30442

摘要： Embodiments of the present invention provide a hardware accelerator that assists a host database system in processing its queries. The hardware accelerator comprises special purpose processing elements that are capable of receiving database query/operation tasks in the form of machine code database instructions, execute them in hardware without software, and return the query/operation result back to the host system. For example, table and column descriptors are embedded in the machine code database instructions. For ease of installation, the hardware accelerators employ a standard interconnect, such as a PCle or HT interconnect. The processing elements implement a novel dataflow design and Inter Macro-Op Communication (IMC) data structures to execute the machine code database instructions. The hardware accelerator may also comprise a relatively large memory to enhance the hardware execution of the query/operation tasks requested. The hardware accelerator utilizes hardware-friendly memory addressing, which allows for arithmetic derivation of a physical address from a global database virtual address simply based on a row identifier. The hardware accelerator minimizes memory reads/writes by keeping most intermediate results flowing through IMCs in pipelined and parallel fashion. Furthermore, the hardware accelerator may employ task pipelining and pre-fetch pipelining to enhance its performance.

公开(公告)号：US08229918B2

公开(公告)日：2012-07-24

申请号：US13048024

申请日：2011-03-15

申请人： Jeremy Branscome ,  Michael Corwin ,  Liuxi Yang ,  Joseph I. Chamdani

发明人： Jeremy Branscome ,  Michael Corwin ,  Liuxi Yang ,  Joseph I. Chamdani

IPC分类号： G06F7/00 ,  G06F17/30

CPC分类号： G06F17/30442

摘要： Embodiments of the present invention provide a hardware accelerator that assists a host database system in processing its queries. The hardware accelerator comprises special purpose processing elements that are capable of receiving database query/operation tasks in the form of machine code database instructions, execute them in hardware without software, and return the query/operation result back to the host system. For example, table and column descriptors are embedded in the machine code database instructions. For ease of installation, the hardware accelerators employ a standard interconnect, such as a PCle or HT interconnect. The processing elements implement a novel dataflow design and Inter Macro-Op Communication (IMC) data structures to execute the machine code database instructions. The hardware accelerator may also comprise a relatively large memory to enhance the hardware execution of the query/operation tasks requested. The hardware accelerator utilizes hardware-friendly memory addressing, which allows for arithmetic derivation of a physical address from a global database virtual address simply based on a row identifier. The hardware accelerator minimizes memory reads/writes by keeping most intermediate results flowing through IMCs in pipelined and parallel fashion. Furthermore, the hardware accelerator may employ task pipelining and pre-fetch pipelining to enhance its performance.

公开(公告)号：US20080189252A1

公开(公告)日：2008-08-07

申请号：US11895998

申请日：2007-08-27

申请人： Jeremy Branscome ,  Michael Corwin ,  Liuxi Yang ,  Joseph I. Chamdani

发明人： Jeremy Branscome ,  Michael Corwin ,  Liuxi Yang ,  Joseph I. Chamdani

IPC分类号： G06F17/30 ,  G06F13/00

CPC分类号： G06F17/30442

摘要： Embodiments of the present invention provide a hardware accelerator that assists a host database system in processing its queries. The hardware accelerator comprises special purpose processing elements that are capable of receiving database query/operation tasks in the form of machine code database instructions, execute them in hardware without software, and return the query/operation result back to the host system. For example, table and column descriptors are embedded in the machine code database instructions. For ease of installation, the hardware accelerators employ a standard interconnect, such as a PCIe or HT interconnect. The processing elements implement a novel dataflow design and Inter Macro-Op Communication (IMC) data structures to execute the machine code database instructions. The hardware accelerator may also comprise a relatively large memory to enhance the hardware execution of the query/operation tasks requested. The hardware accelerator utilizes hardware-friendly memory addressing, which allows for arithmetic derivation of a physical address from a global database virtual address simply based on a row identifier. The hardware accelerator minimizes memory reads/writes by keeping most intermediate results flowing through IMCs in pipelined and parallel fashion. Furthermore, the hardware accelerator may employ task pipelining and pre-fetch pipelining to enhance its performance.

摘要翻译： 本发明的实施例提供了一种辅助主机数据库系统处理其查询的硬件加速器。 硬件加速器包括能够以机器码数据库指令的形式接收数据库查询/操作任务的专用处理元件，无需软件执行硬件，并将查询/运算结果返回主机系统。 例如，表和列描述符嵌入在机器码数据库指令中。 为了便于安装，硬件加速器采用标准互连，例如PCIe或HT互连。 处理元件实现了一种新颖的数据流设计和Inter Macro-Op Communication（IMC）数据结构来执行机器码数据库指令。 硬件加速器还可以包括相对大的存储器，以增强所请求的查询/操作任务的硬件执行。 硬件加速器使用硬件友好的存储器寻址，这允许仅仅基于行标识符从全局数据库虚拟地址算术推导物理地址。 硬件加速器通过保持大多数中间结果以流水线和并行方式流过IMC来最小化存储器读/写。 此外，硬件加速器可以采用任务流水线和预取流水线来增强其性能。

公开(公告)号：US07908259B2

公开(公告)日：2011-03-15

申请号：US11895998

申请日：2007-08-27

申请人： Jeremy Branscome ,  Michael Corwin ,  Liuxi Yang ,  Joseph I. Chamdani

发明人： Jeremy Branscome ,  Michael Corwin ,  Liuxi Yang ,  Joseph I. Chamdani

IPC分类号： G06F7/00 ,  G06F17/30

CPC分类号： G06F17/30442

摘要： Embodiments of the present invention provide a hardware accelerator that assists a host database system in processing its queries. The hardware accelerator comprises special purpose processing elements that are capable of receiving database query/operation tasks in the form of machine code database instructions, execute them in hardware without software, and return the query/operation result back to the host system. For example, table and column descriptors are embedded in the machine code database instructions. For ease of installation, the hardware accelerators employ a standard interconnect, such as a PCIe or HT interconnect. The processing elements implement a novel dataflow design and Inter Macro-Op Communication (IMC) data structures to execute the machine code database instructions. The hardware accelerator may also comprise a relatively large memory to enhance the hardware execution of the query/operation tasks requested. The hardware accelerator utilizes hardware-friendly memory addressing, which allows for arithmetic derivation of a physical address from a global database virtual address simply based on a row identifier. The hardware accelerator minimizes memory reads/writes by keeping most intermediate results flowing through IMCs in pipelined and parallel fashion. Furthermore, the hardware accelerator may employ task pipelining and pre-fetch pipelining to enhance its performance.

摘要翻译： 本发明的实施例提供了一种辅助主机数据库系统处理其查询的硬件加速器。 硬件加速器包括能够以机器码数据库指令的形式接收数据库查询/操作任务的专用处理元件，无需软件执行硬件，并将查询/运算结果返回主机系统。 例如，表和列描述符嵌入在机器码数据库指令中。 为了便于安装，硬件加速器采用标准互连，例如PCIe或HT互连。 处理元件实现了一种新颖的数据流设计和Inter Macro-Op Communication（IMC）数据结构来执行机器码数据库指令。 硬件加速器还可以包括相对大的存储器，以增强所请求的查询/操作任务的硬件执行。 硬件加速器使用硬件友好的存储器寻址，这允许仅仅基于行标识符从全局数据库虚拟地址算术推导物理地址。 硬件加速器通过保持大多数中间结果以流水线和并行方式流过IMC来最小化存储器读/写。 此外，硬件加速器可以采用任务流水线和预取流水线来增强其性能。

公开(公告)号：US20100005077A1

公开(公告)日：2010-01-07

申请号：US12168821

申请日：2008-07-07

申请人： Ravi Krishnamurthy ,  Chi-Young Ku ,  James Shau ,  Chun Zhang ,  Kapil Surlaker ,  Jeremy Branscome ,  Michael Corwin ,  Joseph I. Chamdani

发明人： Ravi Krishnamurthy ,  Chi-Young Ku ,  James Shau ,  Chun Zhang ,  Kapil Surlaker ,  Jeremy Branscome ,  Michael Corwin ,  Joseph I. Chamdani

IPC分类号： G06F17/30

CPC分类号： G06F16/24542

摘要： Embodiments of the present invention generate and optimize query plans that are at least partially executable in hardware. Upon receiving a query, the query is rewritten and optimized with a bias for hardware execution of fragments of the query. A template-based algorithm may be employed for transforming a query into fragments and then into query tasks. The various query tasks can then be routed to either a hardware accelerator, a software module, or sent back to a database management system for execution. For those tasks routed to the hardware accelerator, the query tasks are compiled into machine code database instructions. In order to optimize query execution, query tasks may be broken into subtasks, rearranged based on available resources of the hardware, pipelined, or branched conditionally

摘要翻译： 本发明的实施例生成和优化在硬件中至少部分可执行的查询计划。 在接收到查询后，查询将被重写和优化，以便查询的片段的硬件执行偏差。 可以采用基于模板的算法将查询转换成片段，然后转换为查询任务。 然后可以将各种查询任务路由到硬件加速器，软件模块，或者发送回数据库管理系统以执行。 对于路由到硬件加速器的任务，将查询任务编译为机器码数据库指令。 为了优化查询执行，查询任务可能被分解为子任务，根据硬件的可用资源，流水线或有条件的分支进行重新排列

公开(公告)号：US20110099155A1

公开(公告)日：2011-04-28

申请号：US12984284

申请日：2011-01-04

申请人： James Shau ,  Krishnan Meiyyappan ,  Hung Tran ,  Ravi Krishnamurthy ,  Kapil Surlaker ,  Jeremy Branscome ,  Joseph I. Chamdani

发明人： James Shau ,  Krishnan Meiyyappan ,  Hung Tran ,  Ravi Krishnamurthy ,  Kapil Surlaker ,  Jeremy Branscome ,  Joseph I. Chamdani

IPC分类号： G06F17/30

CPC分类号： G06F17/30595

摘要： Embodiments of the present invention provide for batch and incremental loading of data into a database. In the present invention, the loader infrastructure utilizes machine code database instructions and hardware acceleration to parallelize the load operations with the I/O operations. A large, hardware accelerator memory is used as staging cache for the load process. The load process also comprises an index profiling phase that enables balanced partitioning of the created indexes to allow for pipelined load. The online incremental loading process may also be performed while serving queries.

摘要翻译： 本发明的实施例提供数据批量和增量加载到数据库中。 在本发明中，装载机基础设施利用机器码数据库指令和硬件加速来将加载操作与I / O操作并行化。 大型的硬件加速器内存用作加载进程的分段缓存。 加载过程还包括一个索引分析阶段，可以对所创建的索引进行平衡分区，以允许流水线负载。 在提供查询时也可以执行在线增量加载过程。

公开(公告)号：US08458129B2

公开(公告)日：2013-06-04

申请号：US12144486

申请日：2008-06-23

申请人： Kapil Surlaker ,  Ravi Krishnamurthy ,  Krishnan Meiyyappan ,  Alan Beck ,  Hung Tran ,  Jeremy Branscome ,  Joseph I. Chamdani

发明人： Kapil Surlaker ,  Ravi Krishnamurthy ,  Krishnan Meiyyappan ,  Alan Beck ,  Hung Tran ,  Jeremy Branscome ,  Joseph I. Chamdani

IPC分类号： G06F7/00

CPC分类号： G06F17/30356 ,  G06F17/30551

摘要： Embodiments of the present invention provide fine grain concurrency control for transactions in the presence of database updates. During operations, each transaction is assigned a snapshot version number or SVN. A SVN refers to a historical snapshot of the database that can be created periodically or on demand. Transactions are thus tied to a particular SVN, such as, when the transaction was created. Queries belonging to the transactions can access data that is consistent as of a point in time, for example, corresponding to the latest SVN when the transaction was created. At various times, data from the database stored in a memory can be updated using the snapshot data corresponding to a SVN. When a transaction is committed, a snapshot of the database with a new SVN is created based on the data modified by the transaction and the snapshot is synchronized to the memory. When a transaction query requires data from a version of the database corresponding to a SVN, the data in the memory may be synchronized with the snapshot data corresponding to that SVN.

摘要翻译： 在存在数据库更新的情况下，本发明的实施例为事务提供细粒度并行性控制。 在操作期间，为每个事务分配一个快照版本号或SVN。 SVN是指可以定期或按需创建的数据库的历史快照。 因此，事务与特定的SVN相关联，例如，当事务被创建时。 属于事务的查询可以访问一个时间点一致的数据，例如对应于创建事务时的最新SVN。 在不同时间，可以使用对应于SVN的快照数据来更新存储在存储器中的数据库的数据。 提交事务时，将根据事务修改的数据创建具有新SVN的数据库快照，并将快照与内存同步。 当事务查询需要来自与SVN对应的数据库的版本的数据时，存储器中的数据可以与对应于该SVN的快照数据同步。

公开(公告)号：US20090319550A1

公开(公告)日：2009-12-24

申请号：US12144303

申请日：2008-06-23

申请人： James Shau ,  Krishnan Meiyyappan ,  Hung Tran ,  Ravi Krishnamurthy ,  Kapil Surlaker ,  Jeremy Branscome ,  Joseph I. Chamdani

发明人： James Shau ,  Krishnan Meiyyappan ,  Hung Tran ,  Ravi Krishnamurthy ,  Kapil Surlaker ,  Jeremy Branscome ,  Joseph I. Chamdani

IPC分类号： G06F17/30

CPC分类号： G06F17/30595

摘要： Embodiments of the present invention provide for batch and incremental loading of data into a database. In the present invention, the loader infrastructure utilizes machine code database instructions and hardware acceleration to parallelize the load operations with the I/O operations. A large, hardware accelerator memory is used as staging cache for the load process. The load process also comprises an index profiling phase that enables balanced partitioning of the created indexes to allow for pipelined load. The online incremental loading process may also be performed while serving queries.

摘要翻译： 本发明的实施例提供数据批量和增量加载到数据库中。 在本发明中，装载机基础设施利用机器码数据库指令和硬件加速来将加载操作与I / O操作并行化。 大型的硬件加速器内存用作加载进程的分段缓存。 加载过程还包括一个索引分析阶段，可以对所创建的索引进行平衡分区，以允许流水线负载。 在提供查询时也可以执行在线增量加载过程。

公开(公告)号：US08165988B2

公开(公告)日：2012-04-24

申请号：US12984284

申请日：2011-01-04

申请人： James Shau ,  Krishnan Meiyyappan ,  Hung Tran ,  Ravi Krishnamurthy ,  Kapil Surlaker ,  Jeremy Branscome ,  Joseph I. Chamdani

发明人： James Shau ,  Krishnan Meiyyappan ,  Hung Tran ,  Ravi Krishnamurthy ,  Kapil Surlaker ,  Jeremy Branscome ,  Joseph I. Chamdani

IPC分类号： G06F17/30

CPC分类号： G06F17/30595

摘要： Embodiments of the present invention provide for batch and incremental loading of data into a database. In the present invention, the loader infrastructure utilizes machine code database instructions and hardware acceleration to parallelize the load operations with the I/O operations. A large, hardware accelerator memory is used as staging cache for the load process. The load process also comprises an index profiling phase that enables balanced partitioning of the created indexes to allow for pipelined load. The online incremental loading process may also be performed while serving queries.

摘要翻译： 本发明的实施例提供数据批量和增量加载到数据库中。 在本发明中，装载机基础设施利用机器码数据库指令和硬件加速来将加载操作与I / O操作并行化。 大型的硬件加速器内存用作加载进程的分段缓存。 加载过程还包括一个索引分析阶段，可以对所创建的索引进行平衡分区，以允许流水线负载。 在提供查询时也可以执行在线增量加载过程。

公开(公告)号：US09424315B2

公开(公告)日：2016-08-23

申请号：US12099076

申请日：2008-04-07

申请人： Joseph I. Chamdani ,  Alan Beck ,  Hareesh Boinepelli ,  Jim Crowley ,  Ravi Krishnamurthy ,  Jeremy Branscome

发明人： Joseph I. Chamdani ,  Alan Beck ,  Hareesh Boinepelli ,  Jim Crowley ,  Ravi Krishnamurthy ,  Jeremy Branscome

IPC分类号： G06F17/30 ,  G06F9/48

CPC分类号： G06F17/30477 ,  G06F9/4881 ,  G06F17/30474 ,  G06F2209/484

摘要： Embodiments of the present invention provide a run-time scheduler that schedules tasks for database queries on one or more execution resources in a dataflow fashion. In some embodiments, the run-time scheduler may comprise a task manager, a memory manager, and hardware resource manager. When a query is received by a host database management system, a query plan is created for that query. The query plan splits a query into various fragments. These fragments are further compiled into a directed acyclic graph of tasks. Unlike conventional scheduling, the dependency arc in the directed acyclic graph is based on page resources. Tasks may comprise machine code that may be executed by hardware to perform portions of the query. These tasks may also be performed in software or relate to I/O.

摘要翻译： 本发明的实施例提供一种运行时间调度器，其以数据流的方式调度对一个或多个执行资源的数据库查询的任务。 在一些实施例中，运行时调度器可以包括任务管理器，存储器管理器和硬件资源管理器。 当主机数据库管理系统接收到查询时，将为该查询创建一个查询计划。 查询计划将查询分割成各种片段。 这些片段进一步编译成任务的有向非循环图。 与常规调度不同，有向非循环图中的依赖弧基于页面资源。 任务可以包括可由硬件执行以执行查询的部分的机器代码。 这些任务也可以用软件执行或与I / O相关。