公开(公告)号：US10754700B2

公开(公告)日：2020-08-25

申请号：US16353050

申请日：2019-03-14

Applicant: ORACLE INTERNATIONAL CORPORATION

Inventor： Jinsu Lee ,  Sungpack Hong ,  Siegfried Depner ,  Nicholas Roth ,  Thomas Manhardt ,  Hassan Chafi

IPC: G06F9/46 ,  G06F9/50 ,  G06F9/54

Abstract: Techniques herein provide job control and synchronization of distributed graph-processing jobs. In an embodiment, a computer system maintains an input queue of graph processing jobs. In response to de-queuing a graph processing job, a master thread partitions the graph processing job into distributed jobs. Each distributed job has a sequence of processing phases. The master thread sends each distributed job to a distributed processor. Each distributed job executes a first processing phase of its sequence of processing phases. To the master thread, the distributed job announces completion of its first processing phase. The master thread detects that all distributed jobs have announced finishing their first processing phase. The master thread broadcasts a notification to the distributed jobs that indicates that all distributed jobs have finished their first processing phase. Receiving that notification causes the distributed jobs to execute their second processing phase. Queues and barriers provide for faults and cancellation.

公开(公告)号：US10275287B2

公开(公告)日：2019-04-30

申请号：US15175920

申请日：2016-06-07

Applicant: Oracle International Corporation

Inventor： Thomas Manhardt ,  Sungpack Hong ,  Siegfried Depner ,  Jinsu Lee ,  Nicholas Roth ,  Hassan Chafi

IPC: G06F9/50 ,  H04L29/08 ,  G06F9/52

Abstract: Techniques are provided for dynamically self-balancing communication and computation. In an embodiment, each partition of application data is stored on a respective computer of a cluster. The application is divided into distributed jobs, each of which corresponds to a partition. Each distributed job is hosted on the computer that hosts the corresponding data partition. Each computer divides its distributed job into computation tasks. Each computer has a pool of threads that execute the computation tasks. During execution, one computer receives a data access request from another computer. The data access request is executed by a thread of the pool. Threads of the pool are bimodal and may be repurposed between communication and computation, depending on workload. Each computer individually detects completion of its computation tasks. Each computer informs a central computer that its distributed job has finished. The central computer detects when all distributed jobs of the application have terminated.

公开(公告)号：US20180210761A1

公开(公告)日：2018-07-26

申请号：US15413811

申请日：2017-01-24

Applicant: ORACLE INTERNATIONAL CORPORATION

Inventor： Jinsu Lee ,  Sungpack Hong ,  Siegfried Depner ,  Nicholas Roth ,  Thomas Manhardt ,  Hassan Chafi

IPC: G06F9/50 ,  G06F9/48

CPC classification number: G06F9/5066

Abstract: Techniques herein provide job control and synchronization of distributed graph-processing jobs. In an embodiment, a computer system maintains an input queue of graph processing jobs. In response to de-queuing a graph processing job, a master thread partitions the graph processing job into distributed jobs. Each distributed job has a sequence of processing phases. The master thread sends each distributed job to a distributed processor. Each distributed job executes a first processing phase of its sequence of processing phases. To the master thread, the distributed job announces completion of its first processing phase. The master thread detects that all distributed jobs have announced finishing their first processing phase. The master thread broadcasts a notification to the distributed jobs that indicates that all distributed jobs have finished their first processing phase. Receiving that notification causes the distributed jobs to execute their second processing phase. Queues and barriers provide for faults and cancellation.

公开(公告)号：US20230121198A1

公开(公告)日：2023-04-20

申请号：US18084406

申请日：2022-12-19

Applicant: Oracle International Corporation

Inventor： Petr Koupy ,  Thomas Manhardt ,  Siegfried Depner ,  Sungpack Hong ,  Hassan Chafi

IPC: G06F8/41 ,  G06F9/50 ,  G06F17/16 ,  G06F16/27 ,  G06F17/10 ,  G06F11/34

Abstract: Techniques herein minimally communicate between computers to repartition a graph. In embodiments, each computer receives a partition of edges and vertices of the graph. For each of its edges or vertices, each computer stores an intermediate representation into an edge table (ET) or vertex table. Different edges of a vertex may be loaded by different computers, which may cause a conflict. Each computer announces that a vertex resides on the computer to a respective tracking computer. Each tracking computer makes assignments of vertices to computers and publicizes those assignments. Each computer that loaded conflicted vertices transfers those vertices to computers of the respective assignments. Each computer stores a materialized representation of a partition based on: the ET and vertex table of the computer, and the vertices and edges that were transferred to the computer. Edges stored in the materialized representation are stored differently than edges stored in the ET.

公开(公告)号：US11561780B2

公开(公告)日：2023-01-24

申请号：US17069104

申请日：2020-10-13

Applicant: Oracle International Corporation

Inventor： Petr Koupy ,  Thomas Manhardt ,  Siegfried Depner ,  Sungpack Hong ,  Hassan Chafi

IPC: G06F16/00 ,  G06F8/41 ,  G06F9/50 ,  G06F17/16 ,  G06F16/27 ,  G06F17/10 ,  G06F11/34 ,  G06F3/06 ,  G06F11/10 ,  G06F16/901

Abstract: Techniques herein minimally communicate between computers to repartition a graph. In embodiments, each computer receives a partition of edges and vertices of the graph. For each of its edges or vertices, each computer stores an intermediate representation into an edge table (ET) or vertex table. Different edges of a vertex may be loaded by different computers, which may cause a conflict. Each computer announces that a vertex resides on the computer to a respective tracking computer. Each tracking computer makes assignments of vertices to computers and publicizes those assignments. Each computer that loaded conflicted vertices transfers those vertices to computers of the respective assignments. Each computer stores a materialized representation of a partition based on: the ET and vertex table of the computer, and the vertices and edges that were transferred to the computer. Edges stored in the materialized representation are stored differently than edges stored in the ET.

公开(公告)号：US10534657B2

公开(公告)日：2020-01-14

申请号：US15607985

申请日：2017-05-30

Applicant: Oracle International Corporation

Inventor： Siegfried Depner ,  Sungpack Hong ,  Thomas Manhardt ,  Jinsu Lee ,  Nicholas Roth ,  Hassan Chafi

IPC: G06F15/16 ,  G06F11/00

Abstract: Techniques minimize communication while loading a graph. In a distributed embodiment, each computer loads some edges of the graph. Each edge connects a source vertex (SV) to a destination vertex. For each SV of the edges, the computer hashes the SV to detect a tracking computer (TrC) that tracks on which computer does the SV reside. Each computer informs the TrC that the SV originates an edge that resides on that computer. For each SV, the TrC detects that the SV originates edges that reside on multiple providing computers (PCs). The TrC selects a target computer (TaC) from the multiple PCs to host the SV. The TrC instructs each PC, excluding the TaC, to transfer the SV and related edges that are connected to the SV to the TaC. A vertex's internal identifier indicates which computer hosts the vertex. The TrC maintains a mapping between external and internal identifiers.

公开(公告)号：US10318355B2

公开(公告)日：2019-06-11

申请号：US15413811

申请日：2017-01-24

Applicant: ORACLE INTERNATIONAL CORPORATION

Inventor： Jinsu Lee ,  Sungpack Hong ,  Siegfried Depner ,  Nicholas Roth ,  Thomas Manhardt ,  Hassan Chafi

IPC: G06F9/46 ,  G06F9/50 ,  G06F9/54

Abstract: Techniques herein provide job control and synchronization of distributed graph-processing jobs. In an embodiment, a computer system maintains an input queue of graph processing jobs. In response to de-queuing a graph processing job, a master thread partitions the graph processing job into distributed jobs. Each distributed job has a sequence of processing phases. The master thread sends each distributed job to a distributed processor. Each distributed job executes a first processing phase of its sequence of processing phases. To the master thread, the distributed job announces completion of its first processing phase. The master thread detects that all distributed jobs have announced finishing their first processing phase. The master thread broadcasts a notification to the distributed jobs that indicates that all distributed jobs have finished their first processing phase. Receiving that notification causes the distributed jobs to execute their second processing phase. Queues and barriers provide for faults and cancellation.

公开(公告)号：US20180352026A1

公开(公告)日：2018-12-06

申请号：US15607985

申请日：2017-05-30

Applicant: Oracle International Corporation

Inventor： Siegfried Depner ,  Sungpack Hong ,  Thomas Manhardt ,  Jinsu Lee ,  Nicholas Roth ,  Hassan Chafi

IPC: H04L29/08 ,  G06F9/38 ,  G06F3/00 ,  H04L9/06

Abstract: Techniques minimize communication while loading a graph. In a distributed embodiment, each computer loads some edges of the graph. Each edge connects a source vertex (SV) to a destination vertex. For each SV of the edges, the computer hashes the SV to detect a tracking computer (TrC) that tracks on which computer does the SV reside. Each computer informs the TrC that the SV originates an edge that resides on that computer. For each SV, the TrC detects that the SV originates edges that reside on multiple providing computers (PCs). The TrC selects a target computer (TaC) from the multiple PCs to host the SV. The TrC instructs each PC, excluding the TaC, to transfer the SV and related edges that are connected to the SV to the TaC. A vertex's internal identifier indicates which computer hosts the vertex. The TrC maintains a mapping between external and internal identifiers.

公开(公告)号：US09477532B1

公开(公告)日：2016-10-25

申请号：US14876075

申请日：2015-10-06

Applicant: Oracle International Corporation

Inventor： Sungpack Hong ,  Siegfried Depner ,  Thomas Manhardt ,  Hassan Chafi

IPC: G06F9/46 ,  G06F9/50 ,  G06F9/48

CPC classification number: G06F9/5083 ,  G06F9/4881 ,  G06F2209/5022

Abstract: Techniques herein perform workload-balanced graph partitioning. Each graph partition is distributed to a respective computer. Each computer applies a workload-estimation function to its partition to calculate a numeric workload-value that indicates how much computation the partition needs. Each computer sends its numeric workload-value to a master computer. The master compares the highest and lowest numeric workload-values. If the difference exceeds a threshold, the master detects how much work should overloaded-computers offload to under-utilized computers. To each overloaded-computer, the master sends a directive with a balancing numeric workload-value that indicates how much computation to offload and an identifier of an under-utilized computer to receive the offload. Based on this directive and the workload-estimation function, an overloaded-computer selects a portion of its partition that corresponds to the balancing numeric workload-value, removes that portion from its partition, and transfers the portion to the under-utilized computer, which adds the portion to its partition.

Abstract translation: 这里的技术执行工作负载平衡图分割。 每个图形分区都分配给相应的计算机。 每个计算机将其工作负载估计功能应用于其分区，以计算数字工作负载值，该值指示分区需要多少计算。 每个计算机将其数字工作负载值发送到主计算机。 主人比较最高和最低数值工作负载值。 如果差异超过阈值，则主机检测到应该超载多少工作 - 计算机卸载到未充分利用的计算机。 对于每台重载计算机，主机发送一个指令，其中包含一个平衡数字工作负载值，指示卸载多少计算和一个未充分利用的计算机的标识符来接收卸载。 基于该指令和工作负载估计功能，重载计算机选择其对应于平衡数字工作负载值的分区的一部分，从其分区中移除该部分，并将该部分传送到未充分利用的计算机，其中 将该部分添加到其分区。