Invention Grant
- Patent Title: Scheduled network communication for efficient re-partitioning of data
-
Application No.: US14711617Application Date: 2015-05-13
-
Publication No.: US09813490B2Publication Date: 2017-11-07
- Inventor: Sam Idicula , Aarti Basant , Vikas Aggarwal , Stephan Wolf , Nipun Agarwal
- Applicant: Oracle International Corporation
- Applicant Address: US CA Redwood Shores
- Assignee: Oracle International Corporation
- Current Assignee: Oracle International Corporation
- Current Assignee Address: US CA Redwood Shores
- Agency: Hickman Palermo Becker Bingham LLP
- Main IPC: G06F15/16
- IPC: G06F15/16 ; H04L29/08 ; H04L12/40 ; G06F17/30 ; H04L12/911

Abstract:
A method, apparatus, and system for efficiently re-partitioning data using scheduled network communication are provided. Given re-partitioning data defining the data blocks to be sent amongst a plurality of server nodes, a corresponding network schedule is determined to send the data blocks in a coordinated manner. The network schedule is divided into time slots, wherein each of the plurality of server nodes can send up to one data block and receive up to one data block in each time slot. By using a greedy selection algorithm that prioritizes by largest senders and largest receivers, a near optimal schedule can be determined even in the presence of heavy skew. The greedy selection algorithm can be implemented with a O(T*N^2) time complexity, enabling scaling to large multi-node clusters with many server nodes. The network schedule is of particular interest for database execution plans requiring re-partitioning on operators with different keys.
Public/Granted literature
- US20160337442A1 SCHEDULED NETWORK COMMUNICATION FOR EFFICIENT RE-PARTITIONING OF DATA Public/Granted day:2016-11-17
Information query