Invention Grant
US08510280B2 System, method, and computer-readable medium for dynamic detection and management of data skew in parallel join operations 有权
用于动态检测和管理并行连接操作中数据偏移的系统,方法和计算机可读介质

  • Patent Title: System, method, and computer-readable medium for dynamic detection and management of data skew in parallel join operations
  • Patent Title (中): 用于动态检测和管理并行连接操作中数据偏移的系统,方法和计算机可读介质
  • Application No.: US12494366
    Application Date: 2009-06-30
  • Publication No.: US08510280B2
    Publication Date: 2013-08-13
  • Inventor: Yu XuOlli Pekka KostamaaXin Zhou
  • Applicant: Yu XuOlli Pekka KostamaaXin Zhou
  • Applicant Address: US OH Dayton
  • Assignee: Teradata US, Inc.
  • Current Assignee: Teradata US, Inc.
  • Current Assignee Address: US OH Dayton
  • Agent Steve McDonald; Ramin Mahboubian
  • Main IPC: G06F17/00
  • IPC: G06F17/00
System, method, and computer-readable medium for dynamic detection and management of data skew in parallel join operations
Abstract:
A system, method, and computer-readable medium for dynamic detection and management of data skew in parallel join operations are provided. Rows allocated to processing modules involved in a join operation are redistributed among the processing modules by a hash redistribution of the join attributes. Receipt by a processing module of an excessive number of redistributed rows having a skewed value on the join attribute is detected by a processing module which notifies other processing modules of the skewed value. Processing modules then terminate redistribution of rows having a join attribute value matching the skewed value and either store such rows locally or duplicate the rows. The processing module that has received an excessive number of redistributed rows removes rows having a skewed value of the join attribute from a redistribution spool allocated thereto and duplicates the rows to each of the processing modules. The join operation is completed by performing a local join at each processing module and merging the results of the local join operations.
Information query
Patent Agency Ranking
0/0