Invention Grant
- Patent Title: Hash partitioning streamed data
- Patent Title (中): 哈希分区流数据
-
Application No.: US12642233Application Date: 2009-12-18
-
Publication No.: US08276154B2Publication Date: 2012-09-25
- Inventor: Stephen H. Toub , Igor Ostrovsky
- Applicant: Stephen H. Toub , Igor Ostrovsky
- Applicant Address: US WA Redmond
- Assignee: Microsoft Corporation
- Current Assignee: Microsoft Corporation
- Current Assignee Address: US WA Redmond
- Agency: Workman Nydegger
- Main IPC: G06F9/46
- IPC: G06F9/46

Abstract:
The present invention extends to methods, systems, and computer program products for partitioning streaming data. Embodiments of the invention can be used to hash partition a stream of data and thus avoids unnecessary memory usage (e.g., associated with buffering). Hash partitioning can be used to split an input sequence (e.g., a data stream) into multiple partitions that can be processed independently. Other embodiments of the invention can be used to hash repartition a plurality of streams of data. Hash repartitioning converts a set of partitions into another set of partitions with the hash partitioned property. Partitioning and repartitioning can be done in a streaming manner at runtime by exchanging values between worker threads responsible for different partitions.
Public/Granted literature
- US20110154359A1 HASH PARTITIONING STREAMED DATA Public/Granted day:2011-06-23
Information query