- 专利标题: Distributed columnar data set retrieval
-
申请号: US17039314申请日: 2020-09-30
-
公开(公告)号: US11347686B2公开(公告)日: 2022-05-31
- 发明人: Brian Payton Bowman , Gordon Lyle Keener
- 申请人: SAS Institute Inc.
- 申请人地址: US NC Cary
- 专利权人: SAS Institute Inc.
- 当前专利权人: SAS Institute Inc.
- 当前专利权人地址: US NC Cary
- 代理机构: KDB Firm PLLC
- 主分类号: G06F16/13
- IPC分类号: G06F16/13 ; G06F9/50 ; G06F3/06 ; G06F21/60 ; G06F12/02 ; G06F16/27 ; G06F16/182 ; G06F16/22
摘要:
An apparatus includes a processor to: instantiate data buffers of a queue, reading threads, and provision threads; within each reading thread, use an identifier provided in a data buffer of the queue to retrieve the corresponding data set part and part metadata from storage device(s), and store both within the data buffer; operate the queue as a (FIFO) buffer; within each provision thread, retrieve a row group from among multiple row groups and corresponding metadata from within the data buffer, use information in the metadata to decompress at least one column, and provide the data values of the row group to the requesting device or an application routine; and in response to each instance of storage of a data set part within a data buffer of the queue, analyze the availability of storage space and/or of processing resources to determine whether to dynamically adjust the quantity of reading threads.
公开/授权文献
- US20210026805A1 DISTRIBUTED COLUMNAR DATA SET RETRIEVAL 公开/授权日:2021-01-28
信息查询