Efficient processing of data extents

    公开(公告)号:US10776354B2

    公开(公告)日:2020-09-15

    申请号:US15833244

    申请日:2017-12-06

    摘要: The present disclosure relates to a computer-implemented method, computer program product, and computer system, for optimization of query processing a set of data extents on which a table is stored. Attribute value information may be maintained for each data extent. The attribute value information indicate as ranges the minimum and maximum values of an attribute of the entries stored in the respective extent. A first metric of a first data extent of the set may determine splitting the first data extent into sub-extents increases query processing efficiency. A second metric of a second data extent and a third data extent may determine merging the second data extent and the third data extent increases query processing efficiency.

    Joining two data tables on a join attribute

    公开(公告)号:US10380112B2

    公开(公告)日:2019-08-13

    申请号:US15663896

    申请日:2017-07-31

    IPC分类号: G06F16/00 G06F16/2453

    摘要: The present disclosure relates to a computer-implemented method for joining two data tables on a join attribute. The data tables have at least a first and a second attribute. The second attribute is the join attribute. The method includes providing a function for associating a computing node to a given record. The function may be used to determine the associated computing node. The records of the two data tables may be distributed to the respective determined computing nodes. The relationship between the values of the first and second attributes may be modelled using a predefined dataset. For each record of the two data tables the values of the first attribute may be re-determined using the corresponding values of the second attribute. The function may be used to re-determine the associated computing node.

    Providing multidimensional attribute value information

    公开(公告)号:US10360240B2

    公开(公告)日:2019-07-23

    申请号:US15230509

    申请日:2016-08-08

    IPC分类号: G06F17/30 G06F16/28

    摘要: The invention relates to a method, computer program product and computer system for providing attribute value information for a data extent comprising a set of data entries. For each multidimensional reference point of a set of one or more multidimensional reference points the method comprises: calculating for each multidimensional data entry a reference-point-specific distance between the respective multidimensional data entry and the multidimensional reference point resulting in a set of reference-point-specific distances for the data extent, the respective reference-point-specific distance being calculated using a combination of the attribute values of the multidimensional data entry and a combination of the reference attribute values of the respective multidimensional reference point; determining a minimum reference-point-specific distance and a maximum reference-point-specific distance of the set of reference-point-specific distances; storing for the data extent as attribute value information for further use with query processing the minimum reference-point-specific distance and maximum reference-point-specific distance.

    Selectivity estimation for query execution planning in a database

    公开(公告)号:US10162860B2

    公开(公告)日:2018-12-25

    申请号:US14517964

    申请日:2014-10-20

    IPC分类号: G06F17/30

    摘要: A computer-implemented method of estimating selectivity of a query may include generating, for data stored in a database in a memory, a one-dimensional value distribution for each of a plurality of attributes of the data. A multidimensional histogram may be generated, wherein the multidimensional histogram includes the one-dimensional value distributions for the plurality of attributes of the data. The multidimensional histogram may be converted to a one-dimensional histogram by assigning each bucket of the multidimensional histogram to corresponding buckets of the one-dimensional histogram and ordering the corresponding buckets according to a space-filling curve. One or more bucket ranges of the one-dimensional histogram may be determined by mapping the query conditions on the one-dimensional histogram. The selectivity of the query may be estimated by estimating how many data values in the one or more bucket ranges will meet the query conditions.

    Approximate string matching optimization for a database

    公开(公告)号:US10095808B2

    公开(公告)日:2018-10-09

    申请号:US15494874

    申请日:2017-04-24

    IPC分类号: G06F17/30

    摘要: Software for processing a database query that includes: (i) receiving a query of a database including a search value; (ii) determining a distance between the search value and at least one reference value; (iii) determining a maximum distance from the search value to be used in searching a plurality of datasets of the database, wherein the maximum distance from the search value defines a search range and is based, at least in part, on the determined distance between the search value and the at least one reference value; (iv) determining a subset of datasets from the plurality of datasets that includes datasets for which a data range with respect to each reference value overlaps with the search range; and (v) performing approximate string matching for the search value on the subset of datasets.

    Attribute value information for a data extent

    公开(公告)号:US10713254B2

    公开(公告)日:2020-07-14

    申请号:US15697614

    申请日:2017-09-07

    摘要: The invention relates to a method, computer program product and computer system for providing attribute value information for a data extent having a set of data entries. The method includes: determining a reference string value of a data-extent-specific reference point based on symbol frequencies at each sequence position of attribute string values in a subset of the set of data entries; calculating a distance between each of the attribute string values in the subset and the reference string value of the data-extent-specific reference point resulting in a set of distances; determining for each of the attribute string values an attribute-string-value-specific minimum distance for any reference string value of the data-extent-specific reference point resulting in a set of attribute-string-value-specific minimum distances for the set of data entries; storing for the data extent the minimum distance and the maximum distance of the set of attribute-string-value-specific minimum distances as attribute value information.

    Method for processing a database query

    公开(公告)号:US10698912B2

    公开(公告)日:2020-06-30

    申请号:US15941377

    申请日:2018-03-30

    摘要: The invention relates to a computer-implemented method for processing a query in a database, the query comprising a search value. The database comprises a plurality of datasets the datasets comprising entries, wherein distance statistics are assigned to the datasets. The distance statistics describe the minimum and maximum distance between the values of the entries of a dataset of the plurality of datasets and a reference value. The method comprises determining the distance between the search value and the reference value, said determination resulting in a search distance, determining a subset of datasets from the plurality of datasets for which the search distance is within the limits given by the minimum and maximum distances described by the respective distance statistics, and searching for the search value in the subset of datasets.

    METHOD FOR PROCESSING A DATABASE QUERY
    10.
    发明申请

    公开(公告)号:US20180225338A1

    公开(公告)日:2018-08-09

    申请号:US15941377

    申请日:2018-03-30

    IPC分类号: G06F17/30

    摘要: The invention relates to a computer-implemented method for processing a query in a database, the query comprising a search value. The database comprises a plurality of datasets the datasets comprising entries, wherein distance statistics are assigned to the datasets. The distance statistics describe the minimum and maximum distance between the values of the entries of a dataset of the plurality of datasets and a reference value. The method comprises determining the distance between the search value and the reference value, said determination resulting in a search distance, determining a subset of datasets from the plurality of datasets for which the search distance is within the limits given by the minimum and maximum distances described by the respective distance statistics, and searching for the search value in the subset of datasets.