System and method for automatically managing storage resources of a big data platform

    公开(公告)号:US11507622B2

    公开(公告)日:2022-11-22

    申请号:US16829713

    申请日:2020-03-25

    Abstract: There is provided a computer-implemented method for automatically managing storage resources of a distributed file system comprising: obtaining actual past storage usage data of a first directory from a plurality of directories of the distributed file system to a current time; detecting, a space quota limit for the first directory and associated with a pre-defined expected future time; determining from the actual past storage usage data, projected storage usage data of the first directory over a future time period; obtaining an aggregated correction coefficient providing an indication of aggregated projected storage usage needs of remaining other directories relative to the first directory; in response to determining an expected value of the projected storage usage data at the expected future time is inconsistent with the space quota limit, adjusting the space quota limit to a new quota limit based on the expected value weighted by the aggregated correction coefficient.

    SYSTEM AND METHOD FOR AUTOMATICALLY MANAGING STORAGE RESOURCES OF A BIG DATA PLATFORM

    公开(公告)号:US20230046875A1

    公开(公告)日:2023-02-16

    申请号:US17969453

    申请日:2022-10-19

    Abstract: There is provided a computer-implemented method for automatically managing storage resources of a distributed file system comprising: obtaining actual past storage usage data of a first directory from a plurality of directories of the distributed file system to a current time; detecting, a space quota limit for the first directory and associated with a pre-defined expected future time; determining from the actual past storage usage data, projected storage usage data of the first directory over a future time period; obtaining an aggregated correction coefficient providing an indication of aggregated projected storage usage needs of remaining other directories relative to the first directory; in response to determining an expected value of the projected storage usage data at the expected future time is inconsistent with the space quota limit, adjusting the space quota limit to a new quota limit based on the expected value weighted by the aggregated correction coefficient.

    SYSTEM AND METHOD FOR AUTOMATICALLY MANAGING STORAGE RESOURCES OF A BIG DATA PLATFORM

    公开(公告)号:US20210303631A1

    公开(公告)日:2021-09-30

    申请号:US16829713

    申请日:2020-03-25

    Abstract: There is provided a computer-implemented method for automatically managing storage resources of a distributed file system comprising: obtaining actual past storage usage data of a first directory from a plurality of directories of the distributed file system to a current time; detecting, a space quota limit for the first directory and associated with a pre-defined expected future time; determining from the actual past storage usage data, projected storage usage data of the first directory over a future time period; obtaining an aggregated correction coefficient providing an indication of aggregated projected storage usage needs of remaining other directories relative to the first directory; in response to determining an expected value of the projected storage usage data at the expected future time is inconsistent with the space quota limit, adjusting the space quota limit to a new quota limit based on the expected value weighted by the aggregated correction coefficient.

Patent Agency Ranking