Persistent metadata catalog
    22.
    发明授权

    公开(公告)号:US11886429B2

    公开(公告)日:2024-01-30

    申请号:US17104392

    申请日:2020-11-25

    CPC classification number: G06F16/24 G06F21/6218

    Abstract: A metadata catalog may store metadata about data sources. The metadata may define table, column, partition and/or data formats, as well as title information, textual descriptions, modification information, data schemas and access information, such as location and connection information. A metadata catalog service may provide a shared, persistent, central repository for the metadata. The metadata of the catalog may be published via multiple access mechanisms and programmatically obtained and processed by other programs via the metadata catalog service. Metadata consumers may utilize the metadata catalog service to perform various metadata tasks, such as metadata retrieval, creation, addition, modification and/or deletion. The metadata catalog service may be directly integrated into existing data analytic tools as a persistent and durable metadata store allowing users to utilize the broad set of data processing tools.

    PERSISTENT METADATA CATALOG
    24.
    发明申请

    公开(公告)号:US20210173828A1

    公开(公告)日:2021-06-10

    申请号:US17104392

    申请日:2020-11-25

    Abstract: A metadata catalog may store metadata about data sources. The metadata may define table, column, partition and/or data formats, as well as title information, textual descriptions, modification information, data schemas and access information, such as location and connection information. A metadata catalog service may provide a shared, persistent, central repository for the metadata. The metadata of the catalog may be published via multiple access mechanisms and programmatically obtained and processed by other programs via the metadata catalog service. Metadata consumers may utilize the metadata catalog service to perform various metadata tasks, such as metadata retrieval, creation, addition, modification and/or deletion. The metadata catalog service may be directly integrated into existing data analytic tools as a persistent and durable metadata store allowing users to utilize the broad set of data processing tools.

    Persistent metadata catalog
    25.
    发明授权

    公开(公告)号:US10853356B1

    公开(公告)日:2020-12-01

    申请号:US14310422

    申请日:2014-06-20

    Abstract: A metadata catalog may store metadata about data sources. The metadata may define table, column, partition and/or data formats, as well as title information, textual descriptions, modification information, data schemas and access information, such as location and connection information. A metadata catalog service may provide a shared, persistent, central repository for the metadata. The metadata of the catalog may be published via multiple access mechanisms and programmatically obtained and processed by other programs via the metadata catalog service. Metadata consumers may utilize the metadata catalog service to perform various metadata tasks, such as metadata retrieval, creation, addition, modification and/or deletion. The metadata catalog service may be directly integrated into existing data analytic tools as a persistent and durable metadata store allowing users to utilize the broad set of data processing tools.

    Consistent data storage in distributed computing systems

    公开(公告)号:US10592475B1

    公开(公告)日:2020-03-17

    申请号:US14222103

    申请日:2014-03-21

    Abstract: Methods and apparatus for providing consistent data storage in distributed computing systems. A consistent distributed computing file system (consistent DCFS) may be backed by an object storage service that only guarantees eventual consistency, and may leverage a data storage service (e.g., a database service) to store and maintain a file system/directory structure (a consistent DCFS directory) for the consistent DCFS that may be accessed by compute nodes for file/directory information relevant to the data objects in the consistent DCFS, rather than relying on the information maintained by the object storage service. The compute nodes may reference the consistent DCFS directory to, for example, store and retrieve strongly consistent metadata referencing data objects in the consistent DCFS. The compute nodes may, for example, retrieve metadata from consistent DCFS directory to determine whether the object storage service is presenting all of the data that it is supposed to have.

    Metrics processing service
    28.
    发明授权

    公开(公告)号:US10374915B1

    公开(公告)日:2019-08-06

    申请号:US14754388

    申请日:2015-06-29

    Abstract: A distributed services platform may generate a plurality of log files containing metric values. Metric values may be provided to a first level of a topology of aggregation modules. The first level of aggregation modules may provide output to a second level of the topology. Subsequent levels of the topology may perform greater amounts of aggregation while providing stream-based access to the aggregated values. State information for the aggregation topology may be saved subsequent to each cycle of values through the topology.

Patent Agency Ranking