-
公开(公告)号:US11893044B2
公开(公告)日:2024-02-06
申请号:US16846141
申请日:2020-04-10
Applicant: Amazon Technologies, Inc.
Inventor: Mehul A Shah , George Steven McPherson , Prajakta Datta Damle , Gopinath Duddi , Anurag Windlass Gupta
CPC classification number: G06F16/285 , G06F16/13 , G06F16/211 , G06F16/254 , G06F16/289
Abstract: Recognizing unknown data objects may be implemented for data objects stored in a data store. Data objects that are identified as unknown may be accessed to retrieve a portion of the data object. Different representations of the data object may be generated for recognizing different data schemas. An analysis of the representations may be performed to identify a data schema for the unknown data object. The data schema may be stored in a metadata store for the unknown data object.
-
公开(公告)号:US11886429B2
公开(公告)日:2024-01-30
申请号:US17104392
申请日:2020-11-25
Applicant: Amazon Technologies, Inc.
Inventor: George Steven McPherson , Yevgeniy Mikhaylyuta , Tobin Daniel Baker , Richard Jeffrey Cole
CPC classification number: G06F16/24 , G06F21/6218
Abstract: A metadata catalog may store metadata about data sources. The metadata may define table, column, partition and/or data formats, as well as title information, textual descriptions, modification information, data schemas and access information, such as location and connection information. A metadata catalog service may provide a shared, persistent, central repository for the metadata. The metadata of the catalog may be published via multiple access mechanisms and programmatically obtained and processed by other programs via the metadata catalog service. Metadata consumers may utilize the metadata catalog service to perform various metadata tasks, such as metadata retrieval, creation, addition, modification and/or deletion. The metadata catalog service may be directly integrated into existing data analytic tools as a persistent and durable metadata store allowing users to utilize the broad set of data processing tools.
-
公开(公告)号:US20230362265A1
公开(公告)日:2023-11-09
申请号:US18310461
申请日:2023-05-01
Applicant: Amazon Technologies, Inc.
Inventor: George Steven McPherson , Mehul A. Shah , Supratik Chakraborty , Prajakta Datta Damle , Gopinath Duddi , Anurag Windlass Gupta
IPC: H04L67/01 , H04L67/10 , G06F9/50 , G06F9/4401 , H04L67/00
CPC classification number: H04L67/34 , G06F9/4411 , G06F9/5005 , G06F9/5072 , H04L67/01 , H04L67/10
Abstract: Code may be dynamically routed to computing resources for execution. Code may be received for execution on behalf of a client. Execution criteria for the code may be determined and computing resources that satisfy the execution criteria may be identified. The identified computing resources may then be procured for executing the code and then the code may be routed to the procured computing resources for execution. Permissions or authorization to execute the code may be shared to ensure that computing resources executing the code have the same permissions or authorization when executing the code.
-
公开(公告)号:US20210173828A1
公开(公告)日:2021-06-10
申请号:US17104392
申请日:2020-11-25
Applicant: Amazon Technologies, Inc.
Inventor: George Steven McPherson , Yevgeniy Mikhaylyuta , Tobin Daniel Baker , Richard Jeffrey Cole
Abstract: A metadata catalog may store metadata about data sources. The metadata may define table, column, partition and/or data formats, as well as title information, textual descriptions, modification information, data schemas and access information, such as location and connection information. A metadata catalog service may provide a shared, persistent, central repository for the metadata. The metadata of the catalog may be published via multiple access mechanisms and programmatically obtained and processed by other programs via the metadata catalog service. Metadata consumers may utilize the metadata catalog service to perform various metadata tasks, such as metadata retrieval, creation, addition, modification and/or deletion. The metadata catalog service may be directly integrated into existing data analytic tools as a persistent and durable metadata store allowing users to utilize the broad set of data processing tools.
-
公开(公告)号:US10853356B1
公开(公告)日:2020-12-01
申请号:US14310422
申请日:2014-06-20
Applicant: Amazon Technologies, Inc.
Inventor: George Steven McPherson , Yevgeniy Mikhaylyuta , Tobin Daniel Baker , Richard Jeffrey Cole
Abstract: A metadata catalog may store metadata about data sources. The metadata may define table, column, partition and/or data formats, as well as title information, textual descriptions, modification information, data schemas and access information, such as location and connection information. A metadata catalog service may provide a shared, persistent, central repository for the metadata. The metadata of the catalog may be published via multiple access mechanisms and programmatically obtained and processed by other programs via the metadata catalog service. Metadata consumers may utilize the metadata catalog service to perform various metadata tasks, such as metadata retrieval, creation, addition, modification and/or deletion. The metadata catalog service may be directly integrated into existing data analytic tools as a persistent and durable metadata store allowing users to utilize the broad set of data processing tools.
-
公开(公告)号:US20200242135A1
公开(公告)日:2020-07-30
申请号:US16846141
申请日:2020-04-10
Applicant: Amazon Technologies, Inc.
Inventor: Mehul A. Shah , George Steven McPherson , Prajakta Datta Damle , Gopinath Duddi , Anurag Windlass Gupta
Abstract: Recognizing unknown data objects may be implemented for data objects stored in a data store. Data objects that are identified as unknown may be accessed to retrieve a portion of the data object. Different representations of the data object may be generated for recognizing different data schemas. An analysis of the representations may be performed to identify a data schema for the unknown data object. The data schema may be stored in a metadata store for the unknown data object.
-
公开(公告)号:US10592475B1
公开(公告)日:2020-03-17
申请号:US14222103
申请日:2014-03-21
Applicant: Amazon Technologies, Inc.
Inventor: Bogdan Eduard Ghidireac , Peter Sirota , Robert Frederick Leidle , Mathew Alan Mills , George Steven McPherson , Xing Wu , Jonathan Andrew Fritz
IPC: G06F16/182
Abstract: Methods and apparatus for providing consistent data storage in distributed computing systems. A consistent distributed computing file system (consistent DCFS) may be backed by an object storage service that only guarantees eventual consistency, and may leverage a data storage service (e.g., a database service) to store and maintain a file system/directory structure (a consistent DCFS directory) for the consistent DCFS that may be accessed by compute nodes for file/directory information relevant to the data objects in the consistent DCFS, rather than relying on the information maintained by the object storage service. The compute nodes may reference the consistent DCFS directory to, for example, store and retrieve strongly consistent metadata referencing data objects in the consistent DCFS. The compute nodes may, for example, retrieve metadata from consistent DCFS directory to determine whether the object storage service is presenting all of the data that it is supposed to have.
-
公开(公告)号:US10374915B1
公开(公告)日:2019-08-06
申请号:US14754388
申请日:2015-06-29
Applicant: Amazon Technologies, Inc.
Inventor: Xiqiang Zhi , George Steven McPherson
IPC: H04L12/26
Abstract: A distributed services platform may generate a plurality of log files containing metric values. Metric values may be provided to a first level of a topology of aggregation modules. The first level of aggregation modules may provide output to a second level of the topology. Subsequent levels of the topology may perform greater amounts of aggregation while providing stream-based access to the aggregated values. State information for the aggregation topology may be saved subsequent to each cycle of values through the topology.
-
-
-
-
-
-
-