公开(公告)号：US20220279049A1

公开(公告)日：2022-09-01

申请号：US17694585

申请日：2022-03-14

Applicant: Amazon Technologies, Inc.

Inventor： George Steven McPherson ,  Mehul A. Shah ,  Supratik Chakraborty ,  Prajakta Datta Damle ,  Gopinath Duddi ,  Anurag Windlass Gupta

IPC: H04L67/00 ,  H04L67/10 ,  G06F9/4401 ,  G06F9/50 ,  H04L67/01

Abstract: Code may be dynamically routed to computing resources for execution. Code may be received for execution on behalf of a client. Execution criteria for the code may be determined and computing resources that satisfy the execution criteria may be identified. The identified computing resources may then be procured for executing the code and then the code may be routed to the procured computing resources for execution. Permissions or authorization to execute the code may be shared to ensure that computing resources executing the code have the same permissions or authorization when executing the code.

公开(公告)号：US10713272B1

公开(公告)日：2020-07-14

申请号：US15199505

申请日：2016-06-30

Applicant: Amazon Technologies, Inc.

Inventor： Andrew Edward Caldwell ,  Anurag Windlass Gupta ,  Mehul Shah ,  Prajakta Damle ,  George Steven McPherson

IPC: G06F16/00 ,  G06F16/25 ,  G06F16/28 ,  G06F16/951 ,  G06F16/23

Abstract: Dynamic generation of data catalogs may be implemented for accessing data sets in different storage locations. Data sets may be accessed in order to extract portions of data. Structure recognition techniques may be applied to the extracted data in order to determine structural information for the data sets. The structural information may then be stored as part of a data catalog for the data sets. Requests to access the data catalog from different clients may be received and the requested structural data supplied so that the clients may access different data sets utilizing the supplied structural data. Data catalogs may be updated as changes to data sets are made.

公开(公告)号：US20200218701A1

公开(公告)日：2020-07-09

申请号：US16818404

申请日：2020-03-13

Applicant: Amazon Technologies, Inc.

Inventor： Bogdan Eduard Ghidireac ,  Peter Sirota ,  Robert Frederick Leidle ,  Mathew Alan Mills ,  George Steven McPherson ,  Xing Wu ,  Jonathan Andrew Fritz

IPC: G06F16/182

Abstract: Methods and apparatus for providing consistent data storage in distributed computing systems. A consistent distributed computing file system (consistent DCFS) may be backed by an object storage service that only guarantees eventual consistency, and may leverage a data storage service (e.g., a database service) to store and maintain a file system/directory structure (a consistent DCFS directory) for the consistent DCFS that may be accessed by compute nodes for file/directory information relevant to the data objects in the consistent DCFS, rather than relying on the information maintained by the object storage service. The compute nodes may reference the consistent DCFS directory to, for example, store and retrieve strongly consistent metadata referencing data objects in the consistent DCFS. The compute nodes may, for example, retrieve metadata from consistent DCFS directory to determine whether the object storage service is presenting all of the data that it is supposed to have.

公开(公告)号：US10599621B1

公开(公告)日：2020-03-24

申请号：US14611980

申请日：2015-02-02

Applicant: Amazon Technologies, Inc.

Inventor： Xing Wu ,  George Steven McPherson ,  Robert Frederick Leidle ,  Jonathan Andrew Fritz

IPC: G06F17/30 ,  G06F16/182

Abstract: A system and method for improving the speed of generating a list of previously-uncounted items stored with a computing resource service provider. The system and method involve obtaining a set of keys from a data store, wherein each key of the set of keys corresponds to an item in a group of items, wherein a quantity of items in the group is uncounted. The system and method further includes generating a first sub-listing of keys based at least in part on a first key range of the set of keys by executing a first thread, generating a second sub-listing of keys based at least in part on a second key range of the set of keys by executing a second thread, combining the first sub-listing of keys with the second sub-listing of keys to produce a list of keys, and providing the list of keys.

公开(公告)号：US11695840B2

公开(公告)日：2023-07-04

申请号：US17694585

申请日：2022-03-14

Applicant: Amazon Technologies, Inc.

Inventor： George Steven McPherson ,  Mehul A. Shah ,  Supratik Chakraborty ,  Prajakta Datta Damle ,  Gopinath Duddi ,  Anurag Windlass Gupta

IPC: H04L67/00 ,  H04L67/10 ,  G06F9/50 ,  G06F9/4401 ,  H04L67/01

CPC classification number: H04L67/34 ,  G06F9/4411 ,  G06F9/5005 ,  G06F9/5072 ,  H04L67/01 ,  H04L67/10

Abstract: Code may be dynamically routed to computing resources for execution. Code may be received for execution on behalf of a client. Execution criteria for the code may be determined and computing resources that satisfy the execution criteria may be identified. The identified computing resources may then be procured for executing the code and then the code may be routed to the procured computing resources for execution. Permissions or authorization to execute the code may be shared to ensure that computing resources executing the code have the same permissions or authorization when executing the code.

公开(公告)号：US11423041B2

公开(公告)日：2022-08-23

申请号：US16752022

申请日：2020-01-24

Applicant: Amazon Technologies, Inc.

Inventor： George Steven McPherson ,  Mehul A. Shah ,  Prajakta Datta Damle ,  Gopinath Duddi ,  Anurag Windlass Gupta

IPC: G06F17/00 ,  G06F16/25 ,  G06F16/23 ,  G06F16/2455

Abstract: History for data objects may be maintained to detect data events. An indication of an Extract, Transform, Load (ETL) process applied to one or more source data objects to generate one or more transformed data objects may be received. History for the source data objects may be updated to include the transformed data objects and the ETL process that generated the transformed data objects. An evaluation of the update may be performed to determine whether an event associated with the data lineage is triggered. If the event is triggered, a notification of the event may be sent to one or more subscribers for the event.

公开(公告)号：US20220100774A1

公开(公告)日：2022-03-31

申请号：US17491985

申请日：2021-10-01

Applicant: Amazon Technologies, Inc.

Inventor： Mehul A. Shah ,  George Steven McPherson ,  Prajakta Datta Damle ,  Gopinath Duddi ,  Anurag Windlass Gupta ,  Benjamin Albert Sowell ,  Bohou Li

IPC: G06F16/25 ,  G06F16/28

Abstract: Data transformation workflows may be generated to transform data objects. A source data schema for a data object and a target data format or target data schema for a data object may be identified. A comparison of the source data schema and the target data format or schema may be made to determine what transformations can be performed to transform the data object into the target data format or schema. Code to execute the transformation operations may then be generated. The code may be stored for subsequent modification or execution.

公开(公告)号：US10545979B2

公开(公告)日：2020-01-28

申请号：US15385789

申请日：2016-12-20

Applicant: Amazon Technologies, Inc.

Inventor： George Steven McPherson ,  Mehul A. Shah ,  Prajakta Datta Damle ,  Gopinath Duddi ,  Anurag Windlass Gupta

IPC: G06F16/25 ,  G06F16/23 ,  G06F16/2455

Abstract: History for data objects may be maintained to detect data events. An indication of an Extract, Transform, Load (ETL) process applied to one or more source data objects to generate one or more transformed data objects may be received. History for the source data objects may be updated to include the transformed data objects and the ETL process that generated the transformed data objects. An evaluation of the update may be performed to determine whether an event associated with the data lineage is triggered. If the event is triggered, a notification of the event may be sent to one or more subscribers for the event.

公开(公告)号：US12225092B2

公开(公告)日：2025-02-11

申请号：US18310461

申请日：2023-05-01

Applicant: Amazon Technologies, Inc.

Inventor： George Steven McPherson ,  Mehul A. Shah ,  Supratik Chakraborty ,  Prajakta Datta Damle ,  Gopinath Duddi ,  Anurag Windlass Gupta

IPC: H04L67/00 ,  G06F9/4401 ,  G06F9/50 ,  H04L67/01 ,  H04L67/10 ,  H04L69/24

Abstract: Code may be dynamically routed to computing resources for execution. Code may be received for execution on behalf of a client. Execution criteria for the code may be determined and computing resources that satisfy the execution criteria may be identified. The identified computing resources may then be procured for executing the code and then the code may be routed to the procured computing resources for execution. Permissions or authorization to execute the code may be shared to ensure that computing resources executing the code have the same permissions or authorization when executing the code.

公开(公告)号：US11941017B2

公开(公告)日：2024-03-26

申请号：US18048645

申请日：2022-10-21

Applicant: Amazon Technologies, Inc.

Inventor： George Steven McPherson ,  Mehul A. Shah ,  Prajakta Datta Damle ,  Gopinath Duddi ,  Anurag Windlass Gupta

IPC: G06F17/00 ,  G06F9/54 ,  G06F16/25

CPC classification number: G06F16/254 ,  G06F9/542

Abstract: Extract, Transform, Load (ETL) processing may be initiated by detected events. A trigger event may be associated with an ETL process apply one or more transformations to a source data object. The trigger event may be detected for the ETL process and evaluated with respect to one or more execution conditions for the ETL process. If the execution conditions for the ETL process are satisfied, then the ETL process may be executed. At least some of the source data object may be obtained, the one or more transformations of the ETL process may be applied, and one or more transformed data objects may be stored.