公开(公告)号：US10983967B2

公开(公告)日：2021-04-20

申请号：US15478177

申请日：2017-04-03

Applicant: Amazon Technologies, Inc.

Inventor： Dimitris Tsirogiannis ,  Nathan A. Binkert ,  Stavros Harizopoulos ,  Mehul A. Shah ,  Benjamin A. Sowell ,  Bryan D. Kaplan ,  Kevin R. Meyer

IPC: G06F16/21 ,  G06F16/22 ,  G06F16/84 ,  G06F16/23 ,  G06F16/25

Abstract: A data transformation system includes a schema inference module and an export module. The schema inference module is configured to dynamically create a cumulative schema for objects retrieved from a first data source. Each of the retrieved objects includes (i) data and (ii) metadata describing the data. Dynamically creating the cumulative schema includes, for each object of the retrieved objects, (i) inferring a schema from the object and (ii) selectively updating the cumulative schema to describe the object according to the inferred schema. The export module is configured to output the data of the retrieved objects to a data destination system according to the cumulative schema.

公开(公告)号：US20170206256A1

公开(公告)日：2017-07-20

申请号：US15478177

申请日：2017-04-03

Applicant: Amazon Technologies, Inc.

Inventor： Dimitris Tsirogiannis ,  Nathan A. Binkert ,  Stavros Harizopoulos ,  Mehul A. Shah ,  Benjamin A. Sowell ,  Bryan D. Kaplan ,  Kevin R. Meyer

IPC: G06F17/30

CPC classification number: G06F16/211 ,  G06F16/22 ,  G06F16/235 ,  G06F16/254 ,  G06F16/86

Abstract: A data transformation system includes a schema inference module and an export module. The schema inference module is configured to dynamically create a cumulative schema for objects retrieved from a first data source. Each of the retrieved objects includes (i) data and (ii) metadata describing the data. Dynamically creating the cumulative schema includes, for each object of the retrieved objects, (i) inferring a schema from the object and (ii) selectively updating the cumulative schema to describe the object according to the inferred schema. The export module is configured to output the data of the retrieved objects to a data destination system according to the cumulative schema.