公开(公告)号：US09672122B1

公开(公告)日：2017-06-06

申请号：US14500762

申请日：2014-09-29

Applicant: Amazon Technologies, Inc.

Inventor： Mohana Sudhan Gandhi ,  Rejith George Joseph ,  Bandish N. Chheda ,  Saurabh Dileep Baji

IPC: G06F11/07 ,  G06F11/20 ,  G06F17/30

CPC classification number: G06F11/1425 ,  G06F9/5088 ,  G06F11/1438 ,  G06F11/1484 ,  G06F11/203 ,  G06F11/2035 ,  G06F11/2041 ,  G06F11/2048 ,  G06F11/3433 ,  G06F17/30215 ,  G06F2201/805 ,  G06F2201/84

Abstract: Data files in a distributed system sometimes becomes unavailable. A method for fault tolerance without data loss in a distributed file system includes allocating data nodes of the distributed file system among a plurality of compute groups, replicating a data file among a subset of the plurality of the compute groups such that the data file is located in at least two compute zones, wherein the first compute zone is isolated from the second compute zone, monitoring the accessibility of the data files, and causing a distributed task requiring data in the data file to be executed by a compute instance in the subset of the plurality of the compute groups. Upon detecting a failure in the accessibility of a data node with the data file, the task management node may redistribute the distributed task among other compute instances with access to any replica of the data file.

公开(公告)号：US20170249215A1

公开(公告)日：2017-08-31

申请号：US15595732

申请日：2017-05-15

Applicant: Amazon Technologies, Inc.

Inventor： Mohana Sudhan Gandhi ,  Rejith George Joseph ,  Bandish N. Chheda ,  Saurabh Dileep Baji

IPC: G06F11/14 ,  G06F9/50 ,  G06F11/34 ,  G06F11/20

CPC classification number: G06F11/1425 ,  G06F9/5088 ,  G06F11/1438 ,  G06F11/1484 ,  G06F11/203 ,  G06F11/2035 ,  G06F11/2041 ,  G06F11/2048 ,  G06F16/1844 ,  G06F2201/84

Abstract: Data files in a distributed system sometimes becomes unavailable. A method for fault tolerance without data loss in a distributed file system includes allocating data nodes of the distributed file system among a plurality of compute groups, replicating a data file among a subset of the plurality of the compute groups such that the data file is located in at least two compute zones, wherein the first compute zone is isolated from the second compute zone, monitoring the accessibility of the data files, and causing a distributed task requiring data in the data file to be executed by a compute instance in the subset of the plurality of the compute groups. Upon detecting a failure in the accessibility of a data node with the data file, the task management node may redistribute the distributed task among other compute instances with access to any replica of the data file.

公开(公告)号：US10379956B2

公开(公告)日：2019-08-13

申请号：US15595732

申请日：2017-05-15

Applicant: Amazon Technologies, Inc.

Inventor： Mohana Sudhan Gandhi ,  Rejith George Joseph ,  Bandish N. Chheda ,  Saurabh Dileep Baji

IPC: G06F11/07 ,  G06F11/14 ,  G06F11/20 ,  G06F9/50 ,  G06F16/182

Abstract: Data files in a distributed system sometimes becomes unavailable. A method for fault tolerance without data loss in a distributed file system includes allocating data nodes of the distributed file system among a plurality of compute groups, replicating a data file among a subset of the plurality of the compute groups such that the data file is located in at least two compute zones, wherein the first compute zone is isolated from the second compute zone, monitoring the accessibility of the data files, and causing a distributed task requiring data in the data file to be executed by a compute instance in the subset of the plurality of the compute groups. Upon detecting a failure in the accessibility of a data node with the data file, the task management node may redistribute the distributed task among other compute instances with access to any replica of the data file.

公开(公告)号：US10133646B1

公开(公告)日：2018-11-20

申请号：US15468708

申请日：2017-03-24

Applicant: Amazon Technologies, Inc.

Inventor： Rejith George Joseph ,  Tin-Yu Lee ,  Bandish N. Chheda ,  Scott Michael Le Grand ,  Saurabh Dileep Baji

IPC: G06F11/00 ,  G06F11/20 ,  G06F11/14

Abstract: A method for providing fault tolerance in a distributed file system of a service provider may include launching at least one data storage node on at least a first virtual machine instance (VMI) running on one or more servers of the service provider and storing file data. At least one data management node may be launched on at least a second VMI running on the one or more servers of the service provider. The at least second VMI may be associated with a dedicated IP address and the at least one data management node may store metadata information associated with the file data in a network storage attached to the at least second VMI. Upon detecting a failure of the at least second VMI, the at least one data management node may be re-launched on at least a third VMI running on the one or more servers.

公开(公告)号：US09612924B1

公开(公告)日：2017-04-04

申请号：US14314969

申请日：2014-06-25

Applicant: Amazon Technologies, Inc.

Inventor： Rejith George Joseph ,  Tin-Yu Lee ,  Bandish N. Chheda ,  Scott Michael Le Grand ,  Saurabh Dileep Baji

IPC: G06F11/00 ,  G06F11/20 ,  G06F9/455

CPC classification number: G06F11/2007 ,  G06F9/45533 ,  G06F9/45558 ,  G06F2009/45579 ,  G06F2009/45591

Abstract: A method for providing fault tolerance in a distributed file system of a service provider may include launching at least one data storage node on at least a first virtual machine instance (VMI) running on one or more servers of the service provider and storing file data. At least one data management node may be launched on at least a second VMI running on the one or more servers of the service provider. The at least second VMI may be associated with a dedicated IP address and the at least one data management node may store metadata information associated with the file data in a network storage attached to the at least second VMI. Upon detecting a failure of the at least second VMI, the at least one data management node may be re-launched on at least a third VMI running on the one or more servers.