公开(公告)号：US10481983B1

公开(公告)日：2019-11-19

申请号：US15087710

申请日：2016-03-31

Applicant: Amazon Technologies, Inc.

Inventor： Mahmood Miah ,  Matthew James Eddey ,  John Sandeep Yuhan

IPC: G06F16/13 ,  G06F11/14 ,  G06F16/28 ,  G06F16/901 ,  G06F16/11

Abstract: A snapshot analysis system analyzes a plurality of data snapshots taken in connection with data stored on a block device allocated by a data storage system. The snapshot analysis system may include an ingestor capable of initially detecting new snapshots and adding a root node for the snapshots. The system may include a block device analyzer that analyzes each snapshot to determine its contents, the relationship within data structures extant within the snapshot, and the snapshot's relationship to other snapshots and/or that of other block devices. The system may also include a clustering analyzer capable of determining whether snapshots are associated with multipart block devices, such as LVM or MD RAID devices. The system may further include a block device emulator that exposes data associated with a given snapshot as an addressable block device without necessitating retrieval or exposure of the full block device to which the snapshot is associated.

公开(公告)号：US09026869B1

公开(公告)日：2015-05-05

申请号：US13666855

申请日：2012-11-01

Applicant: Amazon Technologies, Inc.

Inventor： Yi Li ,  Danny Wei ,  Kerry Quintin Lee ,  Mahmood Miah ,  Nandakumar Gopalakrishnan

IPC: G06F11/10

CPC classification number: G06F11/08 ,  G06F11/1004 ,  G06F11/1016 ,  G06F11/1032 ,  G06F11/106 ,  G11C29/38

Abstract: Methods and systems for detecting error in data storage entities based at least in part on importance of data stored in the data storage entities. In an embodiment, multiple verification passes may be performed on a data storage entity comprising one or more data blocks. Each data block may be associated with a probability indicating the likelihood that the data block is to be selected for verification. During each verification pass, a subset of the data blocks may be selected based at least in part on the probabilities associated with the data blocks. The probabilities may be adjusted, for example, at the end of a verification pass, based on importance factors such as usage and verification information associated with the data blocks. The probabilities may be updated to facilitate timely detection of important data blocks. Additionally, error mitigation and/or correction routines may be performed in light of detected errors.

Abstract translation: 至少部分地基于数据存储实体中存储的数据的重要性来检测数据存储实体中的错误的方法和系统。 在一个实施例中，可以对包括一个或多个数据块的数据存储实体执行多个验证遍。 每个数据块可以与指示数据块被选择用于验证的可能性的概率相关联。 在每次验证过程中，可以至少部分地基于与数据块相关联的概率来选择数据块的子集。 可以根据诸如与数据块相关联的使用和验证信息等重要性因素来调整概率，例如，在验证通过结束时。 可能更新概率以便于及时检测重要的数据块。 另外，可以根据检测到的错误来执行误差减轻和/或校正例程。

公开(公告)号：US10936225B1

公开(公告)日：2021-03-02

申请号：US14934954

申请日：2015-11-06

Applicant: AMAZON TECHNOLOGIES, INC.

Inventor： Matthew James Eddey ,  John Sandeep Yuhan ,  Mahmood Miah ,  Abhishek Kumar

IPC: G06F3/06

Abstract: A system includes a storage volume configured to store a data set in a plurality of data blocks, a data store configured to store a plurality of captures of the data set in a plurality of data chunks, and file retrieval logic. The data set includes a file stored in a data block of the plurality of data blocks. The plurality of captures includes the file captured at different points in time. The file retrieval logic is configured to identify the plurality of data chunks in which the data block as captured in the plurality of captures is stored in the data store, retrieve the plurality of data chunks from the data store, and read the data block as captured in the plurality of captures from the plurality of data chunks to produce a plurality of file versions.

公开(公告)号：US09430320B1

公开(公告)日：2016-08-30

申请号：US14703593

申请日：2015-05-04

Applicant: Amazon Technologies, Inc.

Inventor： Yi Li ,  Danny Wei ,  Kerry Quintin Lee ,  Mahmood Miah ,  Nandakumar Gopalakrishnan

IPC: G11C29/00 ,  G06F11/08 ,  G11C29/38

CPC classification number: G06F11/08 ,  G06F11/1004 ,  G06F11/1016 ,  G06F11/1032 ,  G06F11/106 ,  G11C29/38

Abstract: Methods and systems for detecting error in data storage entities based at least in part on importance of data stored in the data storage entities. In an embodiment, multiple verification passes may be performed on a data storage entity comprising one or more data blocks. Each data block may be associated with a probability indicating the likelihood that the data block is to be selected for verification. During each verification pass, a subset of the data blocks may be selected based at least in part on the probabilities associated with the data blocks. The probabilities may be adjusted, for example, at the end of a verification pass, based on importance factors such as usage and verification information associated with the data blocks. The probabilities may be updated to facilitate timely detection of important data blocks. Additionally, error mitigation and/or correction routines may be performed in light of detected errors.

公开(公告)号：US11048424B1

公开(公告)日：2021-06-29

申请号：US14934971

申请日：2015-11-06

Applicant: AMAZON TECHNOLOGIES, INC.

Inventor： Matthew James Eddey ,  John Sandeep Yuhan ,  Mahmood Miah ,  Abhishek Kumar

IPC: G06F3/06

Abstract: A system includes a storage volume configured to store a data set in a plurality of data blocks, a data store configured to store a plurality of captures of the data set in a plurality of data chunks, and file retrieval logic. The data set includes a file stored in a first data block of the plurality of data blocks. The file retrieval logic is configured to identify a first data chunk of the plurality of data chunks in which the first data block as captured in a first capture is stored in the data store, retrieve the first data chunk from the data store, and read the first data block as captured in the first capture from the first data chunk.

公开(公告)号：US10534749B1

公开(公告)日：2020-01-14

申请号：US15087335

申请日：2016-03-31

Applicant: Amazon Technologies, Inc.

Inventor： Mahmood Miah ,  Matthew James Eddey ,  John Sandeep Yuhan

IPC: G06F16/11

Abstract: A snapshot analysis system analyzes a plurality of data snapshots taken in connection with data stored on a block device allocated by a data storage system. The snapshot analysis system may include an ingestor capable of initially detecting new snapshots and adding a root node for the snapshots. The system may include a block device analyzer that analyzes each snapshot to determine its contents, the relationship within data structures extant within the snapshot, and the snapshot's relationship to other snapshots and/or that of other block devices. The system may also include a clustering analyzer capable of determining whether snapshots are associated with multipart block devices, such as LVM or MD-RAID devices. The system may further include a block device emulator that exposes data associated with a given snapshot as an addressable block device without necessitating retrieval or exposure of the full block device to which the snapshot is associated.

公开(公告)号：US10289493B1

公开(公告)日：2019-05-14

申请号：US15087334

申请日：2016-03-31

Applicant: Amazon Technologies, Inc.

Inventor： Mahmood Miah ,  Matthew James Eddey ,  John Sandeep Yuhan

IPC: G06F17/30 ,  G06F11/14

Abstract: A snapshot analysis system analyzes a plurality of data snapshots taken in connection with data stored on a block device allocated by a data storage system. The snapshot analysis system may include an ingestor capable of initially detecting new snapshots and adding a root node for the snapshots. The system may include a block device analyzer that analyzes each snapshot to determine its contents, the relationship within data structures extant within the snapshot, and the snapshot's relationship to other snapshots and/or that of other block devices. The system may also include a clustering analyzer capable of determining whether snapshots are associated with multipart block devices, such as LVM or MD RAID devices. The system may further include a block device emulator that exposes data associated with a given snapshot as an addressable block device without necessitating retrieval or exposure of the full block device to which the snapshot is associated.

公开(公告)号：US11099939B2

公开(公告)日：2021-08-24

申请号：US16687361

申请日：2019-11-18

Applicant: Amazon Technologies, Inc.

Inventor： Mahmood Miah ,  Matthew James Eddey ,  John Sandeep Yuhan

IPC: G06F16/11 ,  G06F11/14 ,  G06F16/28 ,  G06F16/901

Abstract: A snapshot analysis system analyzes a plurality of data snapshots taken in connection with data stored on a block device allocated by a data storage system. The snapshot analysis system may include an ingestor capable of initially detecting new snapshots and adding a root node for the snapshots. The system may include a block device analyzer that analyzes each snapshot to determine its contents, the relationship within data structures extant within the snapshot, and the snapshot's relationship to other snapshots and/or that of other block devices. The system may also include a clustering analyzer capable of determining whether snapshots are associated with multipart block devices, such as LVM or MD RAID devices. The system may further include a block device emulator that exposes data associated with a given snapshot as an addressable block device without necessitating retrieval or exposure of the full block device to which the snapshot is associated.

公开(公告)号：US20200089574A1

公开(公告)日：2020-03-19

申请号：US16687361

申请日：2019-11-18

Applicant: Amazon Technologies, Inc.

Inventor： Mahmood Miah ,  Matthew James Eddey ,  John Sandeep Yuhan

IPC: G06F11/14 ,  G06F16/11 ,  G06F16/28 ,  G06F16/901

Abstract: A snapshot analysis system analyzes a plurality of data snapshots taken in connection with data stored on a block device allocated by a data storage system. The snapshot analysis system may include an ingestor capable of initially detecting new snapshots and adding a root node for the snapshots. The system may include a block device analyzer that analyzes each snapshot to determine its contents, the relationship within data structures extant within the snapshot, and the snapshot's relationship to other snapshots and/or that of other block devices. The system may also include a clustering analyzer capable of determining whether snapshots are associated with multipart block devices, such as LVM or MD RAID devices. The system may further include a block device emulator that exposes data associated with a given snapshot as an addressable block device without necessitating retrieval or exposure of the full block device to which the snapshot is associated.

公开(公告)号：US10019180B1

公开(公告)日：2018-07-10

申请号：US15087463

申请日：2016-03-31

Applicant: Amazon Technologies, Inc.

Inventor： Mahmood Miah ,  Matthew James Eddey ,  John Sandeep Yuhan

IPC: G06F3/06 ,  G06F17/30 ,  G06F12/122 ,  G06F12/128 ,  G06F11/14

CPC classification number: G06F3/0619 ,  G06F3/065 ,  G06F3/0665 ,  G06F3/0683 ,  G06F11/1448 ,  G06F16/128 ,  G06F2201/84

Abstract: A snapshot analysis system analyzes a plurality of data snapshots taken in connection with data stored on a block device allocated by a data storage system. The snapshot analysis system may include an ingestor capable of initially detecting new snapshots and adding a root node for the snapshots. The system may include a block device analyzer that analyzes each snapshot to determine its contents, the relationship within data structures extant within the snapshot, and the snapshot's relationship to other snapshots and/or that of other block devices. The system may also include a clustering analyzer capable of determining whether snapshots are associated with multipart block devices, such as LVM or MD RAID devices. The system may further include a block device emulator that exposes data associated with a given snapshot as an addressable block device without necessitating retrieval or exposure of the full block device to which the snapshot is associated.