-
公开(公告)号:US11553196B2
公开(公告)日:2023-01-10
申请号:US16827311
申请日:2020-03-23
Applicant: Amazon Technologies, Inc.
Inventor: Jeremiah M. Dunham , Andrew Tunall , Benjamin Black , Kristopher Kosmatka , Benjamin Aldouby Schwartz , Jason LaPier , Justin Abrahms
IPC: H04N19/37 , G06F16/71 , G06F16/73 , G06F16/738 , G06F16/78 , G06F16/11 , G06F16/70 , H04N21/2343
Abstract: A user of a storage system can upload files for a media asset, which can include a high quality media file and various related files. As part of the upload process, the storage system can extract metadata that describes the media asset. The user can specify one or more lifecycle policies to be applied for storage of the asset, and a rules engine can ensure the application of the one or more policies. The rules engine can also enable the use of simple media processing workflows. A filename hashing approach can be used to ensure that the segments and files for the asset are stored in a relatively random and even distribution across the partitions of the storage system. As part of the lifecycle for the asset, the high quality media file can be moved to less expensive storage once transcoding of the asset or another such action occurs.
-
公开(公告)号:US10521449B1
公开(公告)日:2019-12-31
申请号:US14573956
申请日:2014-12-17
Applicant: Amazon Technologies, Inc.
Inventor: Benjamin Aldouby Schwartz , Khawaja Salman Shams , Usman Ahmed Shami , David Craig Yanacek , Khai Quang Tran
Abstract: One or more computing nodes located in a first region may maintain a first collection of data items. A second set of one or more computing nodes in a second region may maintain a collection of data items that is at least a partial replica of the first collection. Notifications of changes to the first collection may be transmitted, via a broadcast communications channel, to a replication module, which may be included in a client application. The replication module may transmit requests to update the second collection of data based on changes to the first collection. Conflicts may be resolved through a last-write wins policy.
-
公开(公告)号:US20180077420A1
公开(公告)日:2018-03-15
申请号:US15265513
申请日:2016-09-14
Applicant: Amazon Technologies, Inc.
Inventor: Jeremiah M. Dunham , Andrew Tunall , Benjamin Black , Kristopher Kosmatka , Benjamin Aldouby Schwartz , Jason LaPier , Justin Abrahms
Abstract: A user of a storage system can upload files for a media asset, which can include a high quality media file and various related files. As part of the upload process, the storage system can extract metadata that describes the media asset. The user can specify one or more lifecycle policies to be applied for storage of the asset, and a rules engine can ensure the application of the one or more policies. The rules engine can also enable the use of simple media processing workflows. A filename hashing approach can be used to ensure that the segments and files for the asset are stored in a relatively random and even distribution across the partitions of the storage system. As part of the lifecycle for the asset, the high quality media file can be moved to less expensive storage once transcoding of the asset or another such action occurs.
-
公开(公告)号:US11113155B1
公开(公告)日:2021-09-07
申请号:US15789598
申请日:2017-10-20
Applicant: Amazon Technologies, Inc.
Inventor: Benjamin Aldouby Schwartz , Serj Kazar , Dumanshu Goyal
IPC: G06F16/11 , G06F16/185 , G06F11/14 , G06F16/182 , G06F16/22
Abstract: Transactional log data for a distributed database may be archived by a number of computing nodes scalable to a specified concurrency parameter. A log record may be mapped to a computing node for performance of an archiving operation. The log record may be stored with information indicative of a position, in a hierarchy of shards, of the shard from which the log record originated. The log record may be replayed in an order, relative to other records, that is based on the shard's position in the shard hierarchy. The log record may be replayed on a shard identified based on a time-invariant and idempotent hash function.
-
公开(公告)号:US20200236373A1
公开(公告)日:2020-07-23
申请号:US16827311
申请日:2020-03-23
Applicant: Amazon Technologies, Inc.
Inventor: Jeremiah M. Dunham , Andrew Tunall , Benjamin Black , Kristopher Kosmatka , Benjamin Aldouby Schwartz , Jason LaPier , Justin Abrahms
IPC: H04N19/37 , G06F16/70 , G06F16/11 , H04N21/2343 , G06F16/78 , G06F16/738 , G06F16/73 , G06F16/71
Abstract: A user of a storage system can upload files for a media asset, which can include a high quality media file and various related files. As part of the upload process, the storage system can extract metadata that describes the media asset. The user can specify one or more lifecycle policies to be applied for storage of the asset, and a rules engine can ensure the application of the one or more policies. The rules engine can also enable the use of simple media processing workflows. A filename hashing approach can be used to ensure that the segments and files for the asset are stored in a relatively random and even distribution across the partitions of the storage system. As part of the lifecycle for the asset, the high quality media file can be moved to less expensive storage once transcoding of the asset or another such action occurs.
-
公开(公告)号:US20180089183A1
公开(公告)日:2018-03-29
申请号:US15275082
申请日:2016-09-23
Applicant: Amazon Technologies, Inc.
Inventor: Benjamin Aldouby Schwartz , Jeremiah Dunham , Andrew Tunall , Jason LaPier , Dustin Encelewski , Justin Abrahms , Khawaja Shams
IPC: G06F17/30
Abstract: An asset storage server is provided herein that assigns related files to an asset name and assigns permissions to the asset name such that related files with unrelated names can be assigned permissions independent of the file naming convention and without requiring a user to individually set the permissions of each file. The asset storage server may also generate modified versions of original file names and index a distributed object store based on the modified versions such that related files with related names are not listed in the same partition of the distributed object store. Indexing the distributed object store based on the modified versions of the original file names may reduce data retrieval latency.
-
公开(公告)号:US09823982B1
公开(公告)日:2017-11-21
申请号:US14745260
申请日:2015-06-19
Applicant: Amazon Technologies, Inc.
Inventor: Benjamin Aldouby Schwartz , Serj Kazar , Dumanshu Goyal
CPC classification number: G06F11/1469 , G06F11/1451 , G06F11/1464 , G06F17/30073 , G06F17/30088 , G06F17/30203 , G06F17/30221 , G06F17/3033 , G06F17/30584 , G06F2201/80 , G06F2201/84
Abstract: Transactional log data for a distributed database may be archived by a number of computing nodes scalable to a specified concurrency parameter. A log record may be mapped to a computing node for performance of an archiving operation. The log record may be stored with information indicative of a position, in a hierarchy of shards, of the shard from which the log record originated. The log record may be replayed in an order, relative to other records, that is based on the shard's position in the shard hierarchy. The log record may be replayed on a shard identified based on a time-invariant and idempotent hash function.
-
公开(公告)号:US11086932B1
公开(公告)日:2021-08-10
申请号:US16823198
申请日:2020-03-18
Applicant: Amazon Technologies, Inc.
Inventor: Akhil Ramachandran , Meera Jindal , Benjamin Aldouby Schwartz , Ahmet Gurcan , Ryan Farris , Abilash Ravikumar , Saurav Sengupta , Michael Kale
IPC: G06F16/71 , G06F16/75 , H04N21/218 , H04N21/278 , H04N21/2747
Abstract: A media storage service may maintain an asset including information to indicate a specific media content and a specific number of replicas to be stored by the media storage service for the specific media content. The media storage service may receive content recording-related requests from a recording manager to define or update the specific number for the specific media content. The media storage service may receive one or more segments specific to the media content from an encoder. The media storage service may create and store the specific number of replicas, as indicated in the asset, for the media content.
-
公开(公告)号:US10592546B2
公开(公告)日:2020-03-17
申请号:US15275082
申请日:2016-09-23
Applicant: Amazon Technologies, Inc.
Inventor: Benjamin Aldouby Schwartz , Jeremiah Dunham , Andrew Tunall , Jason LaPier , Dustin Encelewski , Justin Abrahms , Khawaja Shams
Abstract: An asset storage server is provided herein that assigns related files to an asset name and assigns permissions to the asset name such that related files with unrelated names can be assigned permissions independent of the file naming convention and without requiring a user to individually set the permissions of each file. The asset storage server may also generate modified versions of original file names and index a distributed object store based on the modified versions such that related files with related names are not listed in the same partition of the distributed object store. Indexing the distributed object store based on the modified versions of the original file names may reduce data retrieval latency.
-
公开(公告)号:US20190391994A1
公开(公告)日:2019-12-26
申请号:US16505274
申请日:2019-07-08
Applicant: Amazon Technologies, Inc.
Inventor: Benjamin Aldouby Schwartz , Jeremiah Dunham , Andrew Tunall , Jason LaPier , Dustin Encelewski , Justin Abrahms , Khawaja Shams
IPC: G06F16/438 , G06F16/951 , G06F16/48
Abstract: An asset storage server is provided herein that assigns related files to an asset name and assigns permissions to the asset name such that related files with unrelated names can be assigned permissions independent of the file naming convention and without requiring a user to individually set the permissions of each file. The asset storage server may also generate modified versions of original file names and index a distributed object store based on the modified versions such that related files with related names are not listed in the same partition of the distributed object store. Indexing the distributed object store based on the modified versions of the original file names may reduce data retrieval latency.
-
-
-
-
-
-
-
-
-