公开(公告)号：US10523728B1

公开(公告)日：2019-12-31

申请号：US13931095

申请日：2013-06-28

Applicant: EMC Corporation

Inventor： Stephen G. Graham ,  Matthew L. Troutman ,  Robert A. Lincourt, Jr. ,  Dominique Prunier

IPC: G06F15/16 ,  H04L29/06

Abstract: Example embodiments of the present invention relate to a method, a system, and a computer program product for data analytics. The method includes receiving a plurality of first data streams from respective managed elements in a network and partitioning data of the plurality of first data streams according to an attribute regarding the data into a partitioned second data stream. The partitioned second data stream then may be streamed toward a data analytics platform for consumption by the data analytics platform. In a preferred embodiment, WebSockets are used.

公开(公告)号：US09734180B1

公开(公告)日：2017-08-15

申请号：US14501904

申请日：2014-09-30

Applicant: EMC Corporation

Inventor： Stephen G. Graham ,  Shashwat Srivastav ,  Sriram Sankaran ,  Vishrut Shah ,  Qi Zhang ,  Jun Luo

IPC: G06F17/30

CPC classification number: G06F17/30463 ,  G06F17/30477

Abstract: An object storage system having object metadata query capability. Clients can pose queries to the object system in a high-level, declarative language. A query is evaluated against stored object metadata, and only objects satisfying the query's predicates are returned. The object storage system can evaluate alternative logical and physical query plans using a cost model. Queries can be posed using familiar REST-based APIs. The object storage system includes a distributed key-value store for secondary indexing of object metadata. A user can define secondary indexes considering the most common object access patterns.

公开(公告)号：US09652310B1

公开(公告)日：2017-05-16

申请号：US14041229

申请日：2013-09-30

Applicant: EMC Corporation

Inventor： Stephen G. Graham ,  Cheuk Lam

IPC: G06F3/00 ,  G06F9/44 ,  G06F9/46 ,  G06F13/00 ,  G06F9/54

CPC classification number: G06F9/546

Abstract: Example embodiments of the present invention provide a method and a system for using consistent-hashing to ensure proper sequencing of message processing in a scale-out environment. The method includes receiving a stream of a plurality of messages and performing a consistent-hash on each message of the plurality of messages. Each message then may be distributed toward a respective downstream worker of a plurality of downstream workers for processing according to results of the hash.

公开(公告)号：US09703768B1

公开(公告)日：2017-07-11

申请号：US14501891

申请日：2014-09-30

Applicant: EMC Corporation

Inventor： Stephen G. Graham ,  Shashwat Srivastav

IPC: G06F17/30 ,  G06F17/27

CPC classification number: G06F17/30424

Abstract: An object storage system having object metadata query capability. Clients can pose queries to the object system in a high-level, declarative language. A query is evaluated against stored object metadata, and only objects satisfying the query's predicates are returned. The object storage system can evaluate alternative logical and physical query plans using a cost model. Queries can be posed using familiar REST-based APIs.

公开(公告)号：US11016946B1

公开(公告)日：2021-05-25

申请号：US14674314

申请日：2015-03-31

Applicant: EMC Corporation

Inventor： Stephen G. Graham ,  Eron D. Wright

IPC: G06F16/182 ,  G06F16/951

Abstract: A distributed object store can expose object metadata, in addition to object data, to distributed processing systems, such as Hadoop and Apache Spark. The distributed object store may acts as a Hadoop Compatible File System (HCFS), exposing object metadata as a collection of records that can be efficiently processed by MapReduce (MR) and other distributed processing frameworks. Various metadata records formats are supported. Related methods are also described.

公开(公告)号：US10318491B1

公开(公告)日：2019-06-11

申请号：US14674324

申请日：2015-03-31

Applicant: EMC Corporation

Inventor： Stephen G. Graham ,  Eron D. Wright

IPC: G06F17/30 ,  G06F16/182 ,  G06F16/951

Abstract: A distributed object store can expose object metadata, in addition to object data, to distributed processing systems, such as Hadoop and Apache Spark. The distributed object store may acts as a Hadoop Compatible File System (HCFS), exposing object metadata as a collection of records that can be efficiently processed by MapReduce (MR) and other distributed processing frameworks. A distributed processing job can specify a metadata query to narrow the set of objects returned. Related methods are also described.

公开(公告)号：US10048987B1

公开(公告)日：2018-08-14

申请号：US14976332

申请日：2015-12-21

Applicant: EMC CORPORATION

Inventor： Stephen G. Graham ,  Eric Gelinas ,  Frederic Meunier ,  Alexandre Lemay ,  Raphaël Aubert ,  Salvatore DeSimone ,  Dominique Prunier

IPC: G06F9/46 ,  G06F9/455 ,  G06F9/50 ,  G06F9/48

Abstract: Methods and apparatus for providing resource quality estimation in a resource sharing platform having a master and resources on slaves. Embodiments include storing resource performance data for the resources and estimating resource performance using the stored performance data. A framework can use the estimated resource performance data to select between a first resource offer and a second resource offer, which can be equivalent.