发明申请
- 专利标题: SYSTEM AND METHOD FOR INVESTIGATING LARGE AMOUNTS OF DATA
- 专利标题(中): 用于调查大量数据的系统和方法
-
申请号: US13167680申请日: 2011-06-23
-
公开(公告)号: US20120330908A1公开(公告)日: 2012-12-27
- 发明人: Geoffrey Stowe , Chris Fischer , Paul George , Eli Bingham , Rosco Hill
- 申请人: Geoffrey Stowe , Chris Fischer , Paul George , Eli Bingham , Rosco Hill
- 主分类号: G06F17/30
- IPC分类号: G06F17/30
摘要:
A data analysis system is proposed for providing fine-grained low latency access to high volume input data from possibly multiple heterogeneous input data sources. The input data is parsed, optionally transformed, indexed, and stored in a horizontally-scalable key-value data repository where it may be accessed using low latency searches. The input data may be compressed into blocks before being stored to minimize storage requirements. The results of searches present input data in its original form. The input data may include access logs, call data records (CDRs), e-mail messages, etc. The system allows a data analyst to efficiently identify information of interest in a very large dynamic data set up to multiple petabytes in size. Once information of interest has been identified, that subset of the large data set can be imported into a dedicated or specialized data analysis system for an additional in-depth investigation and contextual analysis.
公开/授权文献
- US08799240B2 System and method for investigating large amounts of data 公开/授权日:2014-08-05
信息查询