Invention Grant
- Patent Title: Indexing and relaying data to hot storage
-
Application No.: US16003548Application Date: 2018-06-08
-
Publication No.: US11176113B2Publication Date: 2021-11-16
- Inventor: Robert Fink , Amr Al Mallah , Haithem Turki
- Applicant: Palantir Technologies Inc.
- Applicant Address: US CA Palo Alto
- Assignee: Palantir Technologies Inc.
- Current Assignee: Palantir Technologies Inc.
- Current Assignee Address: US CA Palo Alto
- Agency: Hickman Becker Bingham Ledesma LLP
- Priority: GB1807534 20180509
- Main IPC: G06F16/22
- IPC: G06F16/22 ; G06F16/23 ; G06F16/245 ; G06F16/21 ; G06F16/2455

Abstract:
A method, performed by one or more processors, is disclosed, the method comprising receiving a stream of log data from one or more applications and indexing a plurality of different portions of the received stream to respective locations of a cold storage system. The method may also comprise storing, in an index, catalog pointers to the respective locations of the indexed portions in the cold storage system. One or more requests for log data may be received, and the method may also comprise subsequently identifying from the index catalog one or more pointers to respective indexed portions appropriate to at least part of the one or more requests, and sending of the identified one or more indexed portions to one or more hot storage systems each associated with a respective search node for processing of one or more search requests.
Information query