公开(公告)号：US11914566B2

公开(公告)日：2024-02-27

申请号：US18138492

申请日：2023-04-24

Applicant: Palantir Technologies Inc.

Inventor： Robert Fink ,  Amr Al Mallah ,  Haithem Turki

IPC: G06F16/21 ,  G06F16/22 ,  G06F16/23 ,  G06F16/245

CPC classification number: G06F16/2272 ,  G06F16/212 ,  G06F16/2228 ,  G06F16/2379 ,  G06F16/245

Abstract: A method is disclosed. The method comprises receiving, from one or more search nodes of a distributed system, one or more requests for log data, the one or more search nodes being associated with one or more hot storage systems; identifying, from an index catalog, an indexed portion of the log data stored in a cold storage system of one or more cold storage systems based on at least part of the particular request, the index catalog containing pointers to indexed portions of the log data in the one or more cold storage systems, the indexing being performed by one or more indexing nodes independently from the receiving by the one or more search nodes; and sending the indexed portion to the one or more search nodes for storage in the associated one or more hot storage systems, wherein the method is performed using one or more processors.

公开(公告)号：US11669507B2

公开(公告)日：2023-06-06

申请号：US17518407

申请日：2021-11-03

Applicant: Palantir Technologies Inc.

Inventor： Robert Fink ,  Amr Al Mallah ,  Haithem Turki

IPC: G06F16/21 ,  G06F16/22 ,  G06F16/23 ,  G06F16/245

CPC classification number: G06F16/2272 ,  G06F16/212 ,  G06F16/2228 ,  G06F16/2379 ,  G06F16/245

Abstract: A method, performed by one or more processors, is disclosed, the method comprising receiving a stream of log data from one or more applications and indexing a plurality of different portions of the received stream to respective locations of a cold storage system. The method may also comprise storing, in an index, catalog pointers to the respective locations of the indexed portions in the cold storage system. One or more requests for log data may be received, and the method may also comprise subsequently identifying from the index catalog one or more pointers to respective indexed portions appropriate to at least part of the one or more requests, and sending of the identified one or more indexed portions to one or more hot storage systems each associated with a respective search node for processing of one or more search requests.

公开(公告)号：US20210157816A1

公开(公告)日：2021-05-27

申请号：US17170564

申请日：2021-02-08

Applicant: Palantir Technologies Inc.

Inventor： Sander Kromwijk ,  Haithem Turki ,  Stephen Cohen ,  Yixun Xu ,  Feridun Arda Kara

IPC: G06F16/2455 ,  G06F16/248 ,  G06F16/245 ,  G06F16/25

Abstract: Systems and methods are provided for performing constraint driven database searching. At least one constraint is received for a search of one or more databases comprising one or more datasets, each comprising multiple entry fields. The one or more databases comprising the one or more datasets may be accessed and searched based on the constraint to identify one or more dataset entries that contain the at least one constraint in one of multiple entry fields. A visual representation of the identified dataset entries may be provided to the user as results of the constraint driven database search. Additional constraints may be accepted to further narrow the results of constraint driven database search. The results may be exported and made accessible for later retrieval and/or cached for use in subsequent searches.

公开(公告)号：US10915536B2

公开(公告)日：2021-02-09

申请号：US16160099

申请日：2018-10-15

Applicant: Palantir Technologies Inc.

Inventor： Sander Kromwijk ,  Haithem Turki ,  Stephen Cohen ,  Yixun Xu ,  Feridun Arda Kara

IPC: G06F16/2455 ,  G06F16/248 ,  G06F16/245 ,  G06F16/25

Abstract: Systems and methods are provided for performing constraint driven database searching. At least one constraint is received for a search of one or more databases comprising one or more datasets, each comprising multiple entry fields. The one or more databases comprising the one or more datasets may be accessed and searched based on the constraint to identify one or more dataset entries that contain the at least one constraint in one of multiple entry fields. A visual representation of the identified dataset entries may be provided to the user as results of the constraint driven database search. Additional constraints may be accepted to further narrow the results of constraint driven database search. The results may be exported and made accessible for later retrieval and/or cached for use in subsequent searches.

公开(公告)号：US20230267109A1

公开(公告)日：2023-08-24

申请号：US18138492

申请日：2023-04-24

Applicant: Palantir Technologies Inc.

Inventor： Robert Fink ,  Amr Al Mallah ,  Haithem Turki

IPC: G06F16/22 ,  G06F16/23 ,  G06F16/245 ,  G06F16/21

CPC classification number: G06F16/2272 ,  G06F16/2379 ,  G06F16/245 ,  G06F16/2228 ,  G06F16/212

Abstract: A method is disclosed. The method comprises receiving, from one or more search nodes of a distributed system, one or more requests for log data, the one or more search nodes being associated with one or more hot storage systems; identifying, from an index catalog, an indexed portion of the log data stored in a cold storage system of one or more cold storage systems based on at least part of the particular request, the index catalog containing pointers to indexed portions of the log data in the one or more cold storage systems, the indexing being performed by one or more indexing nodes independently from the receiving by the one or more search nodes; and sending the indexed portion to the one or more search nodes for storage in the associated one or more hot storage systems, wherein the method is performed using one or more processors.

公开(公告)号：US20220058170A1

公开(公告)日：2022-02-24

申请号：US17518407

申请日：2021-11-03

Applicant: Palantir Technologies Inc.

Inventor： Robert Fink ,  Amr Al Mallah ,  Haithem Turki

IPC: G06F16/22 ,  G06F16/23 ,  G06F16/245 ,  G06F16/21 ,  G06F16/2455

Abstract: A method, performed by one or more processors, is disclosed, the method comprising receiving a stream of log data from one or more applications and indexing a plurality of different portions of the received stream to respective locations of a cold storage system. The method may also comprise storing, in an index, catalog pointers to the respective locations of the indexed portions in the cold storage system. One or more requests for log data may be received, and the method may also comprise subsequently identifying from the index catalog one or more pointers to respective indexed portions appropriate to at least part of the one or more requests, and sending of the identified one or more indexed portions to one or more hot storage systems each associated with a respective search node for processing of one or more search requests.

公开(公告)号：US20180293239A1

公开(公告)日：2018-10-11

申请号：US15484983

申请日：2017-04-11

Applicant: Palantir Technologies Inc.

Inventor： Sander Kromwijk ,  Haithem Turki ,  Stephen Cohen ,  Yixun Xu ,  Feridun Arda Kara

IPC: G06F17/30

CPC classification number: G06F17/3051 ,  G06F17/30424 ,  G06F17/3048 ,  G06F17/30554 ,  G06F17/30566

Abstract: Systems and methods are provided for performing constraint driven database searching. At least one constraint is received for a search of one or more databases comprising one or more datasets, each comprising multiple entry fields. The one or more databases comprising the one or more datasets may be accessed and searched based on the constraint to identify one or more dataset entries that contain the at least one constraint in one of multiple entry fields. A visual representation of the identified dataset entries may be provided to the user as results of the constraint driven database search. Additional constraints may be accepted to further narrow the results of constraint driven database search. The results may be exported and made accessible for later retrieval and/or cached for use in subsequent searches.

公开(公告)号：US12099509B2

公开(公告)日：2024-09-24

申请号：US17170564

申请日：2021-02-08

Applicant: Palantir Technologies Inc.

Inventor： Sander Kromwijk ,  Haithem Turki ,  Stephen Cohen ,  Yixun Xu ,  Feridun Arda Kara

IPC: G06F16/2455 ,  G06F16/245 ,  G06F16/248 ,  G06F16/25

CPC classification number: G06F16/24565 ,  G06F16/245 ,  G06F16/24552 ,  G06F16/248 ,  G06F16/256

Abstract: Systems and methods are provided for performing constraint driven database searching. At least one constraint is received for a search of one or more databases comprising one or more datasets, each comprising multiple entry fields. The one or more databases comprising the one or more datasets may be accessed and searched based on the constraint to identify one or more dataset entries that contain the at least one constraint in one of multiple entry fields. A visual representation of the identified dataset entries may be provided to the user as results of the constraint driven database search. Additional constraints may be accepted to further narrow the results of constraint driven database search. The results may be exported and made accessible for later retrieval and/or cached for use in subsequent searches.

公开(公告)号：US20240184761A1

公开(公告)日：2024-06-06

申请号：US18440724

申请日：2024-02-13

Applicant: Palantir Technologies Inc.

Inventor： Robert Fink ,  Amr Al Mallah ,  Haithem Turki

IPC: G06F16/22 ,  G06F16/21 ,  G06F16/23 ,  G06F16/245

CPC classification number: G06F16/2272 ,  G06F16/212 ,  G06F16/2228 ,  G06F16/2379 ,  G06F16/245

Abstract: A method comprises receiving, from one or more search nodes of a distributed system, one or more requests for log data, the one or more search nodes being associated with one or more first storage systems; identifying an indexed portion of the log data stored in a second storage system of one or more second storage systems based on a particular request of the one or more requests, the log data being indexed by one or more indexing nodes independently from the one or more requests being received and processed by the one or more search nodes; changing a first number of the one or more search nodes and updating a second number of the one or more indexing nodes independently.

公开(公告)号：US11176113B2

公开(公告)日：2021-11-16

申请号：US16003548

申请日：2018-06-08

Applicant: Palantir Technologies Inc.

Inventor： Robert Fink ,  Amr Al Mallah ,  Haithem Turki

IPC: G06F16/22 ,  G06F16/23 ,  G06F16/245 ,  G06F16/21 ,  G06F16/2455

Abstract: A method, performed by one or more processors, is disclosed, the method comprising receiving a stream of log data from one or more applications and indexing a plurality of different portions of the received stream to respective locations of a cold storage system. The method may also comprise storing, in an index, catalog pointers to the respective locations of the indexed portions in the cold storage system. One or more requests for log data may be received, and the method may also comprise subsequently identifying from the index catalog one or more pointers to respective indexed portions appropriate to at least part of the one or more requests, and sending of the identified one or more indexed portions to one or more hot storage systems each associated with a respective search node for processing of one or more search requests.