Sorted parallel processing of a large dataset

    公开(公告)号:US11055685B2

    公开(公告)日:2021-07-06

    申请号:US16453947

    申请日:2019-06-26

    Abstract: Disclosed herein are system, method, and computer program product embodiments for sorted parallel processing of large dataset to provide quicker search results to a user. An embodiment operates by receiving a search request containing a first attribute from a user, determining an intermediate result set of items in a database based on the search request, and sorting the items based on a second attribute of the items. The embodiment further operates by dividing the sorted items into a plurality of batches with sequential IDs, determining a result corresponding to the first attribute for each item in parallel, creating a sequentially-ordered list of determined results, identifying a subset of determined results based on a comparison between the determined results and a target result, determining a final result set of items, and returning at least a portion of the final result set of items to the user.

    Scaling by dynamic discovery for data processing

    公开(公告)号:US10984009B2

    公开(公告)日:2021-04-20

    申请号:US16848230

    申请日:2020-04-14

    Abstract: Aspects described herein may relate to methods, systems, and apparatuses that partitions searchable content and distributes the segments across a plurality of processing nodes, which in turn further sub-partitions the partitions for processing by local search actor in order to increase the speed with which a search request from a user is processed. Processing nodes available to receive partitioned searchable content are registered with an external storage device. The external storage device also maintains a global results collector that compiles results from the partitions of searchable content. Respective local collector actors receive compiled results from local search actors for a processing node and the compiled results are sent to the global results collector for compiling for the plurality of processing nodes. Results of the user search request are then provided to the user.

Patent Agency Ranking