Invention Grant
- Patent Title: Method and system to estimate the cardinality of sets and set operation results from single and multiple HyperLogLog sketches
-
Application No.: US17358170Application Date: 2021-06-25
-
Publication No.: US11561954B2Publication Date: 2023-01-24
- Inventor: Otmar Ertl
- Applicant: Dynatrace LLC
- Applicant Address: US MA Waltham
- Assignee: Dynatrace LLC
- Current Assignee: Dynatrace LLC
- Current Assignee Address: US MA Waltham
- Agency: Harness, Dickey & Pierce, P.L.C.
- Main IPC: G06F16/22
- IPC: G06F16/22 ; G06N7/00 ; G06F16/23 ; G06F17/18

Abstract:
A system and method for the estimation of the cardinality of large sets of transaction trace data is disclosed. The estimation is based on HyperLogLog data sketches that are capable to store cardinality relevant data of large sets with low and fixed memory requirements. The disclosure contains improvements to the known analysis methods for HyperLogLog data sketches that provide improved relative error behavior by eliminating a cardinality range dependent bias of the relative error. A new analysis method for HyperLogLog data structures is shown that uses maximum likelihood analysis methods on a Poisson based approximated probability model. In addition, a variant of the new analysis model is disclosed that uses multiple HyperLogLog data structured to directly provide estimation results for set operations like intersections or relative complement directly from the HyperLogLog input data.
Public/Granted literature
Information query