SYSTEMS AND METHODS FOR DATA LINKAGE AND ENTITY RESOLUTION OF CONTINUOUS AND UN-SYNCHRONIZED DATA STREAMS

    公开(公告)号:US20230055677A1

    公开(公告)日:2023-02-23

    申请号:US17463989

    申请日:2021-09-01

    Abstract: The present disclosure is directed to a scalable, extensible, fault-tolerant system for stateful joining of two or more streams that are not fully synchronized, event ordering is not guaranteed, and certain events arrive a bit late. The system can ensure to combine the events or link the data in near real-time with low latency to mitigate impacts on downstream applications, such as ML models for determining suspicious behavior. Apart from combining events, the system can ensure to propagate the needed entities to other product streams or help in entity resolution. If any of the needed data is yet to arrive, a user can configure a few parameters to achieve desired eventual and attribute consistency. The architecture is designed to be agnostic of stream processing framework and can work well with both streaming and batch paths.

Patent Agency Ranking