Pluggable fault detection tests for data pipelines

    公开(公告)号:US10936479B2

    公开(公告)日:2021-03-02

    申请号:US16572404

    申请日:2019-09-16

    Abstract: Discussed herein are embodiments of methods and systems which allow engineers or administrators to create modular plugins which represent the logic for various fault detection tests that can be performed on data pipelines and shared among different software deployments. In some cases, the modular plugins each define a particular test to be executed against data received from the pipeline in addition to one or more configuration points. The configuration points represent configurable arguments, such as variables and/or functions, referenced by the instructions which implement the tests and that can be set according to the specific operation environment of the monitored pipeline.

    Version control machine
    15.
    发明授权

    公开(公告)号:US10827036B2

    公开(公告)日:2020-11-03

    申请号:US15479395

    申请日:2017-04-05

    Abstract: Aspects of the present disclosure relate to version control. A version control server receives, from a client device, a request for making changes to a portion of data stored in a data store. The version control server verifies that the client device has permission to make the changes to the portion of the data stored in the data store. The version control server updates, using a version control servlet, the data store according to the request. The version control sever creates, forks, merges or deletes, using a repository management API (application programming interface), a repository and/or the files in the repository in the data store based on the request. The version control server triggers, using the repository management API, one or more webhooks in response to the request.

    TECHNIQUES FOR DATA EXTRACTION
    16.
    发明申请

    公开(公告)号:US20190034488A1

    公开(公告)日:2019-01-31

    申请号:US16147687

    申请日:2018-09-29

    Abstract: Computer-implemented techniques for data extraction are described. The techniques include a method and system for retrieving an extraction job specification, wherein the extraction job specification comprises a source repository identifier that identifies a source repository comprising a plurality of data records; a data recipient identifier that identifies a data recipient; and a schedule that indicates a timing of when to retrieve the plurality of data records. The method and system further include retrieving the plurality of data records from the source repository based on the schedule, creating an extraction transaction from the plurality of data records, wherein the extraction transaction comprises a subset of the plurality of data records and metadata, and sending the extraction transaction to the data recipient.

    TECHNIQUES FOR DATA EXTRACTION
    17.
    发明申请

    公开(公告)号:US20180032575A1

    公开(公告)日:2018-02-01

    申请号:US15225437

    申请日:2016-08-01

    CPC classification number: G06F17/30477 G06F17/30533 G06F17/30563

    Abstract: Computer-implemented techniques for data extraction are described. The techniques include a method and system for retrieving an extraction job specification, wherein the extraction job specification comprises a source repository identifier that identifies a source repository comprising a plurality of data records; a data recipient identifier that identifies a data recipient; and a schedule that indicates a timing of when to retrieve the plurality of data records. The method and system further include retrieving the plurality of data records from the source repository based on the schedule, creating an extraction transaction from the plurality of data records, wherein the extraction transaction comprises a subset of the plurality of data records and metadata, and sending the extraction transaction to the data recipient.

Patent Agency Ranking