公开(公告)号：US09923794B2

公开(公告)日：2018-03-20

申请号：US14798811

申请日：2015-07-14

Applicant: Huawei Technologies Co., Ltd.

Inventor： Cheng He ,  Qun Huang ,  Pak-Ching Lee

IPC: G06F15/173 ,  H04L12/26 ,  H04L29/06

CPC classification number: H04L43/0882 ,  H04L43/026 ,  H04L43/0888 ,  H04L43/0894 ,  H04L63/1441

Abstract: A method, an apparatus, and a system for identifying an abnormal IP data stream, which are used to improve identification accuracy. The method provided by the embodiments of the present invention includes: receiving Y elements sent by a data collection node; mapping the Y elements to N buckets; acquiring a bucket in the N buckets as a target bucket; acquiring r upper traffic limits of a first object in r buckets within the current time interval, the first object is any object mapped to the target bucket; and identifying, according to a preset abnormal object type and the r upper traffic limits within the current time interval, whether the first object is an abnormal object, where the preset abnormal object type is a heavy hitter or a heavy changer.

公开(公告)号：US11640257B2

公开(公告)日：2023-05-02

申请号：US16259138

申请日：2019-01-28

Applicant: HUAWEI TECHNOLOGIES CO., LTD.

Inventor： Cheng He ,  Qun Huang ,  Pak-Ching Lee

IPC: G06F3/06 ,  G06F11/14

Abstract: In a data processing method, a worker node in a distributed data processing system receives first data from an upstream worker node. The first data has been stored in a buffer of the upstream worker node. The worker node sends a first portion of the first data to a persistent storage device of the distributed data processing system for persistent backup, and performs computational processing on the first data to generate second data. Prior to completing performing computational processing on the first data, the worker node sends acknowledgement information to the upstream worker node to instruct the upstream node to delete the first data from the buffer of the upstream worker node. The worker node then sends the second data to a downstream worker node in the distributed data processing system for further processing by the downstream worker node.

公开(公告)号：US20190171367A1

公开(公告)日：2019-06-06

申请号：US16259138

申请日：2019-01-28

Applicant: HUAWEI TECHNOLOGIES CO.,LTD.

Inventor： Cheng He ,  Qun Huang ,  Pak-Ching Lee

IPC: G06F3/06

Abstract: In a data processing method, a worker node in a distributed data processing system receives first data from an upstream worker node. The first data has been stored in a buffer of the upstream worker node. The worker node sends a first portion of the first data to a persistent storage device of the distributed data processing system for persistent backup, and performs computational processing on the first data to generate second data. Prior to completing performing computational processing on the first data, the worker node sends acknowledgement information to the upstream worker node to instruct the upstream node to delete the first data from the buffer of the upstream worker node. The worker node then sends the second data to a downstream worker node in the distributed data processing system for further processing by the downstream worker node.

公开(公告)号：US11228513B2

公开(公告)日：2022-01-18

申请号：US16776783

申请日：2020-01-30

Applicant: HUAWEI TECHNOLOGIES CO., LTD.

Inventor： Qun Huang ,  Runhui Li ,  Yong Huang ,  Gong Zhang ,  Pak-Ching Lee ,  Lu Tang

IPC: G06F15/173 ,  H04L12/26 ,  H04L9/06 ,  H04L12/717

Abstract: One example packet processing device includes a buffer, and the packet processing device obtains a to-be-measured packet. In response to determining that occupied storage space in the buffer is less than a preset threshold, the packet processing device reads the to-be-measured information from the buffer, and modifies, based on the to-be-measured information and a first algorithm, a pieces of data in first measurement data corresponding to the to-be-measured packet, where a is a positive integer. In response to determining that occupied storage space in the buffer is greater than or equal to a preset threshold, the packet processing device modifies, based on to-be-measured information and a second algorithm, w pieces of data in second measurement data corresponding to the to-be-measured packet, where w is a positive integer, and w is less than a.

公开(公告)号：US11003533B2

公开(公告)日：2021-05-11

申请号：US16369102

申请日：2019-03-29

Applicant: HUAWEI TECHNOLOGIES CO., LTD.

Inventor： Jiajin Zhang ,  Matt M. T. Yiu ,  Pak-Ching Lee

IPC: G11C29/00 ,  G06F11/10 ,  G06F3/06 ,  G06F12/02

Abstract: A data processing method is disclosed, and the method includes: encoding a data chunk of a predetermined size, to generate an error-correcting data chunk corresponding to the data chunk, where the data chunk includes a data object, and the data object includes a key, a value, and metadata; and generating a data chunk index and a data object index, where the data chunk index is used to retrieve the data chunk and the error-correcting data chunk corresponding to the data chunk, the data object index is used to retrieve the data object in the data chunk, and each data object index is used to retrieve a unique data object.

公开(公告)号：US20150319069A1

公开(公告)日：2015-11-05

申请号：US14798811

申请日：2015-07-14

Applicant: Huawei Technologies Co., Ltd.

Inventor： Cheng He ,  Qun Huang ,  Pak-Ching Lee

IPC: H04L12/26

CPC classification number: H04L43/0882 ,  H04L43/026 ,  H04L43/0888 ,  H04L43/0894 ,  H04L63/1441

Abstract: A method, an apparatus, and a system for identifying an abnormal IP data stream, which are used to improve identification accuracy. The method provided by the embodiments of the present invention includes: receiving Y elements sent by a data collection node; mapping the Y elements to N buckets; acquiring a bucket in the N buckets as a target bucket; acquiring r upper traffic limits of a first object in r buckets within the current time interval, the first object is any object mapped to the target bucket; and identifying, according to a preset abnormal object type and the r upper traffic limits within the current time interval, whether the first object is an abnormal object, where the preset abnormal object type is a heavy hitter or a heavy changer.

Abstract translation: 用于识别异常IP数据流的方法，装置和系统，其用于提高识别精度。 本发明实施例提供的方法包括：接收由数据收集节点发送的Y个元素; 将Y元素映射到N个桶; 在N个桶中获取桶作为目标桶; 在当前时间间隔内获取r个桶中第一个对象的上限流量限制，第一个对象是映射到目标桶的任何对象; 根据预设的异常对象类型和当前时间间隔内的上游流量限制来识别第一对象是异常对象，其中预设的异常对象类型是重型打击机还是重型更换器。