Abstract:
The present invention discloses a method and an apparatus for allocating a stream processing unit, and pertains to the field of communications technologies. The method includes: obtaining a parallelism degree and a resource usage rate of a stream processing component on each computing node, and determining the number of stream processing units according to the parallelism degree; generating a stream processing unit to be allocated, and determining a resource usage rate of the stream processing component as a resource usage rate of a corresponding stream processing unit; and allocating, according to a processing capability of the computing node on which the stream processing component is located and a resource usage rate of an allocated stream processing unit, the stream processing unit to be allocated to a corresponding computing node. According to the present invention, the steam data processing efficiency of a distributed stream processing system is improved.
Abstract:
The invention discloses a stream processing method, which includes: receiving a first stream processing task including one or more stream processing components, a data input and output relationship of the stream processing component, and an identifier of a stream data source; calculating a computing resource required by each stream processing component; and if the first stream processing task includes a first stream processing component which does not meet a preset constraint condition, duplicating the first stream processing component to obtain at least one second stream processing component, so that the data may be allocated to the first stream processing component and the second stream processing component(s), which reduce a probability that system instability and a data processing fault are caused.
Abstract:
A method and an apparatus for identifying a state of a user of a social network. The identification method includes acquiring a user-event similarity of a user regarding a new event; identifying whether the user is a silent user or a non-activated user according to the user-event similarity; and determining whether the silent user or the non-activated user on the social network is finally in an activated state or a non-activated state. In the foregoing manner, a novel user state model of a social network is designed in the present disclosure, the model includes an activated state, a non-activated state and an unstable silent state, and a final state of a user is inferred precisely under full and comprehensive consideration of factors that may affect the state of the user, such that the state of the user can be accurately and precisely monitored.
Abstract:
A method and an apparatus for identifying a state of a user of a social network. The identification method includes acquiring a user-event similarity of a user regarding a new event; identifying whether the user is a silent user or a non-activated user according to the user-event similarity; and determining whether the silent user or the non-activated user on the social network is finally in an activated state or a non-activated state. In the foregoing manner, a novel user state model of a social network is designed in the present disclosure, the model includes an activated state, a non-activated state and an unstable silent state, and a final state of a user is inferred precisely under full and comprehensive consideration of factors that may affect the state of the user, such that the state of the user can be accurately and precisely monitored.
Abstract:
The present invention discloses a method and an apparatus for allocating a stream processing unit, and pertains to the field of communications technologies. The method includes: obtaining a parallelism degree and a resource usage rate of a stream processing component on each computing node, and determining the number of stream processing units according to the parallelism degree; generating a stream processing unit to be allocated, and determining a resource usage rate of the stream processing component as a resource usage rate of a corresponding stream processing unit; and allocating, according to a processing capability of the computing node on which the stream processing component is located and a resource usage rate of an allocated stream processing unit, the stream processing unit to be allocated to a corresponding computing node. According to the present invention, the steam data processing efficiency of a distributed stream processing system is improved.