Invention Grant
US08527448B2 System, method and apparatus for increasing speed of hierarchial latent dirichlet allocation model
有权
用于提高分层潜伏Dirichlet分配模型速度的系统,方法和装置
- Patent Title: System, method and apparatus for increasing speed of hierarchial latent dirichlet allocation model
- Patent Title (中): 用于提高分层潜伏Dirichlet分配模型速度的系统,方法和装置
-
Application No.: US13722078Application Date: 2012-12-20
-
Publication No.: US08527448B2Publication Date: 2013-09-03
- Inventor: Kopylov Vladislav , Liufei Wen , Guangyu Shi
- Applicant: Huawei Technologies Co., Ltd.
- Applicant Address: CN Shenzhen
- Assignee: Huawei Technologies Co., Ltd.
- Current Assignee: Huawei Technologies Co., Ltd.
- Current Assignee Address: CN Shenzhen
- Priority: CN201110424177 20111216
- Main IPC: G06F9/44
- IPC: G06F9/44 ; G06N7/02 ; G06N7/06 ; G06F15/18 ; G06F7/00 ; G06F17/30

Abstract:
Embodiments of the present invention disclose a data processing method including: sending global initial statistical information to each slave node; merging received local statistical information of each slave node, to obtain new global statistical information; if Gibbs sampling performed by a slave node has ended, calculating a probability distribution between a document and topic and a probability distribution between the topic and a word according to the new global statistical information; according to the probability distributions obtained through calculation, establishing a likelihood function of a text set, and maximizing the likelihood function, to obtain a new hLDA hyper-parameter; and if iteration of solving for an hLDA hyper-parameter has converged, and according to the new hLDA hyper-parameter, calculating and outputting the probability distribution between the document and topic and the probability distribution between the topic and word.
Public/Granted literature
- US20130159236A1 DATA PROCESSING METHOD AND SYSTEM, AND RELEVANT APPARARTUS Public/Granted day:2013-06-20
Information query