Invention Grant
US08527448B2 System, method and apparatus for increasing speed of hierarchial latent dirichlet allocation model 有权
用于提高分层潜伏Dirichlet分配模型速度的系统,方法和装置

System, method and apparatus for increasing speed of hierarchial latent dirichlet allocation model
Abstract:
Embodiments of the present invention disclose a data processing method including: sending global initial statistical information to each slave node; merging received local statistical information of each slave node, to obtain new global statistical information; if Gibbs sampling performed by a slave node has ended, calculating a probability distribution between a document and topic and a probability distribution between the topic and a word according to the new global statistical information; according to the probability distributions obtained through calculation, establishing a likelihood function of a text set, and maximizing the likelihood function, to obtain a new hLDA hyper-parameter; and if iteration of solving for an hLDA hyper-parameter has converged, and according to the new hLDA hyper-parameter, calculating and outputting the probability distribution between the document and topic and the probability distribution between the topic and word.
Public/Granted literature
Information query
Patent Agency Ranking
0/0