Features are disclosed for identifying randomized latent feature language modeling, such as a recurrent neural network language modeling (RNNLM). Sequences of item identifiers may be provided as the language for training the language model where the item identifiers are the words of the language. To avoid localization bias, the sequences may be randomized prior to or during the training process to provide more accurate prediction models.