Methods, systems, and devices for data processing are described. According to the techniques described herein, a sequential model may be trained using data of different modalities to be used for event recommendation or prediction for an entity or attendee of a future event. Encoders may be used to encode entity data and event data of different data types, and the encoded data may be used to generate vectors for input to a multimodal Transformer. A segment mask may be generated for each of a set of vectors corresponding to the entity and a set of vectors corresponding to an event sequence associated with the entity. The segment masks and sets of vectors may be used to generate embeddings to train the sequential model.