Embodiments of the present disclosure provide a cross-modality processing method, a cross-modality processing apparatus, an electronic device, and a computer storage medium, and relate to a field of natural language processing technologies. The method includes: obtaining (101) a sample set; generating (102) a plurality of training samples according to the sample set; adopting (103) the plurality of the training samples to train a semantic model, so that the semantic model learns semantic vectors containing combinations of the corpus and the images. Therefore, the training effect of the semantic model is improved, and in the related art, when multi-modal processing is performed, each modal is separately trained, and the semantic relations between different modals are isolated, thus the effect of the trained model is poor.