Knowledge graph processing method and device are disclosed. The method includes steps of obtaining an entity set containing a first entity, a second entity, and relation information; acquiring text information and image information related to the first entity and the second entity; generating a first structural information vector of the first entity and a second structural information vector of the second entity, and creating a first text information vector of the first entity, a first image information vector of the first entity, a second text information vector of the second entity, and a second image information vector of the second entity; and building a joint loss function so as to attain a first target vector of the first entity, a second target vector of the second entity, and a target relation vector of the relation information between the first entity and the second entity.