The present disclosure relates to systems, methods, and non-transitory computer-readable media that generates a multi-modal vector and identifies a recommended font corresponding to the source font based on the multi-modal vector. For instance, in one or more embodiments, the disclosed systems receive an indication of a source font and determines font embeddings and glyph metrics embedding. Furthermore, the disclosed system generates, utilizing a multi-modal font machine-learning model, a multi-modal vector representing the source font based on the font embeddings and the glyph metrics embedding.