Implementations of the disclosure describe inferring social groups through patterns of communication. A method of the disclosure includes ascertaining, by a processing device, a proposed group of contacts from contacts of the user based on a correlation in geographic locations of communications between the user and the proposed group of contacts and a correlation in a type of medium of the communications, providing a recommendation that the user create a new list of contacts associated with the user from the proposed group of contacts, and responsive to the user indicating acceptance of the recommendation, creating the new list of contacts associated with the user from the proposed group.