An article of footwear and a method of manufacturing the article of footwear are disclosed. The footwear may include an upper and a sole structure. The upper incorporates a textile element with edges that are joined together to define at least a portion of a void for receiving a foot. The textile element may also have a first area and a second area with a unitary construction. The first area is formed of a first stitch configuration, and the second area is formed of a second stitch configuration that is different from the first stitch configuration to impart varying textures to a surface of the textile element. Various warp knitting or weft knitting processes may be utilized to form the textile element.