A control device for reducing and homogenizing welding residual stress by acoustic waves, comprising: a fixing tool having two rows of through holes; a plurality of ultrasonic transducers each having a body and a conical horn transmitting portion at a lower end of the body, wherein lower ends of the horn transmitting portions are fixedly connected with flanges, the horn transmitting portions of the ultrasonic transducers extend into respective through holes of the fixing tool to be in contact with welded parts below the fixing tool, the flanges are fixed to the fixing tool by bolts, and the two rows of through holes are arranged both sides of a welding seam of the welded parts; and a driving device for driving the ultrasonic transducers to operate. A corresponding control method is also provided. The control device can be used to control residual stress at the welding seam of steels.