A method for controlling polishing and grinding is provided, including: generating an initial polishing and grinding trajectory for robot movements based on a three-dimensional contour of a work piece; adjusting the initial polishing and grinding trajectory based on a first optimized adjustment value and generating an optimized polishing and grinding trajectory; and evaluating the polishing and grinding quality of the work piece and using the polishing and grinding quality to generate a second optimized adjustment value.