An image processing apparatus and a method of controlling the same are provided. The image processing apparatus includes: one or more receiving units which receive a plurality of contents; a signal processing unit which outputs a first image frame by processing first content of the plurality of contents and outputs a second image frame by processing second content of the plurality of contents; an output unit which outputs a plurality of contents views by combining the first image frame and the second image frame; and a control unit which, if a sharing restriction command regarding a first contents view from among the plurality of contents views is obtained, restricts matching of a glasses apparatus with the first contents view.