In a user interface that can identify concurrent pointing at a plurality of given positions on a screen, after detecting that a plurality of pointed positions are concurrently present in a display range of one object on a screen, whether or not an operation of moving the other pointed positions is performed, while keeping at least one pointed position among the plurality of pointed positions, is determined. Then, if it is determined that this operation is performed, the processing that is to be executed is decided based on the number of kept pointed positions and the number of moved pointed positions, and the decided process is executed on the object.