An electronic apparatus, control method thereof, remote control apparatus that controls the electronic apparatus, and control method thereof. The remote control apparatus includes a communication unit which communicates with the electronic apparatus; a user input unit which receives a user button selection indicating an input button; a sensing unit which senses movement of the remote control apparatus; and a control unit which controls the communication unit to transmit information about the user button selection to perform a function corresponding to the input button if the remote control apparatus is in a button input mode, and to transmit information about the movement of the remote control apparatus to the electronic apparatus to control the electronic apparatus by the movement if the remote control apparatus is in a motion recognition mode. Accordingly, controlling a game or a multimedia content is easier, and the user is provided with a new and interesting experience.