A portable device, a display apparatus, a display system, and a method for controlling power of a display apparatus thereof are provided. The method includes sensing, while a portable device operates in a standby mode, a movement of the portable device using a motion sensor, converting, using the portable device, the standby mode of the portable device into a normal mode in response to the movement of the portable device being sensed, generating, using the portable device, a pre-power on signal in response to the standby mode being converted into the normal mode, transmitting the pre-power on signal to the display apparatus, and activating, by the display apparatus, some elements of the display apparatus in response to the pre-power on signal being received.