A remote control device and a remote control method thereof are provided. The remote control method is adapted to a remote control device, which includes a sensing unit for generating remote controlling signals while shaking the remote control device. The remote control method includes the following steps. Firstly, a series of sensing signal is provided by the sensing unit. Next, a series of reference value is generated according to the series of sensing signal. Then, when to start/stop to store the series sensing signal is determined according to the series of reference value. Afterwards, the series of sensing signal is recognized for generating the remote controlling signal. Finally, the remote controlling signal is transmitted.