An optical pointing device for detecting the direction of the user's finger is provided. The optical pointing device comprises a cover, a light source and a sensor. The cover comprises a press portion with a first surface and a second surface opposite the first surface, as well as a side wall extending downwards from the periphery of the second surface. The light source projects a main beam onto the press portion of the cover. The main beam then forms a first beam passing through the press portion and a second beam reflected by the second surface. The sensor is adapted to receive the second beam reflected by the second surface, and detect the second beam by an algorithm to output the first displacement position. In addition, the light source and the sensor are covered by the cover, while the side wall is a flexible side wall.