A game apparatus includes an inward camera, and a skin color is extracted from an imaged image imaged by the inward camera. During execution of the game, it is determined whether or not a skin color region being above a predetermined ratio is detected at a specific region. If the skin color region is above the predetermined ratio, it is determined the face of a user is correctly recognized, and feature points are detected from the imaged image. By detecting whether or not the entire face of the user is recognized, by detecting a part of the face or its movement, on the basis of the feature points, the game is progressed depending on whether or not a predetermined condition is satisfied. However, if the skin color is equal to or less than the predetermined ratio, it is determined that the face of the user is not correctly recognized, and a determination based on the feature points is not performed.