A mahjong game system using touch panel includes: a computer, and four player consoles in communication with the computer by a wired or wireless communication method. The computer includes a touch panel at the top side for displaying game pictures and a mahjong game program installed therein and providing a speech recognition process for identifying multiple specific voice commands. The four player consoles are individual touch panels having an elongated shape. Each player console defines a tiles-in-hand displaying portion and a command displaying portion. Further, a voice sensor is installed in the computer or each player console.