An interactive 3D display apparatus and method are provided. The interactive 3D display apparatus includes a hand sensing module configured to acquire a hand image by detecting a hand of a user and a user interaction module configured to generate a virtual object adjustment parameter by analyzing user-intended information about the hand based on the hand image acquired by the hand sensing module and comparing an analysis result with predefined user scenarios, an image rendering module configured to set a scene according to the generated virtual object adjustment parameter, generate image data by rendering the set scene, and convert the generated image data into display data, and a 3D display configured to display a 3D image including a virtual object in which a change intended by the user has been reflected according to the display data.