An implantable hearing aid transducer is provided that allows providing movement for stimulation purposes in at least first and second directions. This allows for moving an auditory component in a direction that may be substantially aligned with a natural direction of movement for the auditory component. In one arrangement, a middle ear transducer having an elongated vibratory member that extends into a patient's tympanic cavity is operative to move a tip of the vibratory member in at least first and second directions. A first direction may be along a long axis of the vibratory member while a second direction may be in a direction that is at least partially transverse to the long axis of the vibratory member. Further, the transducer may be positionable to provide alignment of the vibratory member such that the transverse direction of movement is substantially aligned with a direction of natural movement of a middle ear component (e.g. ossicles bone) to be stimulated.