The present disclosure relates to a pre-5th-Generation (5G) or 5G communication system to be provided for supporting higher data rates Beyond 4th-Generation (4G) communication system such as Long Term Evolution (LTE). Embodiments of the present invention provide beamforming transmitting/receiving apparatus and method to use in Multiple Input Multiple Output (MIMO)-based wireless communication systems. According to an embodiment of the present invention, a method for operating a transmitting node in a wireless communication system is provided. The method includes determining at least one transmit beam candidate from a plurality of transmit beams and at least one receive beam candidate from a plurality of receive beams, determining an optimal beam pair from pairs of the transmit beam candidates and the receive beam candidates, and transmitting/receiving data with a receiving node based on the optimal beam pair.