The disclosure relates to a communication technique and a system thereof that fuses a 5G communication system for supporting higher data rate after a 4G system. The disclosure is enabled to be applied to intelligent services (for example, smart home, smart building, smart city, smart car or connected car, health care, digital education, retail, security and safety related services, etc.) based on 5G communication technology and IoT related technology. A method for performing a random access by a terminal is provided. The method includes receiving information for performing a random access from a base station (BS), determining a frequency band to perform the random access among a first frequency band and a second frequency band based on the information for performing the random access, and transmitting a first random access preamble to the BS on the determined frequency band.