Methods and apparatuses for handling collision between sidelink feedback and sidelink data in a wireless communication system are disclosed herein. In one method, a User Equipment (UE) is (pre-)configured to perform one or more sidelink transmissions on multiple carriers, wherein the UE is able to transmit a first number of carriers among the multiple carriers at the same time. The UE selects a first resource for transmitting a first sidelink transmission in a first slot on a first carrier. The UE derives a second resource for transmitting a PSFCH delivering a feedback in a second slot on a second carrier, wherein the second slot is at least partly overlapping with the first slot in a time domain. The UE determines whether to prioritize either the PSFCH or the first sidelink transmission based on a rule when the number of carriers which the UE identifies to transmit in the overlapped slot exceeds the first number of carriers.