A method and a system for handling audio packets in a Voice over Long Term Evolution (VoLTE) call by a User Equipment (UE) when Robust Header Compression (ROHC) is enabled are provided. The Transmission Control Protocol/Internet Protocol (TCP/IP) layer provides the VoLTE call properties to the ROHC compressor. The TCP/IP layer receives the audio packets from audio engine and sends the Real-time Transport Protocol (RTP) packets to a ROHC compressor. Further, the ROHC compressor compresses the Internet Protocol/User Datagram Protocol (IP/UDP) headers and a RTP header. The ROHC compressor sends the compressed RTP data along with a payload to the network in the UpLink (UL) data path. During DownLink (DL) data path, ROHC decompressor receives compressed ROHC packet from network. The ROHC decompressor ignores the construction of IP/UDP headers for the compressed data.