In one implementation, an apparatus is provided for encoding or decoding video information. The apparatus comprises a memory unit configured to store video information associated with a base layer and/or an enhancement layer. The apparatus further comprises a processor operationally coupled to the memory unit. In one embodiment, the processor is configured to determine a scaling factor based on spatial dimension values associated with the base and enhancement layers such that the scaling factor is constrained within a predetermined range. The processor is also configured to spatially scale an element associated with the base layer or enhancement layer using the scaling factor and a temporal motion vector scaling process.