The present invention relates to a method of generating an image scaling curve, where local saliency is detected in a received image. The detected local saliency is then accumulated in the first direction. A final scaling curve is derived from the detected local saliency and the image is then possibly rescaled in a second direction by using the derived scaling curve, wherein the second direction is substantially orthogonal to the first direction.