A method and a system for controlling a handling machine, and a non-volatile computer readable recording medium are provided. The method includes: analyzing image data to obtain contour data corresponding to a target in the image data; analyzing the contour data to obtain feature data, where the feature data reflects the position of the target in the physical space; and generating control data based on the feature data, where the control data is adapted to control the handling machine to transport the target in response to the position of the target in the physical space.