Disclosed is a method of tracking multiple objects included in an image using a multi-object tracking apparatus including an integrated similarity neural network, the method including setting a tracking area in an input image, extracting at least one object candidate for a target object from the tracking area; extracting reference features for the target object, the object candidate, and the tracking area, selecting two of the target object, the object candidate, and the tracking area to evaluate similarity based on the reference features; allocating the object candidate to the target object on the basis of the evaluated similarity; and tracking the target object on the basis of a location of the allocated object candidate.