A method and apparatus for detecting and recognizing an object using a vector histogram based on a local binary pattern are disclosed. The apparatus of detecting and recognizing an object using a local binary pattern includes: a feature map creator configured to extract an object area in which a moving object exists from an input image, to create a local binary pattern by designating a local area in the object area, and to create a vector component map including information about magnitude vector components and direction vector components using the local binary pattern; a feature map configuring unit configured to divide the object area into a plurality of blocks and to create a feature vector map through a histogram using the vector component map in a unit of the block; and an object detector configured to detect and classify the moving object based on the feature vector map.