A method and a device for determining similarity between sequences are provided. The method includes obtaining a first sequence of frames and a second sequence of frames, determining a descriptor of a first frame of the first sequence based on luma information of blocks in the first frame, the descriptor of the first frame including luma difference information that is determined based on the luma information of the blocks in the first frame, determining a descriptor of a second frame of the second sequence based on luma information of blocks in the second frame, the descriptor of the second frame including luma difference information that is determined based on the luma information of the blocks in the second frame, and determining a similarity between the first sequence and the second sequence based on the descriptor of the first frame and the descriptor of the second frame.