Techniques facilitating attention based sequential image processing are provided. A system can comprise a memory that stores computer executable components and a processor that executes the computer executable components stored in the memory. The computer executable components can comprise an initialization component that can perform self-attention based training on a model that comprises context information associated with a sequence of images. Images of the sequence of images can be selected during the self-attention based training. The computer executable components can also comprise a localization component that can extract local information from the images selected during the self-attention based training based on the context information. In addition, the computer executable components can also comprise an integration component that can update the model based on an end-to-end integrated attention training framework comprising the context information and the local information.