A system and method enable an electronic device to perform gaze tracking operations. The electronic device includes one or more cameras and at least one processor. The one or more cameras include a Dynamic Vision Sensor (DVS) camera. The one or more cameras are configured to capture features of an eye of a wearer of the electronic device The processor is configured to receive, from the one or more cameras, an image or pixel stream associated with the eye, determine an initial pose of the eye based on the image or pixel stream, receive DVS pixel data from the DVS camera, track one or more changes to the initial pose of the eye based on the DVS pixel data, and based on the one or more changes to the initial pose of the eye, determine a gaze of the wearer.