Disclosed herein is a solid-state imaging device, including: a pixel array unit configured to be formed by two-dimensionally arranging unit pixels each having a photoelectric converter, a charge-voltage converter, a reset transistor to set the charge-voltage converter to a predetermined potential, and an amplification transistor to read out a signal converted by the charge-voltage converter; a signal processor configured to process a signal output from the unit pixel by using a reference voltage; and a setter configured to set a reset level obtained from a second unit pixel from which a signal level has been already read out as the reference voltage of the signal processor before readout of a signal level based on a signal charge accumulated or retained in the charge-voltage converter from a first unit pixel.