A solid-state imaging device includes: an imaging portion in which a plurality of pixels for photoelectrically converting incident light are arranged so as to form a plural kinds of pixel lines having different color arrangements; a memory in which pixel signals obtained from the pixels of at least one line in the imaging portion are stored; an output signal line into which the pixel signals stored in the memory are read out; and an output portion from which signals of the output signal line are output. Pixel signals obtained from non-adjacent pixels of a first color in one line are read out into the output signal lines sequentially, and then pixel signals obtained from non-adjacent pixels of a second color are read out into the output signal lines sequentially. Pixel signals of the same color are output sequentially, so that it is not necessary to operate color selection switch for every pixel signals at high speed. Furthermore, it is possible to suppress the mixing of adjacent colors.