Provided are a polarization imaging apparatus, a polarization imaging method, a controller and a computer readable storage medium. The polarization imaging apparatus includes an optical rotation device, a lens device, an image sensor, an image processor, and a controller which are sequentially arranged along a ray direction of incident light. The controller is configured to control the optical rotation device to be in a first optical rotation state or a second optical rotation state, control the lens device to be in an in-focus state or an out-of-focus state, and control the image sensor to collect light passing through the optical rotation device and the lens device to obtain multiple images. The image processor is configured to obtain polarized image information according to the multiple images.