A rotary damper includes: a shaft having a hollow portion; a pair of side panels; a case provided between the pair of side panels; a vane provided on the shaft so as to divide a first chamber and a second chamber; a liquid chamber defined within the hollow portion; a first partition wall and a second partition wall housed in the hollow portion; a first side valve chamber that is defined by the first partition wall; a second side valve chamber that is defined by the second partition wall; a first side port that connects the first side valve chamber to a second liquid chamber; a second side port that connects the second side valve chamber to the second liquid chamber; a first side damping valve capable of opening and closing the first side port; and a second side damping valve capable of opening and closing the second side port.