An information processing device for analyzing motion and color of an image of a program and detecting shot sound and cheering of golf includes an extraction unit that extracts a notable interval which is a notable time interval of the program based on the motion of the image, a computation unit that computes a play scene level indicating a degree to which the notable interval is a play scene of the golf based on the motion, color and shot sound of the notable interval extracted by the extraction unit, and a determination unit that determines whether or not the notable interval is a play scene of the golf based on the play scene level computed by the computation unit.