An inference device connected between a surgical robot and a console controlling the surgical robot, the inference device includes an image acquisition unit acquiring an operative field image shot by an imaging unit of the surgical robot, an inference unit performing an inference process on the acquired operative field image, and a transmission unit transmitting at least one of the operative field image acquired by the image acquisition unit and information based on an inference result by the inference unit to the console according to transmission settings by the console.