Invention Grant
- Patent Title: Scene annotation using machine learning
-
Application No.: US16177214Application Date: 2018-10-31
-
Publication No.: US11636673B2Publication Date: 2023-04-25
- Inventor: Sudha Krishnamurthy , Justice Adams , Arindam Jati , Masanori Omote , Jian Zheng
- Applicant: Sony Interactive Entertainment Inc.
- Applicant Address: JP Tokyo
- Assignee: Sony Interactive Entertainment Inc.
- Current Assignee: Sony Interactive Entertainment Inc.
- Current Assignee Address: JP Tokyo
- Agency: JDI Patent
- Agent Joshua Isenberg; Robert Pullman
- Main IPC: G06V20/20
- IPC: G06V20/20 ; G06N3/04 ; G06F16/65 ; G10L13/02 ; G10L15/16 ; G10L15/26 ; A63F13/60 ; G06N3/045

Abstract:
A system enhances existing audio-visual content with audio describing the setting of the visual content. A scene annotation module classifies scene elements from an image frame received from a host system and generates a caption describing the scene elements. A text to speech synthesis module may then convert the caption to synthesized speech data describing the scene elements within the image frame
Information query