Invention Grant
- Patent Title: Two-stage online detection of action start in untrimmed videos
-
Application No.: US16394964Application Date: 2019-04-25
-
Publication No.: US11232308B2Publication Date: 2022-01-25
- Inventor: Mingfei Gao , Richard Socher , Caiming Xiong
- Applicant: salesforce.com, inc.
- Applicant Address: US CA San Francisco
- Assignee: salesforce.com, inc.
- Current Assignee: salesforce.com, inc.
- Current Assignee Address: US CA San Francisco
- Agency: Haynes and Boone, LLP
- Main IPC: G06K9/00
- IPC: G06K9/00 ; G06K9/62 ; G06N3/04 ; G06N3/08 ; G06N3/00

Abstract:
Embodiments described herein provide a two-stage online detection of action start system including a classification module and a localization module. The classification module generates a set of action scores corresponding to a first video frame from the video, based on the first video frame and video frames before the first video frames in the video. Each action score indicating a respective probability that the first video frame contains a respective action class. The localization module is coupled to the classification module for receiving the set of action scores from the classification module and generating an action-agnostic start probability that the first video frame contains an action start. A fusion component is coupled to the localization module and the localization module for generating, based on the set of action scores and the action-agnostic start probability, a set of action-specific start probabilities, each action-specific start probability corresponding to a start of an action belonging to the respective action class.
Public/Granted literature
- US20200302178A1 Two-Stage Online Detection of Action Start In Untrimmed Videos Public/Granted day:2020-09-24
Information query