Invention Grant
- Patent Title: Video system using dual stage attention based recurrent neural network for future event prediction
-
Application No.: US15688131Application Date: 2017-08-28
-
Publication No.: US10169656B2Publication Date: 2019-01-01
- Inventor: Dongjin Song , Haifeng Chen , Guofei Jiang , Yao Qin
- Applicant: NEC Laboratories America, Inc.
- Applicant Address: JP
- Assignee: NEC Corporation
- Current Assignee: NEC Corporation
- Current Assignee Address: JP
- Agent Joseph Kolodka
- Main IPC: G06K9/00
- IPC: G06K9/00 ; G06N3/02 ; G06F17/18 ; G06F15/18 ; G08B23/00 ; G08B31/00 ; G06F17/30 ; G06N3/04 ; G06Q10/06

Abstract:
Systems and devices including an imaging sensor to capture video sequences in an environment having safety concerns therein. The systems and devices further including a processor to generate driving series based on observations from the video sequences, and generate predictions of future events based on the observations using a dual-stage attention-based recurrent neural network (DA-RNN). The DA-RNN includes an input attention mechanism to extract relevant driving series, an encoder to encode the extracted relevant driving series into hidden states, a temporal attention mechanism to extract relevant hidden states, and a decoder to decode the relevant hidden states. The processor further generates a signal for initiating an action to machines to mitigate harm to items.
Public/Granted literature
- US20180060666A1 VIDEO SYSTEM USING DUAL STAGE ATTENTION BASED RECURRENT NEURAL NETWORK FOR FUTURE EVENT PREDICTION Public/Granted day:2018-03-01
Information query