公开(公告)号：US10169656B2

公开(公告)日：2019-01-01

申请号：US15688131

申请日：2017-08-28

Applicant: NEC Laboratories America, Inc.

Inventor： Dongjin Song ,  Haifeng Chen ,  Guofei Jiang ,  Yao Qin

IPC: G06K9/00 ,  G06N3/02 ,  G06F17/18 ,  G06F15/18 ,  G08B23/00 ,  G08B31/00 ,  G06F17/30 ,  G06N3/04 ,  G06Q10/06

Abstract: Systems and devices including an imaging sensor to capture video sequences in an environment having safety concerns therein. The systems and devices further including a processor to generate driving series based on observations from the video sequences, and generate predictions of future events based on the observations using a dual-stage attention-based recurrent neural network (DA-RNN). The DA-RNN includes an input attention mechanism to extract relevant driving series, an encoder to encode the extracted relevant driving series into hidden states, a temporal attention mechanism to extract relevant hidden states, and a decoder to decode the relevant hidden states. The processor further generates a signal for initiating an action to machines to mitigate harm to items.

公开(公告)号：US20180060666A1

公开(公告)日：2018-03-01

申请号：US15688131

申请日：2017-08-28

Applicant: NEC Laboratories America, Inc.

Inventor： Dongjin Song ,  Haifeng Chen ,  Guofei Jiang ,  Yao Qin

IPC: G06K9/00 ,  G06N3/04 ,  G08B23/00

CPC classification number: G06K9/00718 ,  G06F15/18 ,  G06F17/18 ,  G06F17/30392 ,  G06K9/00744 ,  G06K2009/00738 ,  G06N3/02 ,  G06N3/04 ,  G06N3/049 ,  G06Q10/06375 ,  G06T2207/20084 ,  G08B23/00 ,  G08B31/00

Abstract: Systems and devices including an imaging sensor to capture video sequences in an environment having safety concerns therein. The systems and devices further including a processor to generate driving series based on observations from the video sequences, and generate predictions of future events based on the observations using a dual-stage attention-based recurrent neural network (DA-RNN). The DA-RNN includes an input attention mechanism to extract relevant driving series, an encoder to encode the extracted relevant driving series into hidden states, a temporal attention mechanism to extract relevant hidden states, and a decoder to decode the relevant hidden states. The processor further generates a signal for initiating an action to machines to mitigate harm to items.

公开(公告)号：US20180060665A1

公开(公告)日：2018-03-01

申请号：US15688094

申请日：2017-08-28

Applicant: NEC Laboratories America, Inc.

Inventor： Dongjin Song ,  Haifeng Chen ,  Guofei Jiang ,  Yao Qin

IPC: G06K9/00 ,  G06F17/18 ,  G06F15/18

CPC classification number: G06K9/00718 ,  G06F16/2423 ,  G06F17/18 ,  G06K9/00744 ,  G06K9/6271 ,  G06K2009/00738 ,  G06N3/02 ,  G06N3/04 ,  G06N3/0445 ,  G06N3/0454 ,  G06N3/049 ,  G06N3/084 ,  G06N20/00 ,  G06Q10/06375 ,  G06T2207/20084 ,  G08B23/00 ,  G08B31/00

Abstract: Systems and methods for time series prediction are described. The systems and methods include encoding driving series into encoded hidden states, the encoding including adaptively prioritizing driving series at each timestamp using input attention, the driving series including data sequences collected from sensors. The systems and methods further includes decoding the encoded hidden states to generate a predicting model, the decoding including adaptively prioritizing encoded hidden states using temporal attention. The systems and methods further include generating predictions of future events using the predicting model based on the data sequences. The systems and methods further include generating signals for initiating an action to devices based on the predictions.

公开(公告)号：US10929674B2

公开(公告)日：2021-02-23

申请号：US15688094

申请日：2017-08-28

Applicant: NEC Laboratories America, Inc.

Inventor： Dongjin Song ,  Haifeng Chen ,  Guofei Jiang ,  Yao Qin

IPC: G06N20/00 ,  G06K9/00 ,  G06F17/18 ,  G08B31/00 ,  G06N3/04 ,  G06N3/08 ,  G06K9/62 ,  G08B23/00 ,  G06Q10/06 ,  G06N3/02 ,  G06F16/242

Abstract: Systems and methods for time series prediction are described. The systems and methods include encoding driving series into encoded hidden states, the encoding including adaptively prioritizing driving series at each timestamp using input attention, the driving series including data sequences collected from sensors. The systems and methods further includes decoding the encoded hidden states to generate a predicting model, the decoding including adaptively prioritizing encoded hidden states using temporal attention. The systems and methods further include generating predictions of future events using the predicting model based on the data sequences. The systems and methods further include generating signals for initiating an action to devices based on the predictions.