Invention Grant
- Patent Title: Video depth estimation based on temporal attention
-
Application No.: US16841618Application Date: 2020-04-06
-
Publication No.: US11527005B2Publication Date: 2022-12-13
- Inventor: Haoyu Ren , Mostafa El-Khamy , Jungwon Lee
- Applicant: Samsung Electronics Co., Ltd.
- Applicant Address: KR Suwon-si
- Assignee: Samsung Electronics Co., Ltd.
- Current Assignee: Samsung Electronics Co., Ltd.
- Current Assignee Address: KR Suwon-si
- Agency: Lewis Roca Rothgerber Christie LLP
- Main IPC: G06T7/579
- IPC: G06T7/579 ; G06T7/194 ; G06T3/00

Abstract:
A method of depth detection based on a plurality of video frames includes receiving a plurality of input frames including a first input frame, a second input frame, and a third input frame respectively corresponding to different capture times, convolving the first to third input frames to generate a first feature map, a second feature map, and a third feature map corresponding to the different capture times, calculating a temporal attention map based on the first to third feature maps, the temporal attention map including a plurality of weights corresponding to different pairs of feature maps from among the first to third feature maps, each weight of the plurality of weights indicating a similarity level of a corresponding pair of feature maps, and applying the temporal attention map to the first to third feature maps to generate a feature map with temporal attention.
Public/Granted literature
- US20210027480A1 VIDEO DEPTH ESTIMATION BASED ON TEMPORAL ATTENTION Public/Granted day:2021-01-28
Information query