TEMPORAL CONSISTENCY VIA BACKBONE FEATURE FUSION FOR PIXEL-LEVEL PREDICTION TASKS

    公开(公告)号:US20250069247A1

    公开(公告)日:2025-02-27

    申请号:US18943520

    申请日:2024-11-11

    Abstract: Methods and systems for performing video prediction, including obtaining an input frame from among a plurality of frames included in an input video; extracting a first feature map by providing the input frame to a first plurality of feature extraction layers and a first strided convolutional layer included in an encoder; providing the first feature map and at least one neighboring first feature map corresponding to at least one neighboring frame to a first fusion module included in the encoder; fusing the first feature map with the at least one neighboring first feature map to generate a fused first feature map using the first fusion module; generating a prediction corresponding to the input frame based on the fused first feature map using a decoder; and performing a video prediction task using the prediction.

    METHOD AND DEVICE FOR DEEP GUIDED FILTER PROCESSING

    公开(公告)号:US20220301128A1

    公开(公告)日:2022-09-22

    申请号:US17563012

    申请日:2021-12-27

    Abstract: A method of image processing includes: determining a first feature, wherein the first feature has a dimensionality D1; determining a second feature, wherein the second feature has a dimensionality D2 and is based on an output of a feature extraction network; generating a third feature by processing the first feature, the third feature having a dimensionality D3; generating a guidance by processing the second feature, the guidance having the dimensionality D3; generating a filter output by applying a deep guided filter (DGF) to the third feature using the guidance; generating a map based on the filter output; and outputting a processed image based on the map.

Patent Agency Ranking