MULTI-FRAME OPTICAL FLOW NETWORK WITH LOSSLESS PYRAMID MICRO-ARCHITECTURE

    公开(公告)号:US20230245328A1

    公开(公告)日:2023-08-03

    申请号:US17590998

    申请日:2022-02-02

    CPC classification number: G06T7/269 G06T2207/10016 G06T2207/20081

    Abstract: A method includes obtaining a first optical flow vector representing motion between consecutive video frames during a previous time step. The method also includes generating a first predicted optical flow vector from the first optical flow vector using a trained prediction model, where the first predicted optical flow vector represents predicted motion during a current time step. The method further includes refining the first predicted optical flow vector using a trained update model to generate a second optical flow vector representing motion during the current time step. The trained update model uses the first predicted optical flow vector, a video frame of the previous time step, and a video frame of the current time step to generate the second optical flow vector.

    Multi-frame optical flow network with lossless pyramid micro-architecture

    公开(公告)号:US12148175B2

    公开(公告)日:2024-11-19

    申请号:US17590998

    申请日:2022-02-02

    Abstract: A method includes obtaining a first optical flow vector representing motion between consecutive video frames during a previous time step. The method also includes generating a first predicted optical flow vector from the first optical flow vector using a trained prediction model, where the first predicted optical flow vector represents predicted motion during a current time step. The method further includes refining the first predicted optical flow vector using a trained update model to generate a second optical flow vector representing motion during the current time step. The trained update model uses the first predicted optical flow vector, a video frame of the previous time step, and a video frame of the current time step to generate the second optical flow vector.

    PIXEL BLENDING FOR SYNTHESIZING VIDEO FRAMES WITH OCCLUSION AND WATERMARK HANDLING

    公开(公告)号:US20220303495A1

    公开(公告)日:2022-09-22

    申请号:US17591040

    申请日:2022-02-02

    Abstract: An apparatus includes at least one processing device configured to obtain input frames from a video. The at least one processing device is also configured to generate a forward flow from a first input frame to a second input frame and a backward flow from the second input frame to the first input frame. The at least one processing device is further configured to generate an occlusion map at an interpolated frame coordinate using the forward flow and the backward flow. The at least one processing device is also configured to generate a consistency map at the interpolated frame coordinate using the forward flow and the backward flow. In addition, the at least one processing device is configured to perform blending using the occlusion map and the consistency map to generate an interpolated frame at the interpolated frame coordinate.

Patent Agency Ranking