Invention Publication
- Patent Title: HIGH-RESOLUTION VIDEO GENERATION USING IMAGE DIFFUSION MODELS
-
Application No.: US18181729Application Date: 2023-03-10
-
Publication No.: US20240171788A1Publication Date: 2024-05-23
- Inventor: Karsten Julian Kreis , Robin Rombach , Andreas Blattmann , Seung Wook Kim , Huan Ling , Sanja Fidler , Tim Dockhorn
- Applicant: NVIDIA Corporation
- Applicant Address: US CA Santa Clara
- Assignee: NVIDIA Corporation
- Current Assignee: NVIDIA Corporation
- Current Assignee Address: US CA Santa Clara
- Main IPC: H04N21/2343
- IPC: H04N21/2343 ; G06T9/00 ; G06V10/24 ; G06V10/25 ; G06V10/82 ; H04N7/01

Abstract:
In various examples, systems and methods are disclosed relating to aligning images into frames of a first video using at least one first temporal attention layer of a neural network model. The first video has a first spatial resolution. A second video having a second spatial resolution is generated by up-sampling the first video using at least one second temporal attention layer of an up-sampler neural network model, wherein the second spatial resolution is higher than the first spatial resolution.
Public/Granted literature
- US12192547B2 High-resolution video generation using image diffusion models Public/Granted day:2025-01-07
Information query