Invention Application
- Patent Title: VIDEO GENERATION METHOD AND SYSTEM FOR HIGH RESOLUTION FACE SWAPPING
-
Application No.: US17623247Application Date: 2021-08-09
-
Publication No.: US20230112462A1Publication Date: 2023-04-13
- Inventor: Qi LI , Zhenan SUN , Yuhao ZHU
- Applicant: INSTITUTE OF AUTOMATION, CHINESE ACADEMY OF SCIENCES
- Applicant Address: CN Beijing
- Assignee: INSTITUTE OF AUTOMATION, CHINESE ACADEMY OF SCIENCES
- Current Assignee: INSTITUTE OF AUTOMATION, CHINESE ACADEMY OF SCIENCES
- Current Assignee Address: CN Beijing
- Priority: CN202110127788.2 20210129
- International Application: PCT/CN2021/111577 WO 20210809
- Main IPC: G11B27/031
- IPC: G11B27/031 ; G06V20/40 ; G06V40/16 ; G06V10/26 ; G06V20/70 ; G06V10/774 ; G06V10/80

Abstract:
A video generation method includes: obtaining a target face image and a source face image; extracting a feature of each of the source face image and the target face image through a face feature encoder, to obtain corresponding source feature codes and target feature codes; generating swapped face feature codes through a face feature exchanger according to the source feature codes and the target feature codes; generating an initial swapped face image through a face generator according to the swapped face feature codes; and fusing the initial swapped face image with the target face image through a face fuser, to obtain a final swapped face image. The face feature encoder performs hierarchical encoding on the face feature to reserve semantic details of a face, and the face feature exchanger performs further processing based on the hierarchical encoding, to obtain hierarchical encoding of a swapped face feature with semantic details.
Public/Granted literature
- US11776576B2 Video generation method and system for high resolution face swapping Public/Granted day:2023-10-03
Information query
IPC分类: