- 专利标题: METHOD AND SYSTEM FOR LATENT-SPACE FACIAL FEATURE EDITING IN DEEP LEARNING BASED FACE SWAPPING
-
申请号: US17707782申请日: 2022-03-29
-
公开(公告)号: US20230316587A1公开(公告)日: 2023-10-05
- 发明人: Sirak Ghebremusse , Stéphane Grabli , Jacek Krzysztof Naruniec , Romann Matthew Weber , Christopher Richard Schroers
- 申请人: LUCASFILM ENTERTAINMENT COMPANY LTD. LLC , DISNEY ENTERPRISES, INC
- 申请人地址: US CA San Francisco
- 专利权人: LUCASFILM ENTERTAINMENT COMPANY LTD. LLC,DISNEY ENTERPRISES, INC
- 当前专利权人: LUCASFILM ENTERTAINMENT COMPANY LTD. LLC,DISNEY ENTERPRISES, INC
- 当前专利权人地址: US CA San Francisco; US CA Burbank
- 主分类号: G06T9/00
- IPC分类号: G06T9/00 ; G06V40/16 ; G06T11/00 ; G06T7/70
摘要:
A computer-implemented method of changing a face within an output image or video frame that includes: receiving an input image that includes a face presenting a facial expression in a pose; processing the image with a neural network encoder to generate a latent space point that is an encoded representation of the image; decoding the latent space point to generate an initial output image in accordance with a desired facial identity but with the facial expression and pose of the face in the input image; identifying a feature of the facial expression in the initial output image to edit; applying an adjustment vector to a latent space point corresponding to the initial output image to generate an adjusted latent space point; and decoding the adjusted latent space point to generate an adjusted output image in accordance with the desired facial identity but with the facial expression and pose of the face in the input image altered in accordance with the adjustment vector
信息查询