- 专利标题: Image synthesis method, apparatus and device for free-viewpoint
-
申请号: US16610296申请日: 2019-02-14
-
公开(公告)号: US11368661B2公开(公告)日: 2022-06-21
- 发明人: Ronggang Wang , Sheng Wang , Zhenyu Wang , Wen Gao
- 申请人: PEKING UNIVERSITY SHENZHEN GRADUATE SCHOOL
- 申请人地址: CN Shenzhen
- 专利权人: PEKING UNIVERSITY SHENZHEN GRADUATE SCHOOL
- 当前专利权人: PEKING UNIVERSITY SHENZHEN GRADUATE SCHOOL
- 当前专利权人地址: CN Shenzhen
- 代理机构: Miles & Stockbridge P.C.
- 国际申请: PCT/CN2019/075056 WO 20190214
- 国际公布: WO2020/164044 WO 20200820
- 主分类号: H04N13/128
- IPC分类号: H04N13/128 ; G06T7/215 ; H04N13/156 ; H04N13/344 ; H04N13/00
摘要:
The embodiment of the present specification discloses an image synthesis method, apparatus and device for free-viewpoint. The method includes: correcting a first depth map based on a first color map and the first depth map inputted, wherein the first color map includes a left image and a right image, and the first depth map includes a left image and a right image; forward-projecting the second depth map to a virtual viewpoint position based on the pose of a virtual viewpoint to obtain a third depth map, where the third depth map is a projection map located at the virtual viewpoint position; back-projecting the left and right color maps closest to the virtual viewpoint position in the first color map to the virtual viewpoint position based on the third depth map to obtain a second color map, where the second color map is a projection view of the first color map at the virtual viewpoint position; correcting the second color map by using an optical flow algorithm to obtain a third color map, where the optical flow algorithm implements aligning the left and right images of the second color map; performing weighting calculation and blendering on the third color map to obtain a composite image.
公开/授权文献
信息查询