公开(公告)号：US10972713B2

公开(公告)日：2021-04-06

申请号：US16725448

申请日：2019-12-23

Applicant: Massachusetts Institute of Technology

Inventor： Wojciech Matusik ,  Piotr K. Didyk ,  William T. Freeman ,  Petr Kellnhofer ,  Pitchaya Sitthi-Amorn ,  Frederic Durand ,  Szu-Po Wang

IPC: H04N13/111 ,  G06T7/593 ,  H04N13/128 ,  H04N13/106 ,  G06T7/00 ,  H04N13/00

Abstract: A method and system of converting stereo video content to multi-view video content combines an Eulerian approach with a Lagrangian approach. The method comprises generating a disparity map for each of the left and right views of a received stereoscopic frame. For each corresponding pair of left and right scanlines of the received stereoscopic frame, the method further comprises decomposing the left and right scanlines into a left sum of wavelets or other basis functions, and a right sum wavelets or other basis functions. The method further comprises establishing an initial disparity correspondence between left wavelets and right wavelets based on the generated disparity maps, and refining the initial disparity between the left wavelet and the right wavelet using a phase difference between the corresponding wavelets. The method further comprises reconstructing at least one novel view based on the left and right wavelets.

公开(公告)号：US10834372B2

公开(公告)日：2020-11-10

申请号：US16000662

申请日：2018-06-05

Applicant: Massachusetts Institute of Technology

Inventor： Wojciech Matusik ,  Piotr K. Didyk ,  William T. Freeman ,  Petr Kellnhofer ,  Pitchaya Sitthi-Amorn ,  Frederic Durand ,  Szu-Po Wang

IPC: H04N13/111 ,  G06T7/593 ,  H04N13/128

Abstract: A method and system of converting stereo video content to multi-view video content combines an Eulerian approach with a Lagrangian approach. The method comprises generating a disparity map for each of the left and right views of a received stereoscopic frame. For each corresponding pair of left and right scanlines of the received stereoscopic frame, the method further comprises decomposing the left and right scanlines into a left sum of wavelets or other basis functions, and a right sum wavelets or other basis functions. The method further comprises establishing an initial disparity correspondence between left wavelets and right wavelets based on the generated disparity maps, and refining the initial disparity between the left wavelet and the right wavelet using a phase difference between the corresponding wavelets. The method further comprises reconstructing at least one novel view based on the left and right wavelets.

公开(公告)号：US20180352208A1

公开(公告)日：2018-12-06

申请号：US16000662

申请日：2018-06-05

Applicant: Massachusetts Institute of Technology

Inventor： Wojciech Matusik ,  Piotr K. Didyk, Ph.D. ,  William T. Freeman ,  Petr Kellnhofer ,  Pitchaya Sitthi-Amorn ,  Frederic Durand ,  Szu-Po Wang

IPC: H04N13/111 ,  G06T7/593 ,  H04N13/128

Abstract: A method and system of converting stereo video content to multi-view video content combines an Eulerian approach with a Lagrangian approach. The method comprises generating a disparity map for each of the left and right views of a received stereoscopic frame. For each corresponding pair of left and right scanlines of the received stereoscopic frame, the method further comprises decomposing the left and right scanlines into a left sum of wavelets or other basis functions, and a right sum wavelets or other basis functions. The method further comprises establishing an initial disparity correspondence between left wavelets and right wavelets based on the generated disparity maps, and refining the initial disparity between the left wavelet and the right wavelet using a phase difference between the corresponding wavelets. The method further comprises reconstructing at least one novel view based on the left and right wavelets.