公开(公告)号：US20190035055A1

公开(公告)日：2019-01-31

申请号：US16069183

申请日：2016-01-13

Applicant: SHANGHAITECH UNIVERSITY

Inventor： Jingyi YU ,  Yi MA

IPC: G06T3/40 ,  H04N5/232 ,  H04N13/243 ,  G06T3/00 ,  H04N13/128 ,  G06K9/62

Abstract: A method of generating a stereoscopic panorama is provided, the method comprising: processing a first right image, a second right image, a first left image, and a second left image to derive a right homography between the first right image and the second right image and a left homography between the first left image and the second left image; stitching the first right image with the second right image to generate a right panorama, the first left image with the second left image to generate a left panorama wherein the right homography is consistent with the left homography; and generating a stereo panorama using the right panorama and the left panorama. The method further comprises capturing the first right image, the second right image, the first left image, and the second left image using a camera array comprising a first right camera, a second right camera, a first left camera, and a second left camera, wherein a relative position between the first right camera and the second right camera is substantially the same as a relative position between the first left camera and the second left camera, and the first right camera and the second right camera comprise parallel optical axes.

公开(公告)号：US20210241462A1

公开(公告)日：2021-08-05

申请号：US17219555

申请日：2021-03-31

Applicant: SHANGHAITECH UNIVERSITY

Inventor： Ziran XING ,  Zhiru SHI ,  Yi MA ,  Jingyi YU

IPC: G06T7/11 ,  G06T7/50 ,  G06T7/187 ,  G06T7/162

Abstract: According to some embodiments, an imaging processing method for extracting a plurality of planar surfaces from a depth map includes computing a depth change indication map (DCI) from a depth map in accordance with a smoothness threshold. The imaging processing method further includes recursively extracting a plurality of planar region from the depth map, wherein the size of each planar region is dynamically adjusted according to the DCI. The imaging processing method further includes clustering the extracted planar regions into a plurality of groups in accordance with a distance function; and growing each group to generate pixel-wise segmentation results and inlier points statistics simultaneously.

公开(公告)号：US20190028707A1

公开(公告)日：2019-01-24

申请号：US16069185

申请日：2016-01-18

Applicant: SHANGHAITECH UNIVERSITY

Inventor： Jingyi YU ,  Yi MA

IPC: H04N19/126 ,  H04N13/106 ,  H04N19/523 ,  H04N19/159 ,  G06T3/40 ,  H04N19/176

Abstract: A method of compressing a stereoscopic video including a left view frame and a right view frame is provided, the method including: determining a texture saliency value for a first block in the left view frame by intra prediction (1101); determining a motion saliency value for the first block by motion estimation (1102); determining a disparity saliency value between the first block and a corresponding second block in the right view frame (1103); determining a quantization parameter based on the disparity saliency value, the texture saliency value, and the motion saliency value (1104); and performing quantization of the first block in accordance with the quantization parameter (1105).

公开(公告)号：US20190028693A1

公开(公告)日：2019-01-24

申请号：US16069181

申请日：2016-01-12

Applicant: SHANGHAITECH UNIVERSITY

Inventor： Jingyi YU ,  Yi MA

IPC: H04N13/246 ,  H04N13/282 ,  H04N13/239 ,  H04N13/243 ,  G06T7/73 ,  G06T7/80 ,  G06T7/33

Abstract: A method of calibrating a camera array comprising a plurality of cameras configured to capture a plurality of images to generate a panorama, wherein the relative positions among the plurality of cameras are constant, the method comprising: moving the camera array from a first position to a second position; measuring a homogeneous transformation matrix of a reference point on the camera array between the first position and the second position; capturing images at the first position and the second position by a first camera and a second camera on the camera array; and determining a homogenous transformation matrix between the first camera and the second camera based on the images captured by the first camera and the second camera at the first position and the second position. The method further comprises identifying a feature in the images taken by the first camera at the first position and the second position, and estimating a rotation of the first camera from the first position to the second position based on the feature.