PANORAMIC CAMERA SYSTEMS
    22.
    发明申请

    公开(公告)号:US20180300894A1

    公开(公告)日:2018-10-18

    申请号:US15490894

    申请日:2017-04-18

    Applicant: Facebook, Inc.

    Abstract: A camera system captures images from a set of cameras to generate binocular panoramic views of an environment. The cameras are oriented in the camera system to maximize the minimum number of cameras viewing a set of randomized test points. To calibrate the system, matching features between images are identified and used to estimate three-dimensional points external to the camera system. Calibration parameters are modified to improve the three-dimensional point estimates. When images are captured, a pipeline generates a depth map for each camera using reprojected views from adjacent cameras and an image pyramid that includes individual pixel depth refinement and filtering between levels of the pyramid. The images may be used generate views of the environment from different perspectives (relative to the image capture location) by generating depth surfaces corresponding to the depth maps and blending the depth surfaces.

    PANORAMIC CAMERA SYSTEMS
    23.
    发明申请

    公开(公告)号:US20180300893A1

    公开(公告)日:2018-10-18

    申请号:US15490893

    申请日:2017-04-18

    Applicant: Facebook, Inc.

    Abstract: A camera system captures images from a set of cameras to generate binocular panoramic views of an environment. The cameras are oriented in the camera system to maximize the minimum number of cameras viewing a set of randomized test points. To calibrate the system, matching features between images are identified and used to estimate three-dimensional points external to the camera system. Calibration parameters are modified to improve the three-dimensional point estimates. When images are captured, a pipeline generates a depth map for each camera using reprojected views from adjacent cameras and an image pyramid that includes individual pixel depth refinement and filtering between levels of the pyramid. The images may be used generate views of the environment from different perspectives (relative to the image capture location) by generating depth surfaces corresponding to the depth maps and blending the depth surfaces.

    Rendering 360 depth content
    24.
    发明授权

    公开(公告)号:US10652514B2

    公开(公告)日:2020-05-12

    申请号:US16040538

    申请日:2018-07-19

    Applicant: Facebook, Inc.

    Abstract: As user device can receive and display 360 panoramic content in a 360 depth format. 360 depth content can comprise 360 panoramic image data and corresponding depth information. To display 360 depth content, the user device can generate a 3D environment based on the 360 depth content and the current user viewpoint. A content display module on the user device can render 360 depth content using a standard 3D rendering pipeline modified to render 360 depth content. The content display module can use a vertex shader or fragment shader of the 3D rendering pipeline to interpret the depth information of the 360 depth content into the 3D environment as it is rendered.

    RENDERING 360 DEPTH CONTENT
    25.
    发明申请

    公开(公告)号:US20200029063A1

    公开(公告)日:2020-01-23

    申请号:US16040538

    申请日:2018-07-19

    Applicant: Facebook, Inc.

    Abstract: As user device can receive and display 360 panoramic content in a 360 depth format. 360 depth content can comprise 360 panoramic image data and corresponding depth information. To display 360 depth content, the user device can generate a 3D environment based on the 360 depth content and the current user viewpoint. A content display module on the user device can render 360 depth content using a standard 3D rendering pipeline modified to render 360 depth content. The content display module can use a vertex shader or fragment shader of the 3D rendering pipeline to interpret the depth information of the 360 depth content into the 3D environment as it is rendered.

Patent Agency Ranking