-
公开(公告)号:US20180302614A1
公开(公告)日:2018-10-18
申请号:US15490887
申请日:2017-04-18
Applicant: Facebook, Inc.
Inventor: Michael John Toksvig , Forrest Samuel Briggs , Brian Keith Cabral
CPC classification number: G06K9/6269 , G06K9/00201 , G06K9/209 , G06K9/4628 , G06K9/527 , G06K9/6201 , G06K9/6202 , G06K9/6255 , G06K9/6256 , G06K9/627 , G06K9/66 , G06T5/002 , G06T5/20 , G06T7/55 , G06T7/70 , G06T7/77 , G06T15/06 , G06T19/20 , G06T2207/10016 , G06T2207/10028 , G06T2207/20081 , G06T2207/30244 , G08B13/19641 , H04N5/2226 , H04N5/2252 , H04N5/23216 , H04N5/23229 , H04N5/23238 , H04N5/247 , H04N7/181 , H04N17/002
Abstract: A camera system captures images from a set of cameras to generate binocular panoramic views of an environment. The cameras are oriented in the camera system to maximize the minimum number of cameras viewing a set of randomized test points. To calibrate the system, matching features between images are identified and used to estimate three-dimensional points external to the camera system. Calibration parameters are modified to improve the three-dimensional point estimates. When images are captured, a pipeline generates a depth map for each camera using reprojected views from adjacent cameras and an image pyramid that includes individual pixel depth refinement and filtering between levels of the pyramid. The images may be used generate views of the environment from different perspectives (relative to the image capture location) by generating depth surfaces corresponding to the depth maps and blending the depth surfaces.
-
公开(公告)号:US20180300894A1
公开(公告)日:2018-10-18
申请号:US15490894
申请日:2017-04-18
Applicant: Facebook, Inc.
Inventor: Michael John Toksvig , Forrest Samuel Briggs , Brian Keith Cabral
Abstract: A camera system captures images from a set of cameras to generate binocular panoramic views of an environment. The cameras are oriented in the camera system to maximize the minimum number of cameras viewing a set of randomized test points. To calibrate the system, matching features between images are identified and used to estimate three-dimensional points external to the camera system. Calibration parameters are modified to improve the three-dimensional point estimates. When images are captured, a pipeline generates a depth map for each camera using reprojected views from adjacent cameras and an image pyramid that includes individual pixel depth refinement and filtering between levels of the pyramid. The images may be used generate views of the environment from different perspectives (relative to the image capture location) by generating depth surfaces corresponding to the depth maps and blending the depth surfaces.
-
公开(公告)号:US20180300893A1
公开(公告)日:2018-10-18
申请号:US15490893
申请日:2017-04-18
Applicant: Facebook, Inc.
Inventor: Michael John Toksvig , Forrest Samuel Briggs , Brian Keith Cabral
Abstract: A camera system captures images from a set of cameras to generate binocular panoramic views of an environment. The cameras are oriented in the camera system to maximize the minimum number of cameras viewing a set of randomized test points. To calibrate the system, matching features between images are identified and used to estimate three-dimensional points external to the camera system. Calibration parameters are modified to improve the three-dimensional point estimates. When images are captured, a pipeline generates a depth map for each camera using reprojected views from adjacent cameras and an image pyramid that includes individual pixel depth refinement and filtering between levels of the pyramid. The images may be used generate views of the environment from different perspectives (relative to the image capture location) by generating depth surfaces corresponding to the depth maps and blending the depth surfaces.
-
公开(公告)号:US10652514B2
公开(公告)日:2020-05-12
申请号:US16040538
申请日:2018-07-19
Applicant: Facebook, Inc.
Inventor: Forrest Samuel Briggs , Michael John Toksvig
IPC: H04N13/128 , G06T7/529 , H04N13/117 , G06T3/00 , G06T3/20 , G06T15/04 , G06T15/80 , H04N13/161
Abstract: As user device can receive and display 360 panoramic content in a 360 depth format. 360 depth content can comprise 360 panoramic image data and corresponding depth information. To display 360 depth content, the user device can generate a 3D environment based on the 360 depth content and the current user viewpoint. A content display module on the user device can render 360 depth content using a standard 3D rendering pipeline modified to render 360 depth content. The content display module can use a vertex shader or fragment shader of the 3D rendering pipeline to interpret the depth information of the 360 depth content into the 3D environment as it is rendered.
-
公开(公告)号:US20200029063A1
公开(公告)日:2020-01-23
申请号:US16040538
申请日:2018-07-19
Applicant: Facebook, Inc.
Inventor: Forrest Samuel Briggs , Michael John Toksvig
IPC: H04N13/128 , H04N13/117 , G06T15/04 , G06T15/80 , G06T3/00 , G06T7/529 , G06T3/20
Abstract: As user device can receive and display 360 panoramic content in a 360 depth format. 360 depth content can comprise 360 panoramic image data and corresponding depth information. To display 360 depth content, the user device can generate a 3D environment based on the 360 depth content and the current user viewpoint. A content display module on the user device can render 360 depth content using a standard 3D rendering pipeline modified to render 360 depth content. The content display module can use a vertex shader or fragment shader of the 3D rendering pipeline to interpret the depth information of the 360 depth content into the 3D environment as it is rendered.
-
公开(公告)号:US20180302550A1
公开(公告)日:2018-10-18
申请号:US15490897
申请日:2017-04-18
Applicant: Facebook, Inc.
Inventor: Forrest Samuel Briggs , Michael John Toksvig , Brian Keith Cabral
CPC classification number: G06K9/6269 , G06K9/00201 , G06K9/209 , G06K9/4628 , G06K9/527 , G06K9/6201 , G06K9/6202 , G06K9/6255 , G06K9/6256 , G06K9/627 , G06K9/66 , G06T5/002 , G06T5/20 , G06T7/55 , G06T7/70 , G06T7/77 , G06T15/06 , G06T19/20 , G06T2207/10016 , G06T2207/10028 , G06T2207/20081 , G06T2207/30244 , G08B13/19641 , H04N5/2226 , H04N5/2252 , H04N5/23216 , H04N5/23229 , H04N5/23238 , H04N5/247 , H04N7/181 , H04N17/002
Abstract: A camera system captures images from a set of cameras to generate binocular panoramic views of an environment. The cameras are oriented in the camera system to maximize the minimum number of cameras viewing a set of randomized test points. To calibrate the system, matching features between images are identified and used to estimate three-dimensional points external to the camera system. Calibration parameters are modified to improve the three- dimensional point estimates. When images are captured, a pipeline generates a depth map for each camera using reprojected views from adjacent cameras and an image pyramid that includes individual pixel depth refinement and filtering between levels of the pyramid. The images may be used generate views of the environment from different perspectives (relative to the image capture location) by generating depth surfaces corresponding to the depth maps and blending the depth surfaces.
-
公开(公告)号:US20180300892A1
公开(公告)日:2018-10-18
申请号:US15490889
申请日:2017-04-18
Applicant: Facebook, Inc.
Inventor: Forrest Samuel Briggs , Michael John Toksvig , Brian Keith Cabral
CPC classification number: G06K9/6269 , G06K9/00201 , G06K9/209 , G06K9/4628 , G06K9/527 , G06K9/6201 , G06K9/6202 , G06K9/6255 , G06K9/6256 , G06K9/627 , G06K9/66 , G06T5/002 , G06T5/20 , G06T5/50 , G06T7/55 , G06T7/70 , G06T7/77 , G06T15/06 , G06T19/00 , G06T19/20 , G06T2207/10016 , G06T2207/10024 , G06T2207/10028 , G06T2207/20081 , G06T2207/20084 , G06T2207/30244 , G08B13/19619 , G08B13/19641 , H04N5/2226 , H04N5/2252 , H04N5/23216 , H04N5/23229 , H04N5/23238 , H04N5/247 , H04N7/181 , H04N17/002
Abstract: A camera system captures images from a set of cameras to generate binocular panoramic views of an environment. The cameras are oriented in the camera system to maximize the minimum number of cameras viewing a set of randomized test points. To calibrate the system, matching features between images are identified and used to estimate three-dimensional points external to the camera system. Calibration parameters are modified to improve the three-dimensional point estimates. When images are captured, a pipeline generates a depth map for each camera using reprojected views from adjacent cameras and an image pyramid that includes individual pixel depth refinement and filtering between levels of the pyramid. The images may be used generate views of the environment from different perspectives (relative to the image capture location) by generating depth surfaces corresponding to the depth maps and blending the depth surfaces.
-
-
-
-
-
-