-
公开(公告)号:US10397549B2
公开(公告)日:2019-08-27
申请号:US15385759
申请日:2016-12-20
Applicant: GoPro, Inc.
Inventor: Adeel Abbas , David A. Newman , Timothy Macmillan
IPC: G06K9/46 , H04N5/232 , H04N13/243 , G06T7/33 , G06T17/00 , H04N13/296 , G06T3/40 , G01S3/00 , H04N5/225 , H04N5/247 , H04N5/262 , G06K9/20 , G06K9/36
Abstract: A method and system are described. The method includes capturing a set of images from a 2×2 array of cameras, each camera of the array of cameras having an overlapping field of view (FOV) with an adjacent camera of the array of cameras. The method further includes synchronously capturing a supplemental image from a fifth camera, the fifth camera having an at least partially overlapping FOV with every camera of the array of cameras. Supplemental information is extracted by comparing the supplemental image with the set of four images. Portions of the set of images are stitched based in part on the supplemental information to produce a combined stitched image, the combined stitched image having a higher resolution than each image of the set of images.
-
公开(公告)号:US10389993B2
公开(公告)日:2019-08-20
申请号:US15077911
申请日:2016-03-23
Applicant: GoPro, Inc.
Inventor: Timothy Macmillan , Scott Patrick Campbell , David A. Newman , Yajie Sun
Abstract: A pair of cameras having an overlapping field of view is aligned based on images captured by image sensors of the pair of cameras. A pixel shift is identified between the images. Based on the identified pixel shift, a calibration is applied to one or both of the pair of cameras. To determine the pixel shift, the camera applies correlation methods including edge matching. Calibrating the pair of cameras may include adjusting a read window on an image sensor. The pixel shift can also be used to determine a time lag, which can be used to synchronize subsequent image captures.
-
公开(公告)号:US10332237B2
公开(公告)日:2019-06-25
申请号:US16056370
申请日:2018-08-06
Applicant: GoPro, Inc.
Inventor: Joseph Steel , Timothy Macmillan
IPC: G06T3/00
Abstract: Hyper-hemispherical images may be combined to generate a rectangular projection of a spherical image having an equatorial stitch line along of a line of lowest distortion in the two images. First and second circular images are received representing respective hyper-hemispherical fields of view. A video processing device may project each circular image to a respective rectangular image by mapping an outer edge of the circular image to a first edge of the rectangular image and mapping a center point of the circular image to a second edge of the first rectangular image. The rectangular images may be stitched together along the edges corresponding to the outer edge of the original circular image.
-
公开(公告)号:US20190124276A1
公开(公告)日:2019-04-25
申请号:US16227404
申请日:2018-12-20
Applicant: GoPro, Inc.
Inventor: Timothy Macmillan , Scott Patrick Campbell
IPC: H04N5/341 , H04N5/262 , G06T3/00 , H04N5/232 , H04N5/225 , G06T5/50 , G06T5/00 , G06T7/33 , G06T3/40 , H04N5/247
CPC classification number: H04N5/3415 , G06T3/0068 , G06T3/0093 , G06T3/4038 , G06T5/006 , G06T5/50 , G06T7/344 , G06T2207/10004 , G06T2207/20128 , G06T2207/20221 , G06T2210/22 , H04N5/2252 , H04N5/2253 , H04N5/2257 , H04N5/2258 , H04N5/23216 , H04N5/23229 , H04N5/23232 , H04N5/23238 , H04N5/247 , H04N5/2624 , H04N5/2628
Abstract: Multiple cameras are arranged in an array at a pitch, roll, and yaw that allow the cameras to have adjacent fields of view such that each camera is pointed inward relative to the array. The read window of an image sensor of each camera in a multi-camera array can be adjusted to minimize the overlap between adjacent fields of view, to maximize the correlation within the overlapping portions of the fields of view, and to correct for manufacturing and assembly tolerances. Images from cameras in a multi-camera array with adjacent fields of view can be manipulated using low-power warping and cropping techniques, and can be taped together to form a final image.
-
公开(公告)号:US10056115B2
公开(公告)日:2018-08-21
申请号:US15396385
申请日:2016-12-30
Applicant: GoPro, Inc.
Inventor: Scott Patrick Campbell , Zhinian Jing , Timothy Macmillan , David A. Newman , Balineedu Chowdary Adsumilli
CPC classification number: G11B27/3081 , H04N5/23238 , H04N5/77 , H04N9/806 , H04N9/8205 , H04N9/8211
Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.
-
-
公开(公告)号:US20170110155A1
公开(公告)日:2017-04-20
申请号:US15396385
申请日:2016-12-30
Applicant: GoPro, Inc.
Inventor: Scott Patrick Campbell , Zhinian Jing , Timothy Macmillan , David A. Newman , Balineedu Chowdary Adsumilli
CPC classification number: G11B27/3081 , H04N5/23238 , H04N5/77 , H04N9/806 , H04N9/8205 , H04N9/8211
Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.
-
公开(公告)号:US20160349600A1
公开(公告)日:2016-12-01
申请号:US15164787
申请日:2016-05-25
Applicant: GoPro, Inc.
Inventor: Timothy Macmillan , Ihab A. Ali
CPC classification number: G03B17/561 , G03B37/04
Abstract: A camera mounting assembly is disclosed for a plurality of cameras. The camera mounting structure may have a substantially circular configuration. The camera mounting structure may include a unibody base cage. One or more lens openings may be configured along the circumference of the unibody base cage. The lens openings may allow a camera lens to have an unobstructed view outside of the unibody base cage to capture an image or a video. The assembly further may include one or more sub-cages that are releasably attached to the unibody base cage. Each sub-cage may be configured to securely hold a camera via a securing mechanism such as a clamp or interlocking pin. Each sub-cage further may include an aligning pin that is configured to align the center of the camera with the center of the lens opening.
Abstract translation: 公开了一种用于多个相机的照相机安装组件。 相机安装结构可以具有基本上圆形的构造。 相机安装结构可以包括一体式基座笼。 一个或多个透镜开口可以沿着一体式基座的圆周构造。 透镜开口可以允许相机镜头在一体式基座外部具有无障碍视图以捕获图像或视频。 组件还可以包括一个或多个可释放地附接到一体式基座笼的子笼。 每个子笼可以被配置成通过诸如夹子或互锁销的固定机构牢固地保持照相机。 每个子架还可以包括对准销,该对准销被配置为将照相机的中心与透镜开口的中心对准。
-
公开(公告)号:US09478008B1
公开(公告)日:2016-10-25
申请号:US15140486
申请日:2016-04-28
Applicant: GoPro, Inc.
CPC classification number: G06T3/4038 , G06T3/0093 , G06T2207/20221
Abstract: Images captured by multi-camera arrays with overlap regions can be stitched together using image stitching operations. An image stitching operation can be selected for use in stitching images based on a number of factors. An image stitching operation can be selected based on a view window location of a user viewing the images to be stitched together. An image stitching operation can also be selected based on a type, priority, or depth of image features located within an overlap region. Finally, an image stitching operation can be selected based on a likelihood that a particular image stitching operation will produce visible artifacts. Once a stitching operation is selected, the images corresponding to the overlap region can be stitched using the stitching operation, and the stitched image can be stored for subsequent access.
-
公开(公告)号:US20160125570A1
公开(公告)日:2016-05-05
申请号:US14991481
申请日:2016-01-08
Applicant: GoPro, Inc.
Inventor: Timothy Macmillan , Scott Patrick Campell
CPC classification number: H04N5/3415 , G06T3/0068 , G06T3/0093 , G06T3/4038 , G06T5/006 , G06T5/50 , G06T7/344 , G06T2207/10004 , G06T2207/20128 , G06T2207/20221 , G06T2210/22 , H04N5/2252 , H04N5/2253 , H04N5/2257 , H04N5/2258 , H04N5/23216 , H04N5/23229 , H04N5/23232 , H04N5/23238 , H04N5/247 , H04N5/2624 , H04N5/2628
Abstract: Multiple cameras are arranged in an array at a pitch, roll, and yaw that allow the cameras to have adjacent fields of view such that each camera is pointed inward relative to the array. The read window of an image sensor of each camera in a multi-camera array can be adjusted to minimize the overlap between adjacent fields of view, to maximize the correlation within the overlapping portions of the fields of view, and to correct for manufacturing and assembly tolerances. Images from cameras in a multi-camera array with adjacent fields of view can be manipulated using low-power warping and cropping techniques, and can be taped together to form a final image.
Abstract translation: 多个相机以阵列,俯仰和偏转方式布置,允许相机具有相邻的视野,使得每个相机相对于阵列向内指向。 可以调整多相机阵列中每个相机的图像传感器的读取窗口,以使相邻视场之间的重叠最小化,以使视场的重叠部分之间的相关性最大化,并纠正制造和组装 公差。 可以使用低功率翘曲和裁剪技术来操纵具有相邻视场的多相机阵列中的相机的图像,并且可以将其粘贴在一起以形成最终图像。
-
-
-
-
-
-
-
-
-