-
公开(公告)号:US12205236B2
公开(公告)日:2025-01-21
申请号:US18632691
申请日:2024-04-11
Applicant: GoPro, Inc.
Inventor: Adeel Abbas , Timothy MacMillan , Cesar Douady-Pleven
IPC: G06T3/08 , G06T3/12 , G06T3/14 , G06T3/4038 , H04N23/45 , H04N23/698
Abstract: Apparatus and methods for the stitch zone calculation of a generated projection of a spherical image. In one embodiment, a non-transitory computer-readable apparatus comprising a storage apparatus, the storage apparatus comprising instructions configured to, when executed by a processor apparatus, cause a computerized apparatus to identify a stitch line associated with an equatorial area of a plurality of spherical images; re-orient the plurality of spherical images in accordance with the stitch line; and project the re-oriented plurality of spherical images to a selected image projection type.
-
公开(公告)号:US20210321047A1
公开(公告)日:2021-10-14
申请号:US17240868
申请日:2021-04-26
Applicant: GoPro, Inc.
Inventor: Adeel Abbas , Cesar Douady , Timothy MacMillan
Abstract: Apparatus and methods for stitching images, or re-stitching previously stitched images. Specifically, the disclosed systems in one implementation save stitching information and/or original overlap source data during an original stitching process. During subsequent retrieval, rendering, and/or display of the stitched images, the originally stitched image can be flexibly augmented, and/or re-stitched to improve the original stitch quality. Practical applications of the disclosed solutions enable, among other things, a user to create and stitch a wide field of view (FOV) panorama from multiple source images on a device with limited processing capability (such as a mobile phone or other capture device). Moreover, post-processing stitching allows for the user to convert from one image projection to another without fidelity loss (or with an acceptable level of loss).
-
3.
公开(公告)号:US20200221067A1
公开(公告)日:2020-07-09
申请号:US16823118
申请日:2020-03-18
Applicant: GoPro, Inc.
Inventor: Adeel Abbas , Timothy MacMillan
IPC: H04N13/243 , H04N5/232 , G06T3/00 , G06T7/38 , G06T7/73 , G06T7/593 , H04N19/136 , H04N19/44 , G06K9/46 , G06K9/52 , G06K9/62 , G06T3/20 , G06T7/00 , G06T11/60 , G06T15/20 , H04N13/302 , H04N13/344 , H04N13/10 , H04N13/334 , H04N13/282 , G06T7/55 , H04N5/265
Abstract: Apparatus and methods for providing a frame packing arrangement for the encoding/decoding of, for example, panoramic content. In one embodiment, the frame packing arrangement utilizes overlapping imaging data so as to enable, for example, a post-decode stitching operation to be performed. The frame packing arrangement may utilize a number of projection formats, such as a cubemap projection, and may utilize any number of differing aspect ratios such as, without limitation, 4×3, 3×2, 4×2, 2×4 aspect ratios. Additionally, the overlapping imaging data may be positioned within the frame packing arrangement chosen so as to improve upon coding efficiency. For example, the overlapping imaging data may be positioned within the frame packing arrangement so as to emphasize image continuity. An encoder apparatus and decoder apparatus for use with the aforementioned frame packing arrangements are also disclosed.
-
公开(公告)号:US10679323B2
公开(公告)日:2020-06-09
申请号:US16713839
申请日:2019-12-13
Applicant: GoPro, Inc.
Inventor: David A. Newman , Joshua Edward Bodinet , Otto Kenneth Sievert , Timothy MacMillan
Abstract: In a video capture system, a virtual lens is simulated when applying a crop or zoom effect to an input video. An input video frame is received from the input video that has a first field of view and an input lens distortion caused by a lens used to capture the input video frame. A selection of a sub-frame representing a portion of the input video frame is obtained that has a second field of view smaller than the first field of view. The sub-frame is processed to remap the input lens distortion to a desired lens distortion in the sub-frame. The processed sub-frame is the outputted.
-
公开(公告)号:US10200636B2
公开(公告)日:2019-02-05
申请号:US14921410
申请日:2015-10-23
Applicant: GoPro, Inc.
Inventor: Timothy MacMillan , Scott Patrick Campbell
IPC: H04N5/225 , H04N7/00 , H04N7/18 , H04N5/341 , G06T3/00 , H04N5/262 , H04N5/232 , G06T5/50 , G06T5/00 , H04N5/247 , G06T3/40 , G06T7/33
Abstract: Multiple cameras are arranged in an array at a pitch, roll, and yaw that allow the cameras to have adjacent fields of view such that each camera is pointed inward relative to the array. The read window of an image sensor of each camera in a multi-camera array can be adjusted to minimize the overlap between adjacent fields of view, to maximize the correlation within the overlapping portions of the fields of view, and to correct for manufacturing and assembly tolerances. Images from cameras in a multi-camera array with adjacent fields of view can be manipulated using low-power warping and cropping techniques, and can be taped together to form a final image.
-
公开(公告)号:US09681068B2
公开(公告)日:2017-06-13
申请号:US14921395
申请日:2015-10-23
Applicant: GoPro, Inc.
Inventor: Timothy MacMillan , Scott Patrick Campbell
IPC: H04N13/02 , H04N15/00 , H04N9/47 , H04N7/18 , H04N5/228 , G06K9/36 , H04N5/341 , G06T3/00 , H04N5/262 , H04N5/232 , G06T5/50 , H04N5/225 , G06T5/00 , H04N5/247 , G06T3/40 , G06T7/33
CPC classification number: H04N5/3415 , G06T3/0068 , G06T3/0093 , G06T3/4038 , G06T5/006 , G06T5/50 , G06T7/344 , G06T2207/10004 , G06T2207/20128 , G06T2207/20221 , G06T2210/22 , H04N5/2252 , H04N5/2253 , H04N5/2257 , H04N5/2258 , H04N5/23216 , H04N5/23229 , H04N5/23232 , H04N5/23238 , H04N5/247 , H04N5/2624 , H04N5/2628
Abstract: Multiple cameras are arranged in an array at a pitch, roll, and yaw that allow the cameras to have adjacent fields of view such that each camera is pointed inward relative to the array. The read window of an image sensor of each camera in a multi-camera array can be adjusted to minimize the overlap between adjacent fields of view, to maximize the correlation within the overlapping portions of the fields of view, and to correct for manufacturing and assembly tolerances. Images from cameras in a multi-camera array with adjacent fields of view can be manipulated using low-power warping and cropping techniques, and can be taped together to form a final image.
-
公开(公告)号:US09355433B1
公开(公告)日:2016-05-31
申请号:US14754695
申请日:2015-06-30
Applicant: GoPro, Inc.
CPC classification number: G06T3/4038 , G06T3/0093 , G06T2207/20221
Abstract: Images captured by multi-camera arrays with overlap regions can be stitched together using image stitching operations. An image stitching operation can be selected for use in stitching images based on a number of factors. An image stitching operation can be selected based on a view window location of a user viewing the images to be stitched together. An image stitching operation can also be selected based on a type, priority, or depth of image features located within an overlap region. Finally, an image stitching operation can be selected based on a likelihood that a particular image stitching operation will produce visible artifacts. Once a stitching operation is selected, the images corresponding to the overlap region can be stitched using the stitching operation, and the stitched image can be stored for subsequent access.
Abstract translation: 使用重叠区域的多相机阵列拍摄的图像可以使用图像拼接操作拼接在一起。 可以基于多个因素来选择图像拼接操作以用于拼接图像。 可以基于观看要缝合的图像的用户的视窗位置来选择图像拼接操作。 还可以基于位于重叠区域内的图像特征的类型,优先级或深度来选择图像拼接操作。 最后,可以基于特定图像拼接操作将产生可见伪影的可能性来选择图像拼接操作。 一旦选择了缝合操作,就可以使用缝合操作来缝合与重叠区域相对应的图像,并且可以存储缝合图像以供后续访问。
-
8.
公开(公告)号:US20150271421A1
公开(公告)日:2015-09-24
申请号:US14606019
申请日:2015-01-27
Applicant: GoPro, Inc.
Inventor: Timothy MacMillan , Scott Patrick Campbell , David A. Newman , Yajie Sun
CPC classification number: H04N13/246 , H04N5/23203 , H04N5/23238 , H04N5/247 , H04N5/265 , H04N5/3532 , H04N13/00 , H04N13/239 , H04N13/296 , H04N17/002
Abstract: A pair of cameras having an overlapping field of view is aligned based on images captured by image sensors of the pair of cameras. A pixel shift is identified between the images. Based on the identified pixel shift, a calibration is applied to one or both of the pair of cameras. To determine the pixel shift, the camera applies correlation methods including edge matching. Calibrating the pair of cameras may include adjusting a read window on an image sensor. The pixel shift can also be used to determine a time lag, which can be used to synchronize subsequent image captures.
Abstract translation: 具有重叠视野的一对相机基于由该对相机的图像传感器捕获的图像来对准。 在图像之间识别像素漂移。 基于所识别的像素偏移,校准被应用于该对照相机中的一个或两个。 为了确定像素偏移,相机应用包括边缘匹配的相关方法。 校准一对相机可能包括调整图像传感器上的读取窗口。 像素偏移也可用于确定时间滞后,可用于同步后续图像捕获。
-
9.
公开(公告)号:US20150256808A1
公开(公告)日:2015-09-10
申请号:US14637180
申请日:2015-03-03
Applicant: GoPro, Inc.
Inventor: Timothy MacMillan , David A. Newman , Balineedu Chowdary Adsumilli , Scott Patrick Campbell
CPC classification number: H04N5/23238 , G03B37/04 , G06F17/30858 , G06K9/00281 , G06K9/00355 , G06K9/00711 , G06T3/0062 , G06T7/246 , G06T2207/10016 , G06T2207/30201 , H04L65/00 , H04L65/4084 , H04L65/602 , H04L67/42 , H04N13/106 , H04N21/233 , H04N21/23418
Abstract: A spherical content capture system captures spherical video content. A spherical video sharing platform enables users to share the captured spherical content and enables users to access spherical content shared by other users. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest.
Abstract translation: 球面内容捕获系统捕获球面视频内容。 一个球面视频共享平台使用户能够共享所捕获的球面内容,并使用户能够访问其他用户共享的球面内容。 在一个实施例中,捕获的元数据或视频/音频处理被用于基于时间和位置信息来识别与特定用户相关的内容。 然后,平台可以从与用户相关的一个或多个共享球面内容文件生成输出视频。 输出视频可以包括诸如通常与常规相机系统相关联的非球面缩小视场。 特别地,可以从球面视频的每个帧中提取具有减小的视场的相关子帧,以生成跟踪特定个人或感兴趣对象的输出视频。
-
公开(公告)号:US20230334616A1
公开(公告)日:2023-10-19
申请号:US18340611
申请日:2023-06-23
Applicant: GoPro, Inc.
Inventor: David A. Newman , Joshua Edward Bodinet , Otto Kenneth Sievert , Timothy MacMillan
CPC classification number: G06T3/0018 , G06T3/00 , G06T5/006 , G06T3/40 , G06T2207/10004 , G06T2207/10016 , G06T2207/20021 , G06T2210/22
Abstract: In a video capture system, a virtual lens is simulated when applying a crop or zoom effect to an input video. An input video frame is received from the input video that has a first field of view and an input lens distortion. A selection of a sub-frame representing a portion of the input video frame is obtained that has a second field of view smaller than the first field of view. The sub-frame is processed to remap the input lens distortion to a desired lens distortion in the sub-frame. The processed sub-frame is output.
-
-
-
-
-
-
-
-
-