-
公开(公告)号：WO2017003557A1
公开(公告)日：2017-01-05
申请号：PCT/US2016/031076
申请日：2016-05-05
Applicant: GOPRO, INC.
IPC: G06K9/36
CPC classification number: G06K9/36 , G06T3/4038
Abstract: Images captured by multi-camera arrays with overlap regions can be stitched together using image stitching operations. An image stitching operation can be selected for use in stitching images based on a number of factors. An image stitching operation can be selected based on a view window location of a user viewing the images to be stitched together. An image stitching operation can also be selected based on a type, priority, or depth of image features located within an overlap region. Finally, an image stitching operation can be selected based on a likelihood that a particular image stitching operation will produce visible artifacts. Once a stitching operation is selected, the images corresponding to the overlap region can be stitched using the stitching operation, and the stitched image can be stored for subsequent access.
Abstract translation: 可以使用图像拼接操作将具有重叠区域的多相机阵列拍摄的图像拼接在一起。 可以基于多个因素来选择用于拼接图像的图像拼接操作。 可以基于观看要缝合的图像的用户的视窗位置来选择图像拼接操作。 还可以基于位于重叠区域内的图像特征的类型，优先级或深度来选择图像拼接操作。 最后，可以基于特定图像拼接操作将产生可见伪像的可能性来选择图像拼接操作。 一旦选择了缝合操作，可以使用拼接操作来缝合与重叠区域相对应的图像，并且可以存储缝合图像以用于随后的访问。
-
公开(公告)号：WO2015134537A1
公开(公告)日：2015-09-11
申请号：PCT/US2015/018538
申请日：2015-03-03
Applicant: GOPRO, INC.
Inventor： MACMILLAN, Timothy , NEWMAN, David, A. , ADSUMILLI, Balineedu, Chowdary , CAMPBELL, Scott, Patrick
IPC: H04N13/04
CPC classification number: H04N5/23238 , G03B37/04 , G06F17/30858 , G06K9/00281 , G06K9/00355 , G06K9/00711 , G06T3/0062 , G06T7/246 , G06T2207/10016 , G06T2207/30201 , H04L65/00 , H04L65/4084 , H04L65/602 , H04L67/42 , H04N13/106 , H04N21/233 , H04N21/23418
Abstract: A spherical content capture system captures spherical video content. A spherical video sharing platform enables users to share the captured spherical content and enables users to access spherical content shared by other users. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non- spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest.
Abstract translation: 球面内容捕获系统捕获球面视频内容。 一个球面视频共享平台使用户能够共享所捕获的球面内容，并使用户能够访问其他用户共享的球面内容。 在一个实施例中，捕获的元数据或视频/音频处理被用于基于时间和位置信息来识别与特定用户相关的内容。 然后，平台可以从与用户相关的一个或多个共享球面内容文件生成输出视频。 输出视频可以包括诸如通常与常规相机系统相关联的非球面缩小视场。 特别地，可以从球面视频的每个帧中提取具有减小的视场的相关子帧，以产生跟踪特定个人或感兴趣对象的输出视频。
-
3.发明申请
公开(公告)号：WO2018132231A1
公开(公告)日：2018-07-19
申请号：PCT/US2017/067392
申请日：2017-12-19
Applicant: GOPRO, INC.
Inventor： ABBAS, Adeel , DOUADY-PLEVEN, Cesar , MACMILLAN, Timothy
Abstract: Apparatus and methods for stitching images, or re-stitching previously stitched images. Specifically, the disclosed systems in one implementation save stitching information and/or original overlap source data during an original stitching process. During subsequent retrieval, rendering, and/or display of the stitched images, the originally stitched image can be flexibly augmented, and/or re-stitched to improve the original stitch quality. Practical applications of the disclosed solutions enable, among other things, a user to create and stitch a wide field of view (FOV) panorama from multiple source images on a device with limited processing capability (such as a mobile phone or other capture device). Moreover, post-processing stitching allows for the user to convert from one image projection to another without fidelity loss (or with an acceptable level of loss).
-
公开(公告)号：WO2015142412A2
公开(公告)日：2015-09-24
申请号：PCT/US2015/011490
申请日：2015-01-15
Applicant: GOPRO, INC.
Inventor： MACMILLAN, Timothy , CAMPBELL, Scott, Patrick , NEWMAN, David, A. , SUN, Yajie
IPC: H04N17/00
CPC classification number: H04N17/002 , H04N5/3532 , H04N13/239 , H04N13/243 , H04N13/246 , H04N13/296
Abstract: A pair of cameras having an overlapping field of view is aligned based on images captured by image sensors of the pair of cameras. A pixel shift is identified between the images. Based on the identified pixel shift, a calibration is applied to one or both of the pair of cameras. To determine the pixel shift, the camera applies correlation methods including edge matching. Calibrating the pair of cameras may include adjusting a read window on an image sensor. The pixel shift can also be used to determine a time lag, which can be used to synchronize subsequent image captures.
Abstract translation: 具有重叠视野的一对相机基于由该对相机的图像传感器捕获的图像来对准。 在图像之间识别像素漂移。 基于所识别的像素偏移，校准被应用于该对照相机中的一个或两者。 为了确定像素偏移，相机应用包括边缘匹配的相关方法。 校准一对相机可能包括调整图像传感器上的读取窗口。 像素偏移也可用于确定时间滞后，可用于同步后续图像捕获。
-
5.发明申请APPARATUS AND METHODS FOR THE OPTIMAL STITCH ZONE CALCULATION OF A GENERATED PROJECTION OF A SPHERICAL IMAGE 审中-公开用于球面图像生成投影的最佳缝区计算的装置和方法
公开(公告)号：WO2018071386A1
公开(公告)日：2018-04-19
申请号：PCT/US2017/055885
申请日：2017-10-10
Applicant: GOPRO, INC.
Inventor： ABBAS, Adeel , MACMILLAN, Timothy , DOUADY-PLEVEN, Cesar
Abstract: Apparatus and methods for the stitch zone calculation of a generated projection of a spherical image. In one embodiment, a computing device is disclosed which includes logic configured to: obtain a plurality of images; map the plurality of images onto a spherical image; re-orient the spherical image in accordance with a desired stitch line and a desired projection for the desired stitch line; and map the spherical image to the desired projection having the desired stitch line. In a variant, the desired stitch line is mapped onto an optimal stitch zone, the optimal stitch zone characterized as a set of points that defines a single line on the desired projection in which the set of points along the desired projection lie closest to the spherical image in a mean square sense.
Abstract translation: 用于计算球形图像的生成投影的针脚区域的装置和方法。 在一个实施例中，公开了一种包括逻辑的计算设备，该逻辑被配置为：获得多个图像; 将多个图像映射到球形图像上; 根据期望的针脚线和期望的针脚线的期望投影来重新定向球形图像; 并将球形图像映射到具有期望的缝合线的期望投影。 在一个变型中，期望的针脚线被映射到最佳针脚区域，该最佳针脚区域被表征为一组点，该点在期望投影上限定单条线，其中沿期望投影的点集合最接近球形 图像的意思是平均值。
-
6.发明申请UNIFIED IMAGE PROCESSING FOR COMBINED IMAGES BASED ON SPATIALLY CO-LOCATED ZONES 审中-公开基于空间相似区域的组合图像的统一图像处理
公开(公告)号：WO2017058327A1
公开(公告)日：2017-04-06
申请号：PCT/US2016/041149
申请日：2016-07-06
Applicant: GOPRO, INC.
Inventor： ADSUMILLI, Balineedu, Chowdary , MACMILLAN, Timothy
IPC: G06T3/40
CPC classification number: G06T11/60 , G06T3/4038 , G06T7/50 , G06T7/73 , G06T2207/20021 , G06T2207/20221 , G06T2207/30244
Abstract: A unified image processing algorithm results in better post-processing quality for combined images that are made up of multiple single-capture images. To ensure that each single-capture image is processed in the context of the entire combined image, the combined image is analyzed to determine portions of the image (referred to as "zones") that should be processed with the same parameters for various image processing algorithms. These zones may be determined based on the content of the combined image. Alternatively, these zones may be determined based on the position of each single-capture image with respect to the entire combined image or the other single-capture images. Once zones and their corresponding image processing parameters are determined for the combined image, they are translated to corresponding zones each of the single-capture images. Finally, the image processing algorithms are applied to each of the single-capture images using the zone-specified parameters.
Abstract translation: 统一的图像处理算法对由多个单捕获图像组成的组合图像产生更好的后处理质量。 为了确保在整个组合图像的上下文中处理每个单个捕获图像，分析组合图像以确定应该用相同参数处理各种图像处理的图像的部分（称为“区域”） 算法。 这些区域可以基于组合图像的内容来确定。 或者，可以基于每个单个捕获图像相对于整个组合图像或其它单个捕获图像的位置来确定这些区域。 一旦确定了组合图像的区域及其对应的图像处理参数，则将它们转换为单个捕获图像中的每一个的相应区域。 最后，使用区域指定的参数将图像处理算法应用于每个单个捕获图像。
-
公开(公告)号：WO2016187235A1
公开(公告)日：2016-11-24
申请号：PCT/US2016/032937
申请日：2016-05-17
Applicant: GOPRO, INC.
CPC classification number: G06T3/0018 , G06T3/00 , G06T3/40 , G06T5/006 , G06T2207/10004 , G06T2207/10016 , G06T2207/20021 , G06T2210/22
Abstract: In a video capture system, a virtual lens is simulated when applying a crop or zoom effect to an input video. An input video frame is received from the input video that has a first field of view and an input lens distortion caused by a lens used to capture the input video frame. A selection of a sub-frame representing a portion of the input video frame is obtained that has a second field of view smaller than the first field of view. The sub-frame is processed to remap the input lens distortion to a desired lens distortion in the sub-frame. The processed sub-frame is the outputted.
Abstract translation: 在视频采集系统中，当对输入视频应用裁剪或缩放效果时，会模拟虚拟镜头。 从具有第一视野的输入视频接收输入视频帧，以及由用于捕获输入视频帧的镜头引起的输入镜头失真。 获得表示输入视频帧的一部分的子帧的选择，其具有小于第一视场的第二视场。 处理子帧以将输入透镜失真重新映射到子帧中期望的透镜失真。 被处理的子帧被输出。
-
8.发明申请
公开(公告)号：WO2016004258A1
公开(公告)日：2016-01-07
申请号：PCT/US2015/038913
申请日：2015-07-01
Applicant: GOPRO, INC.
Inventor： CAMPBELL, Patrick, Campbell , JING, Zhinian , MACMILLAN, Timothy , NEWMAN, David, A. , ADSUMILLI, Balineedu, Chowdary
IPC: G10L19/008
CPC classification number: G11B27/3081 , H04N5/23238 , H04N5/77 , H04N9/806 , H04N9/8205 , H04N9/8211
Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.
Abstract translation: 球面内容捕获系统捕获球面视频和音频内容。 在一个实施例中，捕获的元数据或视频/音频处理被用于基于时间和位置信息来识别与特定用户相关的内容。 然后，平台可以从与用户相关的一个或多个共享球面内容文件生成输出视频。 输出视频可以包括诸如通常与常规相机系统相关联的非球面缩小视场。 特别地，可以从球面视频的每个帧中提取具有减小的视场的相关子帧，以生成跟踪特定个人或感兴趣对象的输出视频。 对于每个子帧，生成音频轨道的对应部分，其包括具有基于所选择的子帧的方向性的定向音频信号。
