-
公开(公告)号:US09760768B2
公开(公告)日:2017-09-12
申请号:US14637180
申请日:2015-03-03
Applicant: GoPro, Inc.
Inventor: Timothy MacMillan , David A. Newman , Balineedu Chowdary Adsumilli , Scott Patrick Campbell
IPC: G06K9/42 , G06K9/00 , G06T3/00 , H04N21/233 , H04N21/234 , G06F17/30 , H04L29/06 , H04N13/00 , G03B37/04 , H04N5/232
CPC classification number: H04N5/23238 , G03B37/04 , G06F17/30858 , G06K9/00281 , G06K9/00355 , G06K9/00711 , G06T3/0062 , G06T7/246 , G06T2207/10016 , G06T2207/30201 , H04L65/00 , H04L65/4084 , H04L65/602 , H04L67/42 , H04N13/106 , H04N21/233 , H04N21/23418
Abstract: A spherical content capture system captures spherical video content. A spherical video sharing platform enables users to share the captured spherical content and enables users to access spherical content shared by other users. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest.
-
42.
公开(公告)号:US09646652B2
公开(公告)日:2017-05-09
申请号:US14705864
申请日:2015-05-06
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Ryan Lustig , David A. Newman
IPC: H04N9/80 , H04N5/93 , G11B27/10 , G06K9/00 , G11B27/30 , G11B27/031 , G10L15/06 , G10L15/22 , H04N5/77 , H04N5/91 , H04N9/82 , G11B27/13 , G11B27/34 , G10L25/57 , G10L25/54
CPC classification number: G11B27/10 , G06K9/00718 , G06K9/00751 , G06K2009/00738 , G10L15/063 , G10L15/22 , G10L25/54 , G10L25/57 , G10L2015/0631 , G10L2015/223 , G11B27/031 , G11B27/13 , G11B27/28 , G11B27/3081 , G11B27/34 , H04N5/77 , H04N5/772 , H04N5/91 , H04N9/8205
Abstract: Video and corresponding metadata is accessed. Events of interest within the video are identified based on the corresponding metadata, and best scenes are identified based on the identified events of interest. In one example, best scenes are identified based on the motion values associated with frames or portions of a frame of a video. Motion values are determined for each frame and portions of the video including frames with the most motion are identified as best scenes. Best scenes may also be identified based on the motion profile of a video. The motion profile of a video is a measure of global or local motion within frames throughout the video. For example, best scenes are identified from portion of the video including steady global motion. A video summary can be generated including one or more of the identified best scenes.
-
公开(公告)号:US20170111626A1
公开(公告)日:2017-04-20
申请号:US15396295
申请日:2016-12-30
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Timothy Macmillan
CPC classification number: H04N5/3415 , G01B2210/52 , G03G15/36 , G06T5/008 , G06T2207/20208 , H04N5/23238 , H04N5/247 , H04N5/265 , H04N5/355 , H04N9/646 , H04N9/77
Abstract: Use of separate range tone mapping for combined images can help minimize loss of image information in scenes that have drastically different luminance values, i.e., scenes that have both bright and shadowed regions. Separate range tone mapping is particularly useful for combined images, such as those from spherical camera systems, which may have a higher probability of including luminance variability. The resulting increased bit depth of separate range tone mapping can make the transition between different images that make up a combined image more subtle. Each of a plurality of images that make up a combined image can use a different tone map that is optimized for the particular image data of the image. Multiple tone maps that are applied to overlapping regions of the plurality of images can subsequently be combined to expand the bit depth of the overlapping regions.
-
公开(公告)号:US09628718B2
公开(公告)日:2017-04-18
申请号:US15282306
申请日:2016-09-30
Applicant: GoPro, Inc.
Inventor: Scott Patrick Campbell , Paul Mobbs , Balineedu Chowdary Adsumilli , Sumit Chawla
IPC: H04N5/232 , H04N19/169 , H04N19/172 , H04N5/247 , G06T3/40 , H04N19/91 , H04N19/102
CPC classification number: G06T1/20 , G06T3/4015 , H04N1/6019 , H04N1/6027 , H04N5/232 , H04N5/23212 , H04N5/23216 , H04N5/23222 , H04N5/23229 , H04N5/23241 , H04N5/23245 , H04N5/23254 , H04N5/23267 , H04N5/23296 , H04N5/2353 , H04N5/247 , H04N5/374 , H04N5/378 , H04N9/045 , H04N9/09 , H04N9/735 , H04N9/8042 , H04N19/102 , H04N19/12 , H04N19/132 , H04N19/156 , H04N19/164 , H04N19/172 , H04N19/186 , H04N19/1883 , H04N19/33 , H04N19/42 , H04N19/423 , H04N19/44 , H04N19/517 , H04N19/63 , H04N19/91
Abstract: An image capture accelerator performs accelerated processing of image data. In one embodiment, the image capture accelerator includes accelerator circuitry including a pre-processing engine and a compression engine. The pre-processing engine is configured to perform accelerated processing on received image data, and the compression engine is configured to compress processed image data received from the pre-processing engine. In one embodiment, the image capture accelerator further includes a demultiplexer configured to receive image data captured by an image sensor array implemented within, for example, an image sensor chip. The demultiplexer may output the received image data to an image signal processor when the image data is captured by the image sensor array in a standard capture mode, and may output the received image data to the accelerator circuitry when the image data is captured by the image sensor array in an accelerated capture mode.
-
公开(公告)号:US09584721B2
公开(公告)日:2017-02-28
申请号:US15282391
申请日:2016-09-30
Applicant: GoPro, Inc.
Inventor: Scott Patrick Campbell , Paul Mobbs , Balineedu Chowdary Adsumilli , Sumit Chawla
IPC: H04N5/232 , G06T3/40 , H04N9/09 , H04N19/91 , H04N5/247 , H04N19/102 , H04N19/172 , H04N19/169 , H04N19/63 , H04N1/60
CPC classification number: G06T1/20 , G06T3/4015 , H04N1/6019 , H04N1/6027 , H04N5/232 , H04N5/23212 , H04N5/23216 , H04N5/23222 , H04N5/23229 , H04N5/23241 , H04N5/23245 , H04N5/23254 , H04N5/23267 , H04N5/23296 , H04N5/2353 , H04N5/247 , H04N5/374 , H04N5/378 , H04N9/045 , H04N9/09 , H04N9/735 , H04N9/8042 , H04N19/102 , H04N19/12 , H04N19/132 , H04N19/156 , H04N19/164 , H04N19/172 , H04N19/186 , H04N19/1883 , H04N19/33 , H04N19/42 , H04N19/423 , H04N19/44 , H04N19/517 , H04N19/63 , H04N19/91
Abstract: An image capture accelerator performs accelerated processing of image data. In one embodiment, the image capture accelerator includes accelerator circuitry including a pre-processing engine and a compression engine. The pre-processing engine is configured to perform accelerated processing on received image data, and the compression engine is configured to compress processed image data received from the pre-processing engine. In one embodiment, the image capture accelerator further includes a demultiplexer configured to receive image data captured by an image sensor array implemented within, for example, an image sensor chip. The demultiplexer may output the received image data to an image signal processor when the image data is captured by the image sensor array in a standard capture mode, and may output the received image data to the accelerator circuitry when the image data is captured by the image sensor array in an accelerated capture mode.
Abstract translation: 图像捕获加速器执行图像数据的加速处理。 在一个实施例中,图像捕获加速器包括包括预处理引擎和压缩引擎的加速器电路。 预处理引擎被配置为对接收的图像数据执行加速处理,并且压缩引擎被配置为压缩从预处理引擎接收的经处理的图像数据。 在一个实施例中,图像捕获加速器还包括解复用器,其被配置为接收由例如图像传感器芯片内实现的图像传感器阵列捕获的图像数据。 当图像数据以标准捕捉模式被图像传感器阵列捕获时,解复用器可以将接收到的图像数据输出到图像信号处理器,并且当图像数据被图像捕获时,可以将接收到的图像数据输出到加速器电路 传感器阵列处于加速捕获模式。
-
46.
公开(公告)号:US20170019592A1
公开(公告)日:2017-01-19
申请号:US15282315
申请日:2016-09-30
Applicant: GoPro, Inc.
Inventor: Scott Patrick Campbell , Paul Mobbs , Balineedu Chowdary Adsumilli , Sumit Chawla
IPC: H04N5/232 , G06T3/40 , H04N19/91 , H04N19/164 , H04N19/172 , H04N19/169 , H04N19/102
CPC classification number: G06T1/20 , G06T3/4015 , H04N1/6019 , H04N1/6027 , H04N5/232 , H04N5/23212 , H04N5/23216 , H04N5/23222 , H04N5/23229 , H04N5/23241 , H04N5/23245 , H04N5/23254 , H04N5/23267 , H04N5/23296 , H04N5/2353 , H04N5/247 , H04N5/374 , H04N5/378 , H04N9/045 , H04N9/09 , H04N9/735 , H04N9/8042 , H04N19/102 , H04N19/12 , H04N19/132 , H04N19/156 , H04N19/164 , H04N19/172 , H04N19/186 , H04N19/1883 , H04N19/33 , H04N19/42 , H04N19/423 , H04N19/44 , H04N19/517 , H04N19/63 , H04N19/91
Abstract: An image capture accelerator performs accelerated processing of image data. In one embodiment, the image capture accelerator includes accelerator circuitry including a pre-processing engine and a compression engine. The pre-processing engine is configured to perform accelerated processing on received image data, and the compression engine is configured to compress processed image data received from the pre-processing engine. In one embodiment, the image capture accelerator further includes a demultiplexer configured to receive image data captured by an image sensor array implemented within, for example, an image sensor chip. The demultiplexer may output the received image data to an image signal processor when the image data is captured by the image sensor array in a standard capture mode, and may output the received image data to the accelerator circuitry when the image data is captured by the image sensor array in an accelerated capture mode.
Abstract translation: 图像捕获加速器执行图像数据的加速处理。 在一个实施例中,图像捕获加速器包括包括预处理引擎和压缩引擎的加速器电路。 预处理引擎被配置为对接收的图像数据执行加速处理,并且压缩引擎被配置为压缩从预处理引擎接收的经处理的图像数据。 在一个实施例中,图像捕获加速器还包括解复用器,其被配置为接收由例如图像传感器芯片内实现的图像传感器阵列捕获的图像数据。 当图像数据以标准捕捉模式被图像传感器阵列捕获时,解复用器可以将接收的图像数据输出到图像信号处理器,并且当图像数据被图像捕获时,可以将接收到的图像数据输出到加速器电路 传感器阵列处于加速捕获模式。
-
公开(公告)号:US20170006219A1
公开(公告)日:2017-01-05
申请号:US14754694
申请日:2015-06-30
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Scott Patrick Campbell
Abstract: Images captured by multi-camera arrays with overlap regions can be stitched together using image stitching operations. An image stitching operation can be selected for use in stitching images based on a number of factors. An image stitching operation can be selected based on a view window location of a user viewing the images to be stitched together. An image stitching operation can also be selected based on a type, priority, or depth of image features located within an overlap region. Finally, an image stitching operation can be selected based on a likelihood that a particular image stitching operation will produce visible artifacts. Once a stitching operation is selected, the images corresponding to the overlap region can be stitched using the stitching operation, and the stitched image can be stored for subsequent access.
-
公开(公告)号:US09466109B1
公开(公告)日:2016-10-11
申请号:US14754696
申请日:2015-06-30
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Scott Patrick Campbell
CPC classification number: G06T7/30 , G06T3/4038 , G06T11/60 , G06T2200/32 , G06T2207/10004 , H04N5/23229 , H04N5/23238 , H04N5/247 , H04N5/2625
Abstract: Images captured by multi-camera arrays with overlap regions can be stitched together using image stitching operations. An image stitching operation can be selected for use in stitching images based on a number of factors. An image stitching operation can be selected based on a view window location of a user viewing the images to be stitched together. An image stitching operation can also be selected based on a type, priority, or depth of image features located within an overlap region. Finally, an image stitching operation can be selected based on a likelihood that a particular image stitching operation will produce visible artifacts. Once a stitching operation is selected, the images corresponding to the overlap region can be stitched using the stitching operation, and the stitched image can be stored for subsequent access.
-
公开(公告)号:US09420173B2
公开(公告)日:2016-08-16
申请号:US15049013
申请日:2016-02-20
Applicant: GoPro, Inc.
Inventor: Scott Patrick Campbell , Paul Mobbs , Balineedu Chowdary Adsumilli , Sumit Chawla
IPC: H04N5/232 , H04N19/91 , H04N19/63 , H04N19/172
CPC classification number: G06T1/20 , G06T3/4015 , H04N1/6019 , H04N1/6027 , H04N5/232 , H04N5/23212 , H04N5/23216 , H04N5/23222 , H04N5/23229 , H04N5/23241 , H04N5/23245 , H04N5/23254 , H04N5/23267 , H04N5/23296 , H04N5/2353 , H04N5/247 , H04N5/374 , H04N5/378 , H04N9/045 , H04N9/09 , H04N9/735 , H04N9/8042 , H04N19/102 , H04N19/12 , H04N19/132 , H04N19/156 , H04N19/164 , H04N19/172 , H04N19/186 , H04N19/1883 , H04N19/33 , H04N19/42 , H04N19/423 , H04N19/44 , H04N19/517 , H04N19/63 , H04N19/91
Abstract: An image capture accelerator performs accelerated processing of image data. In one embodiment, the image capture accelerator includes accelerator circuitry including a pre-processing engine and a compression engine. The pre-processing engine is configured to perform accelerated processing on received image data, and the compression engine is configured to compress processed image data received from the pre-processing engine. In one embodiment, the image capture accelerator further includes a demultiplexer configured to receive image data captured by an image sensor array implemented within, for example, an image sensor chip. The demultiplexer may output the received image data to an image signal processor when the image data is captured by the image sensor array in a standard capture mode, and may output the received image data to the accelerator circuitry when the image data is captured by the image sensor array in an accelerated capture mode.
-
公开(公告)号:US09418396B2
公开(公告)日:2016-08-16
申请号:US14598132
申请日:2015-01-15
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli
CPC classification number: G06T1/0028 , G06T1/005 , G06T2201/0052 , G06T2201/0202 , H04N1/2112 , H04N1/32197 , H04N1/32251 , H04N1/32277 , H04N1/32309 , H04N5/2621 , H04N19/467 , H04N2201/0084 , H04N2201/3233
Abstract: Watermark data is converted to watermark coefficients, which may be embedded in an image by converting the image to a frequency domain, embedding the watermark in image coefficients corresponding to medium-frequency components, and converting the modified coefficients to the spatial domain. The watermark data is extracted from the modified image by converting the modified image to a frequency domain, extracting the watermark coefficients from the image coefficients, and determining the watermark data from the watermark coefficients. The watermark data may be truncated image data bits such as truncated least significant data bits. After extraction from the watermark, the truncated image data bits may be combined with data bits representing the original image to increase the bit depth of the image. Watermark data may include audio data portions corresponding to a video frame, reference frames temporally proximate to a video frame, high-frequency content, sensor calibration information, or other image data.
Abstract translation: 水印数据被转换为水印系数,其可以通过将图像转换为频域而嵌入到图像中,将水印嵌入对应于中频分量的图像系数中,并将修改的系数转换为空间域。 通过将修正图像转换为频域,从图像系数中提取水印系数,并根据水印系数确定水印数据,从修改图像中提取水印数据。 水印数据可以是截断的图像数据位,例如截断的最低有效数据位。 在从水印提取之后,截断的图像数据位可以与表示原始图像的数据位组合,以增加图像的位深度。 水印数据可以包括对应于视频帧的音频数据部分,时间上靠近视频帧的参考帧,高频内容,传感器校准信息或其他图像数据。
-
-
-
-
-
-
-
-
-