-
公开(公告)号:US11109048B2
公开(公告)日:2021-08-31
申请号:US16538693
申请日:2019-08-12
Applicant: GoPro, Inc.
Inventor: David A. Newman , Brian G. Schunck
IPC: H04N19/44 , H04N19/63 , H04N19/423 , G11B20/00 , G11B27/031
Abstract: A system and method disposed to enable encoding, decoding and manipulation of digital video with substantially less processing load than would otherwise required. In particular, one disclosed method is directed to generating a compressed video data structure that is selectively decodable to a plurality of resolutions including the full resolution of the uncompressed stream. The desired number of data components and the content of the data components that make up the compressed video data, which determine the available video resolutions, are variable based upon the processing carried out and the resources available to decode and process the data components. During decoding, efficiency is substantially improved because only the data components necessary to generate a desired resolution are decoded. In variations, both temporal and spatial decoding are utilized to reduce frame rates, and hence, further reduce processor load. The system and method are particularly useful for real-time video editing applications.
-
公开(公告)号:US09792502B2
公开(公告)日:2017-10-17
申请号:US14513150
申请日:2014-10-13
Applicant: GoPro, Inc.
Inventor: David A. Newman , Brian G. Schunck
IPC: G06F17/00 , G06K9/00 , G11B27/031 , H04N21/8549 , G11B27/00 , G11B27/22 , G11B27/34 , H04N5/232 , H04N5/77 , H04N5/91 , H04N9/82
CPC classification number: G06K9/00751 , G06K2009/00328 , G06K2009/00738 , G06K2009/00939 , G06K2209/27 , G11B27/002 , G11B27/031 , G11B27/22 , G11B27/34 , H04N5/232 , H04N5/23216 , H04N5/23293 , H04N5/77 , H04N5/772 , H04N5/91 , H04N9/8205 , H04N13/172 , H04N13/178 , H04N21/2353 , H04N21/8549 , H04N2201/3228 , H04N2201/3229 , H04N2201/3256
Abstract: Video and corresponding metadata is accessed. Events of interest within the video are identified based on the corresponding metadata, and best scenes are identified based on the identified events of interest. A video summary can be generated including one or more of the identified best scenes. The video summary can be generated using a video summary template with slots corresponding to video clips selected from among sets of candidate video clips. Best scenes can also be identified by receiving an indication of an event of interest within video from a user during the capture of the video. Metadata patterns representing activities identified within video clips can be identified within other videos, which can subsequently be associated with the identified activities.
-
公开(公告)号:US20160227068A1
公开(公告)日:2016-08-04
申请号:US15096479
申请日:2016-04-12
Applicant: GoPro, Inc.
Inventor: Scott Patrick Campbell , David A. Newman , Brian G. Schunck
IPC: H04N1/21 , H04N5/341 , H04N1/00 , H04N19/426
CPC classification number: H04N1/2137 , H04N1/00209 , H04N5/23206 , H04N5/335 , H04N5/341 , H04N5/374 , H04N9/045 , H04N19/0049 , H04N19/137 , H04N19/156 , H04N19/172 , H04N19/423 , H04N19/426 , H04N19/625 , H04N19/63 , H04N19/91
Abstract: An image sensor compresses image data prior to transmitting the image data to a DSP. The image sensor captures light representing an image, for instance via a camera's aperture. A focal plane array converts the captured light into pixel data. The pixel data is sorted into categories, and is compressed in parallel by a compression engine. The compressed pixel data is then sent to a DSP, which may be located off-chip. The DSP then decompresses the compressed pixel data, performs image signal processing operations on the compressed pixel data, and then compresses the processed pixel data into a digital image format. The image sensor may buffer the pixel data for one or more images to accommodate for slowdown by the compression engine. The pixel data may be sorted by row and column of a pixel array. Alternatively, the pixel data may be sorted by color from a Bayer color filter.
-
公开(公告)号:US09253421B2
公开(公告)日:2016-02-02
申请号:US14174814
申请日:2014-02-06
Applicant: GoPro, Inc.
Inventor: Scott Patrick Campbell , David A. Newman , Brian G. Schunck
IPC: H04N5/228 , H04N5/335 , H04N5/341 , H04N19/426 , H04N19/423 , H04N5/232 , H04N1/21
CPC classification number: H04N1/2137 , H04N1/00209 , H04N5/23206 , H04N5/335 , H04N5/341 , H04N5/374 , H04N9/045 , H04N19/0049 , H04N19/137 , H04N19/156 , H04N19/172 , H04N19/423 , H04N19/426 , H04N19/625 , H04N19/63 , H04N19/91
Abstract: An image sensor compresses image data prior to transmitting the image data to a DSP. The image sensor captures light representing an image, for instance via a camera's aperture. A focal plane array converts the captured light into pixel data. The pixel data is sorted into categories, and is compressed in parallel by a compression engine. The compressed pixel data is then sent to a DSP, which may be located off-chip. The DSP then decompresses the compressed pixel data, performs image signal processing operations on the compressed pixel data, and then compresses the processed pixel data into a digital image format. The image sensor may buffer the pixel data for one or more images to accommodate for slowdown by the compression engine. The pixel data may be sorted by row and column of a pixel array. Alternatively, the pixel data may be sorted by color from a Bayer color filter.
Abstract translation: 图像传感器在将图像数据发送到DSP之前压缩图像数据。 图像传感器例如通过相机的光圈捕获表示图像的光。 焦平面阵列将捕获的光转换成像素数据。 像素数据被分类并被压缩引擎并行压缩。 压缩的像素数据然后被发送到可以位于芯片外的DSP。 然后,DSP解压缩压缩像素数据,对压缩像素数据执行图像信号处理操作,然后将经处理的像素数据压缩为数字图像格式。 图像传感器可以缓冲一个或多个图像的像素数据,以适应压缩引擎的减速。 像素数据可以按像素阵列的行和列排序。 或者,像素数据可以由拜耳滤色器的颜色分类。
-
公开(公告)号:US20150138397A1
公开(公告)日:2015-05-21
申请号:US14603563
申请日:2015-01-23
Applicant: GoPro, Inc.
Inventor: Scott Patrick Campbell , David A. Newman , Brian G. Schunck
IPC: H04N19/426 , H04N1/21
CPC classification number: H04N1/2137 , H04N1/00209 , H04N5/23206 , H04N5/335 , H04N5/341 , H04N5/374 , H04N9/045 , H04N19/0049 , H04N19/137 , H04N19/156 , H04N19/172 , H04N19/423 , H04N19/426 , H04N19/625 , H04N19/63 , H04N19/91
Abstract: An image sensor compresses image data prior to transmitting the image data to a DSP. The image sensor captures light representing an image, for instance via a camera's aperture. A focal plane array converts the captured light into pixel data. The pixel data is sorted into categories, and is compressed in parallel by a compression engine. The compressed pixel data is then sent to a DSP, which may be located off-chip. The DSP then decompresses the compressed pixel data, performs image signal processing operations on the compressed pixel data, and then compresses the processed pixel data into a digital image format. The image sensor may buffer the pixel data for one or more images to accommodate for slowdown by the compression engine. The pixel data may be sorted by row and column of a pixel array. Alternatively, the pixel data may be sorted by color from a Bayer color filter.
Abstract translation: 图像传感器在将图像数据发送到DSP之前压缩图像数据。 图像传感器例如通过相机的光圈捕获表示图像的光。 焦平面阵列将捕获的光转换成像素数据。 像素数据被分类并被压缩引擎并行压缩。 压缩的像素数据然后被发送到可以位于芯片外的DSP。 然后,DSP解压缩压缩像素数据,对压缩像素数据执行图像信号处理操作,然后将经处理的像素数据压缩为数字图像格式。 图像传感器可以缓冲一个或多个图像的像素数据,以适应压缩引擎的减速。 像素数据可以按像素阵列的行和列排序。 或者,像素数据可以由拜耳滤色器的颜色分类。
-
公开(公告)号:US20210385473A1
公开(公告)日:2021-12-09
申请号:US17400531
申请日:2021-08-12
Applicant: GoPro, Inc.
Inventor: David A. Newman , Brian G. Schunck
IPC: H04N19/44 , G11B20/00 , H04N19/423 , H04N19/63 , G11B27/031
Abstract: A system and method disposed to enable encoding, decoding and manipulation of digital video with substantially less processing load than would otherwise be required. In particular, one disclosed method is directed to generating a compressed video data structure that is selectively decodable to a plurality of resolutions including the full resolution of the uncompressed stream. The desired number of data components and the content of the data components that make up the compressed video data, which determine the available video resolutions, are variable based upon the processing carried out and the resources available to decode and process the data components. During decoding, efficiency is substantially improved because only the data components necessary to generate a desired resolution are decoded. In variations, both temporal and spatial decoding are utilized to reduce frame rates, and hence, further reduce processor load. The system and method are particularly useful for real-time video editing applications.
-
公开(公告)号:US10326904B2
公开(公告)日:2019-06-18
申请号:US16050305
申请日:2018-07-31
Applicant: GoPro, Inc.
Inventor: Scott Patrick Campbell , David A. Newman , Brian G. Schunck
IPC: H04N5/374 , H04N5/341 , H04N19/156 , H04N5/335 , H04N1/21 , H04N19/137 , H04N19/426 , H04N19/423 , H04N9/04 , H04N19/91 , H04N19/625 , H04N5/232 , H04N1/00 , H04N19/172 , H04N19/63
Abstract: Systems and methods are disclosed that capture and compress frames of pixel data. In an implementation, an image sensor chip is configured to convert light into pixel data and generate compressed pixel data at a variable compression rate including applying a transform to pixel data associated with a pixel category from a plurality of pixel categories. The variable compression rate is within an available bandwidth of an output bus configured to output the compressed pixel data.
-
公开(公告)号:US09967580B2
公开(公告)日:2018-05-08
申请号:US15354933
申请日:2016-11-17
Applicant: GoPro, Inc.
Inventor: David A. Newman , Brian G. Schunck
IPC: H04N19/44 , H04N19/423 , H04N19/63 , G11B27/031 , G11B20/00
CPC classification number: H04N19/44 , G11B20/00007 , G11B27/031 , G11B2020/00072 , H04N19/423 , H04N19/63
Abstract: A system and method disposed to enable encoding, decoding and manipulation of digital video with substantially less processing load than would otherwise required. In particular, one disclosed method is directed to generating a compressed video data structure that is selectively decodable to a plurality of resolutions including the full resolution of the uncompressed stream. The desired number of data components and the content of the data components that make up the compressed video data, which determine the available video resolutions, are variable based upon the processing carried out and the resources available to decode and process the data components. During decoding, efficiency is substantially improved because only the data components necessary to generate a desired resolution are decoded. In variations, both temporal and spatial decoding are utilized to reduce frame rates, and hence, further reduce processor load. The system and method are particularly useful for real-time video editing applications.
-
公开(公告)号:US09854263B2
公开(公告)日:2017-12-26
申请号:US14852868
申请日:2015-09-14
Applicant: GoPro, Inc.
Inventor: David A. Newman , Brian G. Schunck
IPC: H04N19/44 , H04N19/423 , H04N19/63 , G11B27/031 , G11B20/00
CPC classification number: H04N19/44 , G11B20/00007 , G11B27/031 , G11B2020/00072 , H04N19/423 , H04N19/63
Abstract: A system and method disposed to enable encoding, decoding and manipulation of digital video with substantially less processing load than would otherwise be required. In particular, one disclosed method is directed to generating a compressed video data structure that is selectively decodable to a plurality of resolutions including the full resolution of the uncompressed stream. The desired number of data components and the content of the data components that make up the compressed video data, which determine the available video resolutions, are variable based upon the processing carried out and the resources available to decode and process the data components. During decoding, efficiency is substantially improved because only the data components necessary to generate a desired resolution are decoded. In variations, both temporal and spatial decoding are utilized to reduce frame rates, and hence, further reduce processor load. The system and method are particularly useful for real-time video editing applications.
-
公开(公告)号:US20170171423A1
公开(公告)日:2017-06-15
申请号:US15445166
申请日:2017-02-28
Applicant: GoPro, Inc.
Inventor: Scott Patrick Campbell , David A. Newman , Brian G. Schunck
IPC: H04N1/21 , H04N5/374 , H04N19/426 , H04N19/172 , H04N9/04 , H04N19/91 , H04N19/137 , H04N19/625 , H04N19/156 , H04N1/00 , H04N19/63
CPC classification number: H04N1/2137 , H04N1/00209 , H04N5/23206 , H04N5/335 , H04N5/341 , H04N5/374 , H04N9/045 , H04N19/0049 , H04N19/137 , H04N19/156 , H04N19/172 , H04N19/423 , H04N19/426 , H04N19/625 , H04N19/63 , H04N19/91
Abstract: Systems and methods are disclosed that capture and compress frames of pixel data. In an implementation, an image sensor chip converts light into pixel data and generates transform data by applying a transform to a portion of the pixel data associated with a pixel category from a plurality of pixel categories and generates compressed pixel data at a variable compression rate by compressing the transform data. The variable compression rate is within an available bandwidth of an output bus that outputs the compressed pixel data.
-
-
-
-
-
-
-
-
-