公开(公告)号：US11375139B2

公开(公告)日：2022-06-28

申请号：US16914934

申请日：2020-06-29

Applicant: GoPro, Inc.

Inventor： Scott Patrick Campbell ,  David A. Newman ,  Brian G. Schunck

IPC: H04N5/341 ,  H04N5/232 ,  H04N19/423 ,  H04N19/426 ,  H04N9/04 ,  H04N1/21 ,  H04N5/335 ,  H04N1/00 ,  H04N19/137 ,  H04N19/156 ,  H04N19/172 ,  H04N19/625 ,  H04N19/63 ,  H04N19/91

Abstract: Systems and methods are disclosed that capture and compress frames of pixel data. In an implementation, an image sensor chip is configured to convert light into pixel data and generate compressed pixel data at a variable compression rate including applying a transform to pixel data associated with a pixel category from a plurality of pixel categories. The variable compression rate is within an available bandwidth of an output bus configured to output the compressed pixel data.

公开(公告)号：US20190260901A1

公开(公告)日：2019-08-22

申请号：US16401529

申请日：2019-05-02

Applicant: GoPro, Inc.

Inventor： Scott Patrick Campbell ,  David A. Newman ,  Brian G. Schunck

IPC: H04N1/21 ,  H04N5/232 ,  H04N5/341 ,  H04N19/426 ,  H04N19/423 ,  H04N9/04 ,  H04N19/91 ,  H04N5/335 ,  H04N19/137 ,  H04N19/156 ,  H04N19/172 ,  H04N19/625 ,  H04N19/63 ,  H04N1/00 ,  H04N5/374

Abstract: Systems and methods are disclosed that capture and compress frames of pixel data. In an implementation, an image sensor chip is configured to convert light into pixel data and generate compressed pixel data at a variable compression rate including applying a transform to pixel data associated with a pixel category from a plurality of pixel categories. The variable compression rate is within an available bandwidth of an output bus configured to output the compressed pixel data.

公开(公告)号：US20180338060A1

公开(公告)日：2018-11-22

申请号：US16050305

申请日：2018-07-31

Applicant: GoPro, Inc.

Inventor： Scott Patrick Campbell ,  David A. Newman ,  Brian G. Schunck

IPC: H04N1/21 ,  H04N9/04 ,  H04N5/374 ,  H04N5/341 ,  H04N5/335 ,  H04N5/232 ,  H04N1/00 ,  H04N19/137 ,  H04N19/63 ,  H04N19/625 ,  H04N19/426 ,  H04N19/423 ,  H04N19/172 ,  H04N19/156 ,  H04N19/91

CPC classification number: H04N1/2137 ,  H04N1/00209 ,  H04N5/23206 ,  H04N5/335 ,  H04N5/341 ,  H04N5/374 ,  H04N9/045 ,  H04N19/0049 ,  H04N19/137 ,  H04N19/156 ,  H04N19/172 ,  H04N19/423 ,  H04N19/426 ,  H04N19/625 ,  H04N19/63 ,  H04N19/91

Abstract: Systems and methods are disclosed that capture and compress frames of pixel data. In an implementation, an image sensor chip is configured to convert light into pixel data and generate compressed pixel data at a variable compression rate including applying a transform to pixel data associated with a pixel category from a plurality of pixel categories. The variable compression rate is within an available bandwidth of an output bus configured to output the compressed pixel data.

公开(公告)号：US20170026658A1

公开(公告)日：2017-01-26

申请号：US15288836

申请日：2016-10-07

Applicant: GoPro, Inc.

Inventor： David A. Newman ,  Brian G. Schunck

IPC: H04N19/44 ,  H04N19/423 ,  H04N19/63 ,  G11B20/00 ,  G11B27/031

CPC classification number: H04N19/44 ,  G11B20/00007 ,  G11B27/031 ,  G11B2020/00072 ,  H04N19/423 ,  H04N19/63

Abstract: A system and method disposed to enable encoding, decoding and manipulation of digital video with substantially less processing load than would otherwise required. In particular, one disclosed method is directed to generating a compressed video data structure that is selectively decodable to a plurality of resolutions including the full resolution of the uncompressed stream. The desired number of data components and the content of the data components that make up the compressed video data, which determine the available video resolutions, are variable based upon the processing carried out and the resources available to decode and process the data components. During decoding, efficiency is substantially improved because only the data components necessary to generate a desired resolution are decoded. In variations, both temporal and spatial decoding are utilized to reduce frame rates, and hence, further reduce processor load. The system and method are particularly useful for real-time video editing applications.

Abstract translation: 一种系统和方法，其被设置为使得能够以比其它方式要求的处理负载小得多的数字视频进行编码，解码和操纵。 特别地，一种公开的方法涉及生成可选择性地解码为包括未压缩流的全分辨率的多种分辨率的压缩视频数据结构。 基于执行的处理和可用于解码和处理数据组件的资源，确定可用视频分辨率的组成压缩视频数据的数据组件的期望数量和数据组件的内容是可变的。 在解码期间，由于仅产生所需分辨率所需的数据分量被解码，所以效率显着提高。 在变型中，利用时间和空间解码来降低帧速率，并因此进一步减少处理器负载。 该系统和方法对于实时视频编辑应用特别有用。

公开(公告)号：US20150010286A1

公开(公告)日：2015-01-08

申请号：US14340873

申请日：2014-07-25

Applicant: GoPro, Inc.

Inventor： David A. Newman ,  Brian G. Schunck

IPC: G11B27/028 ,  G11B27/00 ,  G11B20/00

CPC classification number: H04N19/44 ,  G11B20/00007 ,  G11B27/031 ,  G11B2020/00072 ,  H04N19/423 ,  H04N19/63

Abstract: A system and method disposed to enable encoding, decoding and manipulation of digital video with substantially less processing load than would otherwise be required. In particular, one disclosed method is directed to generating a compressed video data structure that is selectively decodable to a plurality of resolutions including the full resolution of the uncompressed stream. The desired number of data components and the content of the data components that make up the compressed video data, which determine the available video resolutions, are variable based upon the processing carried out and the resources available to decode and process the data components. During decoding, efficiency is substantially improved because only the data components necessary to generate a desired resolution are decoded. In variations, both temporal and spatial decoding are utilized to reduce frame rates, and hence, further reduce processor load. The system and method are particularly useful for real-time video editing applications.

公开(公告)号：US20200021829A1

公开(公告)日：2020-01-16

申请号：US16538693

申请日：2019-08-12

Applicant: GoPro, Inc.

Inventor： David A. Newman ,  Brian G. Schunck

IPC: H04N19/44 ,  G11B27/031 ,  H04N19/63 ,  G11B20/00 ,  H04N19/423

Abstract: A system and method disposed to enable encoding, decoding and manipulation of digital video with substantially less processing load than would otherwise required. In particular, one disclosed method is directed to generating a compressed video data structure that is selectively decodable to a plurality of resolutions including the full resolution of the uncompressed stream. The desired number of data components and the content of the data components that make up the compressed video data, which determine the available video resolutions, are variable based upon the processing carried out and the resources available to decode and process the data components. During decoding, efficiency is substantially improved because only the data components necessary to generate a desired resolution are decoded. In variations, both temporal and spatial decoding are utilized to reduce frame rates, and hence, further reduce processor load. The system and method are particularly useful for real-time video editing applications.

公开(公告)号：US10044899B2

公开(公告)日：2018-08-07

申请号：US15445166

申请日：2017-02-28

Applicant: GoPro, Inc.

Inventor： Scott Patrick Campbell ,  David A. Newman ,  Brian G. Schunck

IPC: H04N1/21 ,  H04N9/04 ,  H04N19/137 ,  H04N19/625 ,  H04N19/91 ,  H04N19/172 ,  H04N19/156 ,  H04N5/374 ,  H04N19/426 ,  H04N19/63 ,  H04N1/00

Abstract: Systems and methods are disclosed that capture and compress frames of pixel data. In an implementation, an image sensor chip converts light into pixel data and generates transform data by applying a transform to a portion of the pixel data associated with a pixel category from a plurality of pixel categories and generates compressed pixel data at a variable compression rate by compressing the transform data. The variable compression rate is within an available bandwidth of an output bus that outputs the compressed pixel data.

公开(公告)号：US20170201760A1

公开(公告)日：2017-07-13

申请号：US15414496

申请日：2017-01-24

Applicant: GoPro, Inc.

Inventor： David A. Newman ,  Brian G. Schunck

IPC: H04N19/44 ,  H04N19/63 ,  G11B27/031 ,  H04N19/423

CPC classification number: H04N19/44 ,  G11B20/00007 ,  G11B27/031 ,  G11B2020/00072 ,  H04N19/423 ,  H04N19/63

Abstract: A system and method disposed to enable encoding, decoding and manipulation of digital video with substantially less processing load than would otherwise required. In particular, one disclosed method is directed to generating a compressed video data structure that is selectively decodable to a plurality of resolutions including the full resolution of the uncompressed stream. The desired number of data components and the content of the data components that make up the compressed video data, which determine the available video resolutions, are variable based upon the processing carried out and the resources available to decode and process the data components. During decoding, efficiency is substantially improved because only the data components necessary to generate a desired resolution are decoded. In variations, both temporal and spatial decoding are utilized to reduce frame rates, and hence, further reduce processor load. The system and method are particularly useful for real-time video editing applications.

公开(公告)号：US20170142435A1

公开(公告)日：2017-05-18

申请号：US15354933

申请日：2016-11-17

Applicant: GoPro, Inc.

Inventor： David A. Newman ,  Brian G. Schunck

IPC: H04N19/44 ,  G11B20/00 ,  H04N19/63 ,  G11B27/031 ,  H04N19/423

CPC classification number: H04N19/44 ,  G11B20/00007 ,  G11B27/031 ,  G11B2020/00072 ,  H04N19/423 ,  H04N19/63

Abstract: A system and method disposed to enable encoding, decoding and manipulation of digital video with substantially less processing load than would otherwise required. In particular, one disclosed method is directed to generating a compressed video data structure that is selectively decodable to a plurality of resolutions including the full resolution of the uncompressed stream. The desired number of data components and the content of the data components that make up the compressed video data, which determine the available video resolutions, are variable based upon the processing carried out and the resources available to decode and process the data components. During decoding, efficiency is substantially improved because only the data components necessary to generate a desired resolution are decoded. In variations, both temporal and spatial decoding are utilized to reduce frame rates, and hence, further reduce processor load. The system and method are particularly useful for real-time video editing applications.

公开(公告)号：US09338373B2

公开(公告)日：2016-05-10

申请号：US14603563

申请日：2015-01-23

Applicant: GoPro, Inc.

Inventor： Scott Patrick Campbell ,  David A. Newman ,  Brian G. Schunck

IPC: H04N5/335 ,  H04N5/341 ,  H04N19/426 ,  H04N19/423 ,  H04N5/232 ,  H04N1/21

CPC classification number: H04N1/2137 ,  H04N1/00209 ,  H04N5/23206 ,  H04N5/335 ,  H04N5/341 ,  H04N5/374 ,  H04N9/045 ,  H04N19/0049 ,  H04N19/137 ,  H04N19/156 ,  H04N19/172 ,  H04N19/423 ,  H04N19/426 ,  H04N19/625 ,  H04N19/63 ,  H04N19/91

Abstract: An image sensor compresses image data prior to transmitting the image data to a DSP. The image sensor captures light representing an image, for instance via a camera's aperture. A focal plane array converts the captured light into pixel data. The pixel data is sorted into categories, and is compressed in parallel by a compression engine. The compressed pixel data is then sent to a DSP, which may be located off-chip. The DSP then decompresses the compressed pixel data, performs image signal processing operations on the compressed pixel data, and then compresses the processed pixel data into a digital image format. The image sensor may buffer the pixel data for one or more images to accommodate for slowdown by the compression engine. The pixel data may be sorted by row and column of a pixel array. Alternatively, the pixel data may be sorted by color from a Bayer color filter.