-
公开(公告)号:US09338373B2
公开(公告)日:2016-05-10
申请号:US14603563
申请日:2015-01-23
申请人: GoPro, Inc.
IPC分类号: H04N5/335 , H04N5/341 , H04N19/426 , H04N19/423 , H04N5/232 , H04N1/21
CPC分类号: H04N1/2137 , H04N1/00209 , H04N5/23206 , H04N5/335 , H04N5/341 , H04N5/374 , H04N9/045 , H04N19/0049 , H04N19/137 , H04N19/156 , H04N19/172 , H04N19/423 , H04N19/426 , H04N19/625 , H04N19/63 , H04N19/91
摘要: An image sensor compresses image data prior to transmitting the image data to a DSP. The image sensor captures light representing an image, for instance via a camera's aperture. A focal plane array converts the captured light into pixel data. The pixel data is sorted into categories, and is compressed in parallel by a compression engine. The compressed pixel data is then sent to a DSP, which may be located off-chip. The DSP then decompresses the compressed pixel data, performs image signal processing operations on the compressed pixel data, and then compresses the processed pixel data into a digital image format. The image sensor may buffer the pixel data for one or more images to accommodate for slowdown by the compression engine. The pixel data may be sorted by row and column of a pixel array. Alternatively, the pixel data may be sorted by color from a Bayer color filter.
-
公开(公告)号:US20180338060A1
公开(公告)日:2018-11-22
申请号:US16050305
申请日:2018-07-31
申请人: GoPro, Inc.
IPC分类号: H04N1/21 , H04N9/04 , H04N5/374 , H04N5/341 , H04N5/335 , H04N5/232 , H04N1/00 , H04N19/137 , H04N19/63 , H04N19/625 , H04N19/426 , H04N19/423 , H04N19/172 , H04N19/156 , H04N19/91
CPC分类号: H04N1/2137 , H04N1/00209 , H04N5/23206 , H04N5/335 , H04N5/341 , H04N5/374 , H04N9/045 , H04N19/0049 , H04N19/137 , H04N19/156 , H04N19/172 , H04N19/423 , H04N19/426 , H04N19/625 , H04N19/63 , H04N19/91
摘要: Systems and methods are disclosed that capture and compress frames of pixel data. In an implementation, an image sensor chip is configured to convert light into pixel data and generate compressed pixel data at a variable compression rate including applying a transform to pixel data associated with a pixel category from a plurality of pixel categories. The variable compression rate is within an available bandwidth of an output bus configured to output the compressed pixel data.
-
公开(公告)号:US08970726B2
公开(公告)日:2015-03-03
申请号:US14174812
申请日:2014-02-06
申请人: GoPro, Inc.
IPC分类号: H04N5/228
CPC分类号: H04N1/2137 , H04N1/00209 , H04N5/23206 , H04N5/335 , H04N5/341 , H04N5/374 , H04N9/045 , H04N19/0049 , H04N19/137 , H04N19/156 , H04N19/172 , H04N19/423 , H04N19/426 , H04N19/625 , H04N19/63 , H04N19/91
摘要: An image sensor compresses image data prior to transmitting the image data to a DSP. The image sensor captures light representing an image, for instance via a camera's aperture. A focal plane array converts the captured light into pixel data. The pixel data is sorted into categories, and is compressed in parallel by a compression engine. The compressed pixel data is then sent to a DSP, which may be located off-chip. The DSP then decompresses the compressed pixel data, performs image signal processing operations on the compressed pixel data, and then compresses the processed pixel data into a digital image format. The image sensor may buffer the pixel data for one or more images to accommodate for slowdown by the compression engine. The pixel data may be sorted by row and column of a pixel array. Alternatively, the pixel data may be sorted by color from a Bayer color filter.
摘要翻译: 图像传感器在将图像数据发送到DSP之前压缩图像数据。 图像传感器例如通过相机的光圈捕获表示图像的光。 焦平面阵列将捕获的光转换成像素数据。 像素数据被分类并被压缩引擎并行压缩。 压缩的像素数据然后被发送到可以位于芯片外的DSP。 然后,DSP解压缩压缩像素数据,对压缩像素数据执行图像信号处理操作,然后将经处理的像素数据压缩为数字图像格式。 图像传感器可以缓冲一个或多个图像的像素数据,以适应压缩引擎的减速。 像素数据可以按像素阵列的行和列排序。 或者,像素数据可以由拜耳滤色器的颜色分类。
-
公开(公告)号:US20140152871A1
公开(公告)日:2014-06-05
申请号:US14174812
申请日:2014-02-06
申请人: GoPro, Inc.
IPC分类号: H04N19/423 , H04N1/21
CPC分类号: H04N1/2137 , H04N1/00209 , H04N5/23206 , H04N5/335 , H04N5/341 , H04N5/374 , H04N9/045 , H04N19/0049 , H04N19/137 , H04N19/156 , H04N19/172 , H04N19/423 , H04N19/426 , H04N19/625 , H04N19/63 , H04N19/91
摘要: An image sensor compresses image data prior to transmitting the image data to a DSP. The image sensor captures light representing an image, for instance via a camera's aperture. A focal plane array converts the captured light into pixel data. The pixel data is sorted into categories, and is compressed in parallel by a compression engine. The compressed pixel data is then sent to a DSP, which may be located off-chip. The DSP then decompresses the compressed pixel data, performs image signal processing operations on the compressed pixel data, and then compresses the processed pixel data into a digital image format. The image sensor may buffer the pixel data for one or more images to accommodate for slowdown by the compression engine. The pixel data may be sorted by row and column of a pixel array. Alternatively, the pixel data may be sorted by color from a Bayer color filter.
摘要翻译: 图像传感器在将图像数据发送到DSP之前压缩图像数据。 图像传感器例如通过相机的光圈捕获表示图像的光。 焦平面阵列将捕获的光转换成像素数据。 像素数据被分类并被压缩引擎并行压缩。 压缩的像素数据然后被发送到可以位于芯片外的DSP。 然后,DSP解压缩压缩像素数据,对压缩像素数据执行图像信号处理操作,然后将经处理的像素数据压缩为数字图像格式。 图像传感器可以缓冲一个或多个图像的像素数据,以适应压缩引擎的减速。 像素数据可以按像素阵列的行和列排序。 或者,像素数据可以由拜耳滤色器的颜色分类。
-
公开(公告)号:US08731067B2
公开(公告)日:2014-05-20
申请号:US13223079
申请日:2011-08-31
申请人: Yongjun Wu , Shyam Sadhwani
发明人: Yongjun Wu , Shyam Sadhwani
CPC分类号: H04N19/423 , H04N19/0049 , H04N19/127 , H04N19/136 , H04N19/159 , H04N19/172 , H04N19/176 , H04N19/426 , H04N19/44
摘要: Techniques and tools described herein help manage memory efficiently during video decoding, especially when multiple video clips are concurrently decoded. For example, with clip-adaptive memory usage, a decoder determines first memory usage settings expected to be sufficient for decoding of a video clip. The decoder also determines second memory usage settings known to be sufficient for decoding of the clip. During decoding, memory usage is initially set according to the first settings. Memory usage is adaptively increased during decoding, subject to theoretical limits in the second settings. With adaptive early release of side information, the decoder can release side information memory for a picture earlier than the decoder releases image plane memory for the picture. The decoder can also adapt memory usage for decoded transform coefficients depending on whether the coefficients are for intra-coded blocks or inter-coded blocks, and also exploit the relative sparseness of non-zero coefficient values.
摘要翻译: 这里描述的技术和工具有助于在视频解码期间有效地管理存储器,特别是当多个视频片段被同时解码时。 例如,利用剪辑自适应存储器使用,解码器确定预期对视频剪辑的解码足够的第一存储器使用设置。 解码器还确定已知足以解码剪辑的第二存储器使用设置。 在解码期间,最初根据第一个设置设置内存使用。 存储器使用在解码期间自适应地增加,受到第二设置中的理论限制。 利用辅助信息的适应性早期释放,解码器可以在解码器释放用于图像的图像平面存储器之前释放用于图像的侧信息存储器。 解码器还可以根据系数是用于帧内编码块还是帧间编码块来适应解码变换系数的存储器使用,并且还利用非零系数值的相对稀疏度。
-
公开(公告)号:US20170171423A1
公开(公告)日:2017-06-15
申请号:US15445166
申请日:2017-02-28
申请人: GoPro, Inc.
IPC分类号: H04N1/21 , H04N5/374 , H04N19/426 , H04N19/172 , H04N9/04 , H04N19/91 , H04N19/137 , H04N19/625 , H04N19/156 , H04N1/00 , H04N19/63
CPC分类号: H04N1/2137 , H04N1/00209 , H04N5/23206 , H04N5/335 , H04N5/341 , H04N5/374 , H04N9/045 , H04N19/0049 , H04N19/137 , H04N19/156 , H04N19/172 , H04N19/423 , H04N19/426 , H04N19/625 , H04N19/63 , H04N19/91
摘要: Systems and methods are disclosed that capture and compress frames of pixel data. In an implementation, an image sensor chip converts light into pixel data and generates transform data by applying a transform to a portion of the pixel data associated with a pixel category from a plurality of pixel categories and generates compressed pixel data at a variable compression rate by compressing the transform data. The variable compression rate is within an available bandwidth of an output bus that outputs the compressed pixel data.
-
公开(公告)号:US09210421B2
公开(公告)日:2015-12-08
申请号:US14256351
申请日:2014-04-18
发明人: Yongjun Wu , Shyam Sadhwani
IPC分类号: H04N7/12 , H04N11/02 , H04N11/04 , H04N19/426 , H04N19/44 , H04N19/172 , H04N19/159 , H04N19/127 , H04N19/136 , H04N19/423
CPC分类号: H04N19/423 , H04N19/0049 , H04N19/127 , H04N19/136 , H04N19/159 , H04N19/172 , H04N19/176 , H04N19/426 , H04N19/44
摘要: Techniques and tools described herein help manage memory efficiently during video decoding, especially when multiple video clips are concurrently decoded. For example, with clip-adaptive memory usage, a decoder determines first memory usage settings expected to be sufficient for decoding of a video clip. The decoder also determines second memory usage settings known to be sufficient for decoding of the clip. During decoding, memory usage is initially set according to the first settings. Memory usage is adaptively increased during decoding, subject to theoretical limits in the second settings. With adaptive early release of side information, the decoder can release side information memory for a picture earlier than the decoder releases image plane memory for the picture. The decoder can also adapt memory usage for decoded transform coefficients depending on whether the coefficients are for intra-coded blocks or inter-coded blocks, and also exploit the relative sparseness of non-zero coefficient values.
摘要翻译: 这里描述的技术和工具有助于在视频解码期间有效地管理存储器,特别是当多个视频片段被同时解码时。 例如,利用剪辑自适应存储器使用,解码器确定预期对视频剪辑的解码足够的第一存储器使用设置。 解码器还确定已知足以解码剪辑的第二存储器使用设置。 在解码期间,最初根据第一个设置设置内存使用。 存储器使用在解码期间自适应地增加,受到第二设置中的理论限制。 利用辅助信息的适应性早期释放,解码器可以在解码器释放用于图像的图像平面存储器之前释放用于图像的侧信息存储器。 解码器还可以根据系数是用于帧内编码块还是帧间编码块来适应解码变换系数的存储器使用,并且还利用非零系数值的相对稀疏度。
-
公开(公告)号:US20140226727A1
公开(公告)日:2014-08-14
申请号:US14256351
申请日:2014-04-18
发明人: Yongjun Wu , Shyam Sadhwani
IPC分类号: H04N19/426
CPC分类号: H04N19/423 , H04N19/0049 , H04N19/127 , H04N19/136 , H04N19/159 , H04N19/172 , H04N19/176 , H04N19/426 , H04N19/44
摘要: Techniques and tools described herein help manage memory efficiently during video decoding, especially when multiple video clips are concurrently decoded. For example, with clip-adaptive memory usage, a decoder determines first memory usage settings expected to be sufficient for decoding of a video clip. The decoder also determines second memory usage settings known to be sufficient for decoding of the clip. During decoding, memory usage is initially set according to the first settings. Memory usage is adaptively increased during decoding, subject to theoretical limits in the second settings. With adaptive early release of side information, the decoder can release side information memory for a picture earlier than the decoder releases image plane memory for the picture. The decoder can also adapt memory usage for decoded transform coefficients depending on whether the coefficients are for intra-coded blocks or inter-coded blocks, and also exploit the relative sparseness of non-zero coefficient values.
摘要翻译: 这里描述的技术和工具有助于在视频解码期间有效地管理存储器,特别是当多个视频片段被同时解码时。 例如,利用剪辑自适应存储器使用,解码器确定预期对视频剪辑的解码足够的第一存储器使用设置。 解码器还确定已知足以解码剪辑的第二存储器使用设置。 在解码期间,最初根据第一个设置设置内存使用。 存储器使用在解码期间自适应地增加,受到第二设置中的理论限制。 利用辅助信息的适应性早期释放,解码器可以在解码器释放用于图像的图像平面存储器之前释放用于图像的侧信息存储器。 解码器还可以根据系数是用于帧内编码块还是帧间编码块来适应解码变换系数的存储器使用,并且还利用非零系数值的相对稀疏度。
-
公开(公告)号:US20140152872A1
公开(公告)日:2014-06-05
申请号:US14174814
申请日:2014-02-06
申请人: GoPro, Inc.
IPC分类号: H04N19/426 , H04N1/21
CPC分类号: H04N1/2137 , H04N1/00209 , H04N5/23206 , H04N5/335 , H04N5/341 , H04N5/374 , H04N9/045 , H04N19/0049 , H04N19/137 , H04N19/156 , H04N19/172 , H04N19/423 , H04N19/426 , H04N19/625 , H04N19/63 , H04N19/91
摘要: An image sensor compresses image data prior to transmitting the image data to a DSP. The image sensor captures light representing an image, for instance via a camera's aperture. A focal plane array converts the captured light into pixel data. The pixel data is sorted into categories, and is compressed in parallel by a compression engine. The compressed pixel data is then sent to a DSP, which may be located off-chip. The DSP then decompresses the compressed pixel data, performs image signal processing operations on the compressed pixel data, and then compresses the processed pixel data into a digital image format. The image sensor may buffer the pixel data for one or more images to accommodate for slowdown by the compression engine. The pixel data may be sorted by row and column of a pixel array. Alternatively, the pixel data may be sorted by color from a Bayer color filter.
摘要翻译: 图像传感器在将图像数据发送到DSP之前压缩图像数据。 图像传感器例如通过相机的光圈捕获表示图像的光。 焦平面阵列将捕获的光转换成像素数据。 像素数据被分类并被压缩引擎并行压缩。 压缩的像素数据然后被发送到可以位于芯片外的DSP。 然后,DSP解压缩压缩像素数据,对压缩像素数据执行图像信号处理操作,然后将经处理的像素数据压缩为数字图像格式。 图像传感器可以缓冲一个或多个图像的像素数据,以适应压缩引擎的减速。 像素数据可以按像素阵列的行和列排序。 或者,像素数据可以由拜耳滤色器的颜色分类。
-
公开(公告)号:US20160227068A1
公开(公告)日:2016-08-04
申请号:US15096479
申请日:2016-04-12
申请人: GoPro, Inc.
IPC分类号: H04N1/21 , H04N5/341 , H04N1/00 , H04N19/426
CPC分类号: H04N1/2137 , H04N1/00209 , H04N5/23206 , H04N5/335 , H04N5/341 , H04N5/374 , H04N9/045 , H04N19/0049 , H04N19/137 , H04N19/156 , H04N19/172 , H04N19/423 , H04N19/426 , H04N19/625 , H04N19/63 , H04N19/91
摘要: An image sensor compresses image data prior to transmitting the image data to a DSP. The image sensor captures light representing an image, for instance via a camera's aperture. A focal plane array converts the captured light into pixel data. The pixel data is sorted into categories, and is compressed in parallel by a compression engine. The compressed pixel data is then sent to a DSP, which may be located off-chip. The DSP then decompresses the compressed pixel data, performs image signal processing operations on the compressed pixel data, and then compresses the processed pixel data into a digital image format. The image sensor may buffer the pixel data for one or more images to accommodate for slowdown by the compression engine. The pixel data may be sorted by row and column of a pixel array. Alternatively, the pixel data may be sorted by color from a Bayer color filter.
-
-
-
-
-
-
-
-
-