Image sensor data compression and DSP decompression
    3.
    发明授权
    Image sensor data compression and DSP decompression 有权
    图像传感器数据压缩和DSP解压缩

    公开(公告)号:US08970726B2

    公开(公告)日:2015-03-03

    申请号:US14174812

    申请日:2014-02-06

    申请人: GoPro, Inc.

    IPC分类号: H04N5/228

    摘要: An image sensor compresses image data prior to transmitting the image data to a DSP. The image sensor captures light representing an image, for instance via a camera's aperture. A focal plane array converts the captured light into pixel data. The pixel data is sorted into categories, and is compressed in parallel by a compression engine. The compressed pixel data is then sent to a DSP, which may be located off-chip. The DSP then decompresses the compressed pixel data, performs image signal processing operations on the compressed pixel data, and then compresses the processed pixel data into a digital image format. The image sensor may buffer the pixel data for one or more images to accommodate for slowdown by the compression engine. The pixel data may be sorted by row and column of a pixel array. Alternatively, the pixel data may be sorted by color from a Bayer color filter.

    摘要翻译: 图像传感器在将图像数据发送到DSP之前压缩图像数据。 图像传感器例如通过相机的光圈捕获表示图像的光。 焦平面阵列将捕获的光转换成像素数据。 像素数据被分类并被压缩引擎并行压缩。 压缩的像素数据然后被发送到可以位于芯片外的DSP。 然后,DSP解压缩压缩像素数据,对压缩像素数据执行图像信号处理操作,然后将经处理的像素数据压缩为数字图像格式。 图像传感器可以缓冲一个或多个图像的像素数据,以适应压缩引擎的减速。 像素数据可以按像素阵列的行和列排序。 或者,像素数据可以由拜耳滤色器的颜色分类。

    IMAGE SENSOR DATA COMPRESSION AND DSP DECOMPRESSION
    4.
    发明申请
    IMAGE SENSOR DATA COMPRESSION AND DSP DECOMPRESSION 有权
    图像传感器数据压缩和DSP分解

    公开(公告)号:US20140152871A1

    公开(公告)日:2014-06-05

    申请号:US14174812

    申请日:2014-02-06

    申请人: GoPro, Inc.

    IPC分类号: H04N19/423 H04N1/21

    摘要: An image sensor compresses image data prior to transmitting the image data to a DSP. The image sensor captures light representing an image, for instance via a camera's aperture. A focal plane array converts the captured light into pixel data. The pixel data is sorted into categories, and is compressed in parallel by a compression engine. The compressed pixel data is then sent to a DSP, which may be located off-chip. The DSP then decompresses the compressed pixel data, performs image signal processing operations on the compressed pixel data, and then compresses the processed pixel data into a digital image format. The image sensor may buffer the pixel data for one or more images to accommodate for slowdown by the compression engine. The pixel data may be sorted by row and column of a pixel array. Alternatively, the pixel data may be sorted by color from a Bayer color filter.

    摘要翻译: 图像传感器在将图像数据发送到DSP之前压缩图像数据。 图像传感器例如通过相机的光圈捕获表示图像的光。 焦平面阵列将捕获的光转换成像素数据。 像素数据被分类并被压缩引擎并行压缩。 压缩的像素数据然后被发送到可以位于芯片外的DSP。 然后,DSP解压缩压缩像素数据,对压缩像素数据执行图像信号处理操作,然后将经处理的像素数据压缩为数字图像格式。 图像传感器可以缓冲一个或多个图像的像素数据,以适应压缩引擎的减速。 像素数据可以按像素阵列的行和列排序。 或者,像素数据可以由拜耳滤色器的颜色分类。

    Memory management for video decoding
    5.
    发明授权
    Memory management for video decoding 有权
    视频解码的内存管理

    公开(公告)号:US08731067B2

    公开(公告)日:2014-05-20

    申请号:US13223079

    申请日:2011-08-31

    IPC分类号: H04N7/12 H04N11/02 H04N11/04

    摘要: Techniques and tools described herein help manage memory efficiently during video decoding, especially when multiple video clips are concurrently decoded. For example, with clip-adaptive memory usage, a decoder determines first memory usage settings expected to be sufficient for decoding of a video clip. The decoder also determines second memory usage settings known to be sufficient for decoding of the clip. During decoding, memory usage is initially set according to the first settings. Memory usage is adaptively increased during decoding, subject to theoretical limits in the second settings. With adaptive early release of side information, the decoder can release side information memory for a picture earlier than the decoder releases image plane memory for the picture. The decoder can also adapt memory usage for decoded transform coefficients depending on whether the coefficients are for intra-coded blocks or inter-coded blocks, and also exploit the relative sparseness of non-zero coefficient values.

    摘要翻译: 这里描述的技术和工具有助于在视频解码期间有效地管理存储器,特别是当多个视频片段被同时解码时。 例如,利用剪辑自适应存储器使用,解码器确定预期对视频剪辑的解码足够的第一存储器使用设置。 解码器还确定已知足以解码剪辑的第二存储器使用设置。 在解码期间,最初根据第一个设置设置内存使用。 存储器使用在解码期间自适应地增加,受到第二设置中的理论限制。 利用辅助信息的适应性早期释放,解码器可以在解码器释放用于图像的图像平面存储器之前释放用于图像的侧信息存储器。 解码器还可以根据系数是用于帧内编码块还是帧间编码块来适应解码变换系数的存储器使用,并且还利用非零系数值的相对稀疏度。

    Memory management for video decoding
    7.
    发明授权
    Memory management for video decoding 有权
    视频解码的内存管理

    公开(公告)号:US09210421B2

    公开(公告)日:2015-12-08

    申请号:US14256351

    申请日:2014-04-18

    摘要: Techniques and tools described herein help manage memory efficiently during video decoding, especially when multiple video clips are concurrently decoded. For example, with clip-adaptive memory usage, a decoder determines first memory usage settings expected to be sufficient for decoding of a video clip. The decoder also determines second memory usage settings known to be sufficient for decoding of the clip. During decoding, memory usage is initially set according to the first settings. Memory usage is adaptively increased during decoding, subject to theoretical limits in the second settings. With adaptive early release of side information, the decoder can release side information memory for a picture earlier than the decoder releases image plane memory for the picture. The decoder can also adapt memory usage for decoded transform coefficients depending on whether the coefficients are for intra-coded blocks or inter-coded blocks, and also exploit the relative sparseness of non-zero coefficient values.

    摘要翻译: 这里描述的技术和工具有助于在视频解码期间有效地管理存储器,特别是当多个视频片段被同时解码时。 例如,利用剪辑自适应存储器使用,解码器确定预期对视频剪辑的解码足够的第一存储器使用设置。 解码器还确定已知足以解码剪辑的第二存储器使用设置。 在解码期间,最初根据第一个设置设置内存使用。 存储器使用在解码期间自适应地增加,受到第二设置中的理论限制。 利用辅助信息的适应性早期释放,解码器可以在解码器释放用于图像的图像平面存储器之前释放用于图像的侧信息存储器。 解码器还可以根据系数是用于帧内编码块还是帧间编码块来适应解码变换系数的存储器使用,并且还利用非零系数值的相对稀疏度。

    MEMORY MANAGEMENT FOR VIDEO DECODING
    8.
    发明申请
    MEMORY MANAGEMENT FOR VIDEO DECODING 有权
    视频解码的内存管理

    公开(公告)号:US20140226727A1

    公开(公告)日:2014-08-14

    申请号:US14256351

    申请日:2014-04-18

    IPC分类号: H04N19/426

    摘要: Techniques and tools described herein help manage memory efficiently during video decoding, especially when multiple video clips are concurrently decoded. For example, with clip-adaptive memory usage, a decoder determines first memory usage settings expected to be sufficient for decoding of a video clip. The decoder also determines second memory usage settings known to be sufficient for decoding of the clip. During decoding, memory usage is initially set according to the first settings. Memory usage is adaptively increased during decoding, subject to theoretical limits in the second settings. With adaptive early release of side information, the decoder can release side information memory for a picture earlier than the decoder releases image plane memory for the picture. The decoder can also adapt memory usage for decoded transform coefficients depending on whether the coefficients are for intra-coded blocks or inter-coded blocks, and also exploit the relative sparseness of non-zero coefficient values.

    摘要翻译: 这里描述的技术和工具有助于在视频解码期间有效地管理存储器,特别是当多个视频片段被同时解码时。 例如,利用剪辑自适应存储器使用,解码器确定预期对视频剪辑的解码足够的第一存储器使用设置。 解码器还确定已知足以解码剪辑的第二存储器使用设置。 在解码期间,最初根据第一个设置设置内存使用。 存储器使用在解码期间自适应地增加,受到第二设置中的理论限制。 利用辅助信息的适应性早期释放,解码器可以在解码器释放用于图像的图像平面存储器之前释放用于图像的侧信息存储器。 解码器还可以根据系数是用于帧内编码块还是帧间编码块来适应解码变换系数的存储器使用,并且还利用非零系数值的相对稀疏度。

    ON-CHIP IMAGE SENSOR DATA COMPRESSION
    9.
    发明申请
    ON-CHIP IMAGE SENSOR DATA COMPRESSION 有权
    片内图像传感器数据压缩

    公开(公告)号:US20140152872A1

    公开(公告)日:2014-06-05

    申请号:US14174814

    申请日:2014-02-06

    申请人: GoPro, Inc.

    IPC分类号: H04N19/426 H04N1/21

    摘要: An image sensor compresses image data prior to transmitting the image data to a DSP. The image sensor captures light representing an image, for instance via a camera's aperture. A focal plane array converts the captured light into pixel data. The pixel data is sorted into categories, and is compressed in parallel by a compression engine. The compressed pixel data is then sent to a DSP, which may be located off-chip. The DSP then decompresses the compressed pixel data, performs image signal processing operations on the compressed pixel data, and then compresses the processed pixel data into a digital image format. The image sensor may buffer the pixel data for one or more images to accommodate for slowdown by the compression engine. The pixel data may be sorted by row and column of a pixel array. Alternatively, the pixel data may be sorted by color from a Bayer color filter.

    摘要翻译: 图像传感器在将图像数据发送到DSP之前压缩图像数据。 图像传感器例如通过相机的光圈捕获表示图像的光。 焦平面阵列将捕获的光转换成像素数据。 像素数据被分类并被压缩引擎并行压缩。 压缩的像素数据然后被发送到可以位于芯片外的DSP。 然后,DSP解压缩压缩像素数据,对压缩像素数据执行图像信号处理操作,然后将经处理的像素数据压缩为数字图像格式。 图像传感器可以缓冲一个或多个图像的像素数据,以适应压缩引擎的减速。 像素数据可以按像素阵列的行和列排序。 或者,像素数据可以由拜耳滤色器的颜色分类。