公开(公告)号：US09635262B2

公开(公告)日：2017-04-25

申请号：US15282423

申请日：2016-09-30

Applicant: GoPro, Inc.

Inventor： Scott Patrick Campbell ,  Paul Mobbs ,  Balineedu Chowdary Adsumilli ,  Sumit Chawla

IPC: H04N5/232 ,  G06T3/40 ,  H04N5/247 ,  H04N19/102 ,  H04N19/172 ,  H04N19/169 ,  H04N1/60 ,  H04N19/91 ,  H04N19/63

CPC classification number: G06T1/20 ,  G06T3/4015 ,  H04N1/6019 ,  H04N1/6027 ,  H04N5/232 ,  H04N5/23212 ,  H04N5/23216 ,  H04N5/23222 ,  H04N5/23229 ,  H04N5/23241 ,  H04N5/23245 ,  H04N5/23254 ,  H04N5/23267 ,  H04N5/23296 ,  H04N5/2353 ,  H04N5/247 ,  H04N5/374 ,  H04N5/378 ,  H04N9/045 ,  H04N9/09 ,  H04N9/735 ,  H04N9/8042 ,  H04N19/102 ,  H04N19/12 ,  H04N19/132 ,  H04N19/156 ,  H04N19/164 ,  H04N19/172 ,  H04N19/186 ,  H04N19/1883 ,  H04N19/33 ,  H04N19/42 ,  H04N19/423 ,  H04N19/44 ,  H04N19/517 ,  H04N19/63 ,  H04N19/91

Abstract: An image capture accelerator performs accelerated processing of image data. In one embodiment, the image capture accelerator includes accelerator circuitry including a pre-processing engine and a compression engine. The pre-processing engine is configured to perform accelerated processing on received image data, and the compression engine is configured to compress processed image data received from the pre-processing engine. In one embodiment, the image capture accelerator further includes a demultiplexer configured to receive image data captured by an image sensor array implemented within, for example, an image sensor chip. The demultiplexer may output the received image data to an image signal processor when the image data is captured by the image sensor array in a standard capture mode, and may output the received image data to the accelerator circuitry when the image data is captured by the image sensor array in an accelerated capture mode.

公开(公告)号：US20170045708A1

公开(公告)日：2017-02-16

申请号：US15233935

申请日：2016-08-10

Applicant: GoPro, Inc.

Inventor： Scott Patrick Campbell

IPC: G02B7/18 ,  G03B17/12 ,  G02B7/02

CPC classification number: G02B7/008 ,  G02B7/028 ,  G02B7/1805 ,  G02B7/181 ,  G03B17/12

Abstract: To compensate for a focal plane shifting away from an image plane due to a temperature change, an integrated image sensor and lens assembly includes an optical component and an optics compensator including passively actuating elements. The passively actuating elements couple the optical component to the inner surface of the lens mount. The passively actuating elements and the optics component are configured such that the focal plane is maintained to coincide with or substantially coincide with the image plane. The passively actuating elements and the optics component adjust the distance an incident ray travels in the optics compensator when the temperature changes to thereby maintaining the focal plane to coincide with or substantially coincide with the image plane.

Abstract translation: 为了补偿由于温度变化而偏离图像平面的焦平面，集成的图像传感器和透镜组件包括光学部件和包括被动致动元件的光学补偿器。 被动致动元件将光学部件耦合到透镜支架的内表面。 被动致动元件和光学部件被构造成使焦平面保持与图像平面重合或基本上重合。 当温度变化时，被动致动元件和光学部件调节入射光线在光学补偿器中行进的距离，从而保持焦平面与图像平面重合或基本上重合。

公开(公告)号：US20170019606A1

公开(公告)日：2017-01-19

申请号：US15282306

申请日：2016-09-30

Applicant: GoPro, Inc.

Inventor： Scott Patrick Campbell ,  Paul Mobbs ,  Balineedu Chowdary Adsumilli ,  Sumit Chawla

IPC: H04N5/232 ,  H04N19/91 ,  H04N5/247 ,  G06T3/40 ,  H04N19/169 ,  H04N19/172

CPC classification number: G06T1/20 ,  G06T3/4015 ,  H04N1/6019 ,  H04N1/6027 ,  H04N5/232 ,  H04N5/23212 ,  H04N5/23216 ,  H04N5/23222 ,  H04N5/23229 ,  H04N5/23241 ,  H04N5/23245 ,  H04N5/23254 ,  H04N5/23267 ,  H04N5/23296 ,  H04N5/2353 ,  H04N5/247 ,  H04N5/374 ,  H04N5/378 ,  H04N9/045 ,  H04N9/09 ,  H04N9/735 ,  H04N9/8042 ,  H04N19/102 ,  H04N19/12 ,  H04N19/132 ,  H04N19/156 ,  H04N19/164 ,  H04N19/172 ,  H04N19/186 ,  H04N19/1883 ,  H04N19/33 ,  H04N19/42 ,  H04N19/423 ,  H04N19/44 ,  H04N19/517 ,  H04N19/63 ,  H04N19/91

Abstract: An image capture accelerator performs accelerated processing of image data. In one embodiment, the image capture accelerator includes accelerator circuitry including a pre-processing engine and a compression engine. The pre-processing engine is configured to perform accelerated processing on received image data, and the compression engine is configured to compress processed image data received from the pre-processing engine. In one embodiment, the image capture accelerator further includes a demultiplexer configured to receive image data captured by an image sensor array implemented within, for example, an image sensor chip. The demultiplexer may output the received image data to an image signal processor when the image data is captured by the image sensor array in a standard capture mode, and may output the received image data to the accelerator circuitry when the image data is captured by the image sensor array in an accelerated capture mode.

Abstract translation: 图像捕获加速器执行图像数据的加速处理。 在一个实施例中，图像捕获加速器包括包括预处理引擎和压缩引擎的加速器电路。 预处理引擎被配置为对接收的图像数据执行加速处理，并且压缩引擎被配置为压缩从预处理引擎接收的经处理的图像数据。 在一个实施例中，图像捕获加速器还包括解复用器，其被配置为接收由例如图像传感器芯片内实现的图像传感器阵列捕获的图像数据。 当图像数据以标准捕捉模式被图像传感器阵列捕获时，解复用器可以将接收到的图像数据输出到图像信号处理器，并且当图像数据被图像捕获时，可以将接收到的图像数据输出到加速器电路 传感器阵列处于加速捕获模式。

公开(公告)号：US20170013209A1

公开(公告)日：2017-01-12

申请号：US15262159

申请日：2016-09-12

Applicant: GoPro, Inc.

Inventor： Timothy Macmillan ,  Scott Patrick Campbell

IPC: H04N5/341 ,  G06T3/00 ,  H04N5/225 ,  H04N5/262 ,  H04N5/232 ,  G06T3/40 ,  H04N5/247

CPC classification number: H04N5/3415 ,  G06T3/0068 ,  G06T3/0093 ,  G06T3/4038 ,  G06T5/006 ,  G06T5/50 ,  G06T7/344 ,  G06T2207/10004 ,  G06T2207/20128 ,  G06T2207/20221 ,  G06T2210/22 ,  H04N5/2252 ,  H04N5/2253 ,  H04N5/2257 ,  H04N5/2258 ,  H04N5/23216 ,  H04N5/23229 ,  H04N5/23232 ,  H04N5/23238 ,  H04N5/247 ,  H04N5/2624 ,  H04N5/2628

Abstract: Multiple cameras are arranged in an array at a pitch, roll, and yaw that allow the cameras to have adjacent fields of view such that each camera is pointed inward relative to the array. The read window of an image sensor of each camera in a multi-camera array can be adjusted to minimize the overlap between adjacent fields of view, to maximize the correlation within the overlapping portions of the fields of view, and to correct for manufacturing and assembly tolerances. Images from cameras in a multi-camera array with adjacent fields of view can be manipulated using low-power warping and cropping techniques, and can be taped together to form a final image.

Abstract translation: 多个相机以阵列，俯仰和偏转方式布置，允许相机具有相邻的视野，使得每个相机相对于阵列向内指向。 可以调整多相机阵列中每个相机的图像传感器的读取窗口，以使相邻视场之间的重叠最小化，以使视场的重叠部分之间的相关性最大化，并纠正制造和组装 公差。 可以使用低功率翘曲和裁剪技术来操纵具有相邻视场的多相机阵列中的相机的图像，并且可以将其粘贴在一起以形成最终图像。

公开(公告)号：US09485417B2

公开(公告)日：2016-11-01

申请号：US15049011

申请日：2016-02-20

Applicant: GoPro, Inc.

Inventor： Scott Patrick Campbell ,  Paul Mobbs ,  Balineedu Chowdary Adsumilli ,  Sumit Chawla

IPC: H04N5/232 ,  H04N19/102 ,  H04N19/91 ,  H04N19/63 ,  H04N19/169 ,  G06T3/40 ,  H04N5/378 ,  H04N9/04 ,  H04N5/235 ,  H04N9/73 ,  H04N19/164 ,  H04N19/172 ,  H04N5/247

CPC classification number: G06T1/20 ,  G06T3/4015 ,  H04N1/6019 ,  H04N1/6027 ,  H04N5/232 ,  H04N5/23212 ,  H04N5/23216 ,  H04N5/23222 ,  H04N5/23229 ,  H04N5/23241 ,  H04N5/23245 ,  H04N5/23254 ,  H04N5/23267 ,  H04N5/23296 ,  H04N5/2353 ,  H04N5/247 ,  H04N5/374 ,  H04N5/378 ,  H04N9/045 ,  H04N9/09 ,  H04N9/735 ,  H04N9/8042 ,  H04N19/102 ,  H04N19/12 ,  H04N19/132 ,  H04N19/156 ,  H04N19/164 ,  H04N19/172 ,  H04N19/186 ,  H04N19/1883 ,  H04N19/33 ,  H04N19/42 ,  H04N19/423 ,  H04N19/44 ,  H04N19/517 ,  H04N19/63 ,  H04N19/91

Abstract: An image capture accelerator performs accelerated processing of image data. In one embodiment, the image capture accelerator includes accelerator circuitry including a pre-processing engine and a compression engine. The pre-processing engine is configured to perform accelerated processing on received image data, and the compression engine is configured to compress processed image data received from the pre-processing engine. In one embodiment, the image capture accelerator further includes a demultiplexer configured to receive image data captured by an image sensor array implemented within, for example, an image sensor chip. The demultiplexer may output the received image data to an image signal processor when the image data is captured by the image sensor array in a standard capture mode, and may output the received image data to the accelerator circuitry when the image data is captured by the image sensor array in an accelerated capture mode.

Abstract translation: 图像捕获加速器执行图像数据的加速处理。 在一个实施例中，图像捕获加速器包括包括预处理引擎和压缩引擎的加速器电路。 预处理引擎被配置为对接收的图像数据执行加速处理，并且压缩引擎被配置为压缩从预处理引擎接收的经处理的图像数据。 在一个实施例中，图像捕获加速器还包括解复用器，其被配置为接收由例如图像传感器芯片内实现的图像传感器阵列捕获的图像数据。 当图像数据以标准捕捉模式被图像传感器阵列捕获时，解复用器可以将接收到的图像数据输出到图像信号处理器，并且当图像数据被图像捕获时，可以将接收到的图像数据输出到加速器电路 传感器阵列处于加速捕获模式。

公开(公告)号：US20160227068A1

公开(公告)日：2016-08-04

申请号：US15096479

申请日：2016-04-12

Applicant: GoPro, Inc.

Inventor： Scott Patrick Campbell ,  David A. Newman ,  Brian G. Schunck

IPC: H04N1/21 ,  H04N5/341 ,  H04N1/00 ,  H04N19/426

CPC classification number: H04N1/2137 ,  H04N1/00209 ,  H04N5/23206 ,  H04N5/335 ,  H04N5/341 ,  H04N5/374 ,  H04N9/045 ,  H04N19/0049 ,  H04N19/137 ,  H04N19/156 ,  H04N19/172 ,  H04N19/423 ,  H04N19/426 ,  H04N19/625 ,  H04N19/63 ,  H04N19/91

Abstract: An image sensor compresses image data prior to transmitting the image data to a DSP. The image sensor captures light representing an image, for instance via a camera's aperture. A focal plane array converts the captured light into pixel data. The pixel data is sorted into categories, and is compressed in parallel by a compression engine. The compressed pixel data is then sent to a DSP, which may be located off-chip. The DSP then decompresses the compressed pixel data, performs image signal processing operations on the compressed pixel data, and then compresses the processed pixel data into a digital image format. The image sensor may buffer the pixel data for one or more images to accommodate for slowdown by the compression engine. The pixel data may be sorted by row and column of a pixel array. Alternatively, the pixel data may be sorted by color from a Bayer color filter.

公开(公告)号：US20160173785A1

公开(公告)日：2016-06-16

申请号：US15049011

申请日：2016-02-20

Applicant: GoPro, Inc.

Inventor： Scott Patrick Campbell ,  Paul Mobbs ,  Balineedu Chowdary Adsumilli ,  Sumit Chawla

IPC: H04N5/232 ,  H04N19/169 ,  H04N5/247

CPC classification number: G06T1/20 ,  G06T3/4015 ,  H04N1/6019 ,  H04N1/6027 ,  H04N5/232 ,  H04N5/23212 ,  H04N5/23216 ,  H04N5/23222 ,  H04N5/23229 ,  H04N5/23241 ,  H04N5/23245 ,  H04N5/23254 ,  H04N5/23267 ,  H04N5/23296 ,  H04N5/2353 ,  H04N5/247 ,  H04N5/374 ,  H04N5/378 ,  H04N9/045 ,  H04N9/09 ,  H04N9/735 ,  H04N9/8042 ,  H04N19/102 ,  H04N19/12 ,  H04N19/132 ,  H04N19/156 ,  H04N19/164 ,  H04N19/172 ,  H04N19/186 ,  H04N19/1883 ,  H04N19/33 ,  H04N19/42 ,  H04N19/423 ,  H04N19/44 ,  H04N19/517 ,  H04N19/63 ,  H04N19/91

Abstract: An image capture accelerator performs accelerated processing of image data. In one embodiment, the image capture accelerator includes accelerator circuitry including a pre-processing engine and a compression engine. The pre-processing engine is configured to perform accelerated processing on received image data, and the compression engine is configured to compress processed image data received from the pre-processing engine. In one embodiment, the image capture accelerator further includes a demultiplexer configured to receive image data captured by an image sensor array implemented within, for example, an image sensor chip. The demultiplexer may output the received image data to an image signal processor when the image data is captured by the image sensor array in a standard capture mode, and may output the received image data to the accelerator circuitry when the image data is captured by the image sensor array in an accelerated capture mode.

Abstract translation: 图像捕获加速器执行图像数据的加速处理。 在一个实施例中，图像捕获加速器包括包括预处理引擎和压缩引擎的加速器电路。 预处理引擎被配置为对接收的图像数据执行加速处理，并且压缩引擎被配置为压缩从预处理引擎接收的经处理的图像数据。 在一个实施例中，图像捕获加速器还包括解复用器，其被配置为接收由例如图像传感器芯片内实现的图像传感器阵列捕获的图像数据。 当图像数据以标准捕捉模式被图像传感器阵列捕获时，解复用器可以将接收的图像数据输出到图像信号处理器，并且当图像数据被图像捕获时，可以将接收到的图像数据输出到加速器电路 传感器阵列处于加速捕获模式。

公开(公告)号：US09357115B2

公开(公告)日：2016-05-31

申请号：US14926310

申请日：2015-10-29

Applicant: GoPro, Inc.

Inventor： Scott Patrick Campbell ,  Michael Zaven Demerjian ,  Rudy Lucas Samuels

IPC: H04N5/225 ,  G03B17/08 ,  G03B17/56

CPC classification number: H04N5/2252 ,  G03B17/08 ,  G03B17/561 ,  H04N5/2253 ,  H04N5/2254

Abstract: A camera mounting assembly is configured to couple to a camera housing. The camera mounting assembly includes a plurality of indentations configured to allow for the passage of light through the indentations and upon the image sensor of a camera enclosed by the camera housing. The camera mounting assembly can further include recessed channels within an inner-front surface of the camera mounting assembly configured to further allow for the passage of light through the indentations, through the recessed channels, and upon the image sensor.

公开(公告)号：US09294671B2

公开(公告)日：2016-03-22

申请号：US14536315

申请日：2014-11-07

Applicant: GoPro, Inc.

Inventor： Nicholas D. Woodman ,  Sumit Chawla ,  Loic Segapelli ,  Scott Patrick Campbell

IPC: H04N5/228 ,  H04N5/232 ,  H04N21/2343 ,  H04N21/4402 ,  H04N5/262

CPC classification number: H04N5/2628 ,  G06T3/0093 ,  G06T3/20 ,  G06T3/40 ,  G06T3/4069 ,  G06T3/4084 ,  G09G5/005 ,  G09G2340/0442 ,  H04N5/23229 ,  H04N7/0122 ,  H04N21/234372 ,  H04N21/440272

Abstract: A camera system captures an image in a source aspect ratio and applies a transformation to the input image to scale and warp the image to generate an output image having a target aspect ratio different than the source aspect ratio. The output image has the same field of view as the input image, maintains image resolution, and limits distortion to levels that do not substantially affect the viewing experience. In one embodiment, the output image is non-linearly warped relative to the input image such that a distortion in the output image relative to the input image is greater in a corner region of the output image than a center region of the output image.

Abstract translation: 相机系统以源宽高比捕获图像，并且对输入图像应用变换以缩放和扭曲图像以生成具有不同于源宽高比的目标纵横比的输出图像。 输出图像与输入图像具有相同的视野，保持图像分辨率，并将失真限制到不会对观看体验产生实质影响的水平。 在一个实施例中，输出图像相对于输入图像非线性翘曲，使得输出图像中相对于输入图像的失真在输出图像的拐角区域中大于输出图像的中心区域。

公开(公告)号：US09253421B2

公开(公告)日：2016-02-02

申请号：US14174814

申请日：2014-02-06

Applicant: GoPro, Inc.

Inventor： Scott Patrick Campbell ,  David A. Newman ,  Brian G. Schunck

IPC: H04N5/228 ,  H04N5/335 ,  H04N5/341 ,  H04N19/426 ,  H04N19/423 ,  H04N5/232 ,  H04N1/21

CPC classification number: H04N1/2137 ,  H04N1/00209 ,  H04N5/23206 ,  H04N5/335 ,  H04N5/341 ,  H04N5/374 ,  H04N9/045 ,  H04N19/0049 ,  H04N19/137 ,  H04N19/156 ,  H04N19/172 ,  H04N19/423 ,  H04N19/426 ,  H04N19/625 ,  H04N19/63 ,  H04N19/91

Abstract: An image sensor compresses image data prior to transmitting the image data to a DSP. The image sensor captures light representing an image, for instance via a camera's aperture. A focal plane array converts the captured light into pixel data. The pixel data is sorted into categories, and is compressed in parallel by a compression engine. The compressed pixel data is then sent to a DSP, which may be located off-chip. The DSP then decompresses the compressed pixel data, performs image signal processing operations on the compressed pixel data, and then compresses the processed pixel data into a digital image format. The image sensor may buffer the pixel data for one or more images to accommodate for slowdown by the compression engine. The pixel data may be sorted by row and column of a pixel array. Alternatively, the pixel data may be sorted by color from a Bayer color filter.

Abstract translation: 图像传感器在将图像数据发送到DSP之前压缩图像数据。 图像传感器例如通过相机的光圈捕获表示图像的光。 焦平面阵列将捕获的光转换成像素数据。 像素数据被分类并被压缩引擎并行压缩。 压缩的像素数据然后被发送到可以位于芯片外的DSP。 然后，DSP解压缩压缩像素数据，对压缩像素数据执行图像信号处理操作，然后将经处理的像素数据压缩为数字图像格式。 图像传感器可以缓冲一个或多个图像的像素数据，以适应压缩引擎的减速。 像素数据可以按像素阵列的行和列排序。 或者，像素数据可以由拜耳滤色器的颜色分类。