公开(公告)号：US20160173777A1

公开(公告)日：2016-06-16

申请号：US15049014

申请日：2016-02-20

Applicant: GoPro, Inc.

Inventor： Scott Patrick Campbell ,  Paul Mobbs ,  Balineedu Chowdary Adsumilli ,  Sumit Chawla

IPC: H04N5/232 ,  H04N19/172 ,  H04N19/63

CPC classification number: G06T1/20 ,  G06T3/4015 ,  H04N1/6019 ,  H04N1/6027 ,  H04N5/232 ,  H04N5/23212 ,  H04N5/23216 ,  H04N5/23222 ,  H04N5/23229 ,  H04N5/23241 ,  H04N5/23245 ,  H04N5/23254 ,  H04N5/23267 ,  H04N5/23296 ,  H04N5/2353 ,  H04N5/247 ,  H04N5/374 ,  H04N5/378 ,  H04N9/045 ,  H04N9/09 ,  H04N9/735 ,  H04N9/8042 ,  H04N19/102 ,  H04N19/12 ,  H04N19/132 ,  H04N19/156 ,  H04N19/164 ,  H04N19/172 ,  H04N19/186 ,  H04N19/1883 ,  H04N19/33 ,  H04N19/42 ,  H04N19/423 ,  H04N19/44 ,  H04N19/517 ,  H04N19/63 ,  H04N19/91

Abstract: An image capture accelerator performs accelerated processing of image data. In one embodiment, the image capture accelerator includes accelerator circuitry including a pre-processing engine and a compression engine. The pre-processing engine is configured to perform accelerated processing on received image data, and the compression engine is configured to compress processed image data received from the pre-processing engine. In one embodiment, the image capture accelerator further includes a demultiplexer configured to receive image data captured by an image sensor array implemented within, for example, an image sensor chip. The demultiplexer may output the received image data to an image signal processor when the image data is captured by the image sensor array in a standard capture mode, and may output the received image data to the accelerator circuitry when the image data is captured by the image sensor array in an accelerated capture mode.

公开(公告)号：US20160173776A1

公开(公告)日：2016-06-16

申请号：US15049013

申请日：2016-02-20

Applicant: GoPro, Inc.

Inventor： Scott Patrick Campbell ,  Paul Mobbs ,  Balineedu Chowdary Adsumilli ,  Sumit Chawla

IPC: H04N5/232 ,  H04N19/169 ,  H04N19/63

CPC classification number: G06T1/20 ,  G06T3/4015 ,  H04N1/6019 ,  H04N1/6027 ,  H04N5/232 ,  H04N5/23212 ,  H04N5/23216 ,  H04N5/23222 ,  H04N5/23229 ,  H04N5/23241 ,  H04N5/23245 ,  H04N5/23254 ,  H04N5/23267 ,  H04N5/23296 ,  H04N5/2353 ,  H04N5/247 ,  H04N5/374 ,  H04N5/378 ,  H04N9/045 ,  H04N9/09 ,  H04N9/735 ,  H04N9/8042 ,  H04N19/102 ,  H04N19/12 ,  H04N19/132 ,  H04N19/156 ,  H04N19/164 ,  H04N19/172 ,  H04N19/186 ,  H04N19/1883 ,  H04N19/33 ,  H04N19/42 ,  H04N19/423 ,  H04N19/44 ,  H04N19/517 ,  H04N19/63 ,  H04N19/91

Abstract: An image capture accelerator performs accelerated processing of image data. In one embodiment, the image capture accelerator includes accelerator circuitry including a pre-processing engine and a compression engine. The pre-processing engine is configured to perform accelerated processing on received image data, and the compression engine is configured to compress processed image data received from the pre-processing engine. In one embodiment, the image capture accelerator further includes a demultiplexer configured to receive image data captured by an image sensor array implemented within, for example, an image sensor chip. The demultiplexer may output the received image data to an image signal processor when the image data is captured by the image sensor array in a standard capture mode, and may output the received image data to the accelerator circuitry when the image data is captured by the image sensor array in an accelerated capture mode.

公开(公告)号：US20160173764A1

公开(公告)日：2016-06-16

申请号：US15049010

申请日：2016-02-20

Applicant: GoPro, Inc.

Inventor： Scott Patrick Campbell ,  Paul Mobbs ,  Balineedu Chowdary Adsumilli ,  Sumit Chawla

IPC: H04N5/232 ,  H04N9/73 ,  H04N19/169 ,  H04N5/235

CPC classification number: G06T1/20 ,  G06T3/4015 ,  H04N1/6019 ,  H04N1/6027 ,  H04N5/232 ,  H04N5/23212 ,  H04N5/23216 ,  H04N5/23222 ,  H04N5/23229 ,  H04N5/23241 ,  H04N5/23245 ,  H04N5/23254 ,  H04N5/23267 ,  H04N5/23296 ,  H04N5/2353 ,  H04N5/247 ,  H04N5/374 ,  H04N5/378 ,  H04N9/045 ,  H04N9/09 ,  H04N9/735 ,  H04N9/8042 ,  H04N19/102 ,  H04N19/12 ,  H04N19/132 ,  H04N19/156 ,  H04N19/164 ,  H04N19/172 ,  H04N19/186 ,  H04N19/1883 ,  H04N19/33 ,  H04N19/42 ,  H04N19/423 ,  H04N19/44 ,  H04N19/517 ,  H04N19/63 ,  H04N19/91

Abstract: An image capture accelerator performs accelerated processing of image data. In one embodiment, the image capture accelerator includes accelerator circuitry including a pre-processing engine and a compression engine. The pre-processing engine is configured to perform accelerated processing on received image data, and the compression engine is configured to compress processed image data received from the pre-processing engine. In one embodiment, the image capture accelerator further includes a demultiplexer configured to receive image data captured by an image sensor array implemented within, for example, an image sensor chip. The demultiplexer may output the received image data to an image signal processor when the image data is captured by the image sensor array in a standard capture mode, and may output the received image data to the accelerator circuitry when the image data is captured by the image sensor array in an accelerated capture mode.

Abstract translation: 图像捕获加速器执行图像数据的加速处理。 在一个实施例中，图像捕获加速器包括包括预处理引擎和压缩引擎的加速器电路。 预处理引擎被配置为对接收的图像数据执行加速处理，并且压缩引擎被配置为压缩从预处理引擎接收的经处理的图像数据。 在一个实施例中，图像捕获加速器还包括解复用器，其被配置为接收由例如图像传感器芯片内实现的图像传感器阵列捕获的图像数据。 当图像数据以标准捕捉模式被图像传感器阵列捕获时，解复用器可以将接收到的图像数据输出到图像信号处理器，并且当图像数据被图像捕获时，可以将接收到的图像数据输出到加速器电路 传感器阵列处于加速捕获模式。

公开(公告)号：US12126809B2

公开(公告)日：2024-10-22

申请号：US18144574

申请日：2023-05-08

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Balineedu Chowdary Adsumilli ,  Vadim Polonichko

IPC: H04N19/597 ,  H04N13/00 ,  H04N19/107 ,  H04N19/137 ,  H04N19/167 ,  H04N23/45 ,  H04N23/698

CPC classification number: H04N19/137 ,  H04N13/00 ,  H04N19/107 ,  H04N19/167 ,  H04N19/597 ,  H04N23/45 ,  H04N23/698

Abstract: Encoded content is accessed. The encoded content includes an encoded first centrally located tile corresponding to a first centrally located tile of a first image, an encoded first peripherally located tile of the first image, and an encoded second peripherally located tile of a second image. The encoded first peripherally located tile is decoded to obtain a decoded first peripherally located tile. The encoded second peripherally located tile is decoded to obtain a decoded second peripherally located tile. The decoded first peripherally located tile and the decoded second peripherally located tile are stitched to obtain a stitched image portion. The stitched image portion is encoded to obtain an encoded stitched image portion. An encoded stitched image of the first image and the second image is obtained by combining the encoded first centrally located tile, and the encoded stitched image portion.

公开(公告)号：US20230276054A1

公开(公告)日：2023-08-31

申请号：US18144574

申请日：2023-05-08

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Balineedu Chowdary Adsumilli ,  Vadim Polonichko

IPC: H04N19/137 ,  H04N19/167 ,  H04N13/00 ,  H04N19/107 ,  H04N19/597 ,  H04N23/45 ,  H04N23/698

CPC classification number: H04N19/137 ,  H04N19/167 ,  H04N13/00 ,  H04N19/107 ,  H04N19/597 ,  H04N23/45 ,  H04N23/698

Abstract: Encoded content is accessed. The encoded content includes an encoded first centrally located tile corresponding to a first centrally located tile of a first image, an encoded first peripherally located tile of the first image, and an encoded second peripherally located tile of a second image. The encoded first peripherally located tile is decoded to obtain a decoded first peripherally located tile. The encoded second peripherally located tile is decoded to obtain a decoded second peripherally located tile. The decoded first peripherally located tile and the decoded second peripherally located tile are stitched to obtain a stitched image portion. The stitched image portion is encoded to obtain an encoded stitched image portion. An encoded stitched image of the first image and the second image is obtained by combining the encoded first centrally located tile, and the encoded stitched image portion.

公开(公告)号：US11637971B2

公开(公告)日：2023-04-25

申请号：US17401895

申请日：2021-08-13

Applicant: GoPro, Inc.

Inventor： Balineedu Chowdary Adsumilli ,  Ryan Lustig

IPC: H04N5/272 ,  G06T15/50 ,  H04N13/128 ,  G06T11/60 ,  G06T7/11 ,  G06T7/143 ,  G06T7/194 ,  G06T7/174 ,  G06T7/254 ,  G06T5/00 ,  G06T7/20 ,  H04N5/235 ,  H04N13/00

Abstract: A processing device generates composite images from a sequence of images. The composite images may be used as frames of video. A foreground/background segmentation is performed at selected frames to extract a plurality of foreground object images depicting a foreground object at different locations as it moves across a scene. The foreground object images are stored to a foreground object list. The foreground object images in the foreground object list are overlaid onto subsequent video frames that follow the respective frames from which they were extracted, thereby generating a composite video.

公开(公告)号：US20210377460A1

公开(公告)日：2021-12-02

申请号：US17401895

申请日：2021-08-13

Applicant: GoPro, Inc.

Inventor： Balineedu Chowdary Adsumilli ,  Ryan Lustig

IPC: H04N5/272 ,  G06T15/50 ,  H04N13/128 ,  G06T11/60 ,  G06T7/11 ,  G06T7/143 ,  G06T7/194 ,  G06T7/174 ,  G06T7/254 ,  G06T5/00 ,  G06T7/20 ,  H04N5/235

Abstract: A processing device generates composite images from a sequence of images. The composite images may be used as frames of video. A foreground/background segmentation is performed at selected frames to extract a plurality of foreground object images depicting a foreground object at different locations as it moves across a scene. The foreground object images are stored to a foreground object list. The foreground object images in the foreground object list are overlaid onto subsequent video frames that follow the respective frames from which they were extracted, thereby generating a composite video.

公开(公告)号：US20210264565A1

公开(公告)日：2021-08-26

申请号：US17314217

申请日：2021-05-07

Applicant: GoPro, Inc.

Inventor： Balineedu Chowdary Adsumilli ,  Adeel Abbas

IPC: G06T3/40 ,  H04N5/232

Abstract: Systems and methods for providing panoramic image and/or video content using multi-resolution stitching. Panoramic content may include stitched spherical (360-degree) images and/or VR video. In some implementations, multi-resolution stitching functionality may be embodied in a spherical image capture device that may include two lenses configured to capture pairs of hemispherical images. The capture device may obtain images (e.g., representing left and right hemispheres) that may be characterized by 180-degree (or greater) field of view. Source images may be combined using multi-resolution stitching methodology. Source images may be transformed to obtain multiple image components characterized by two or more image resolutions. The stitched image may be encoded using selective encoding methodology including: partitioning source images into a low resolution/frequency and a high resolution/frequency components; stitching low resolution/frequency components using coarse stitching operation, stitching high resolution/high frequency components using a refined stitch operation; combining stitched LF components and stitched HF components.

公开(公告)号：US10462466B2

公开(公告)日：2019-10-29

申请号：US15414426

申请日：2017-01-24

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Balineedu Chowdary Adsumilli ,  Vadim Polonichko

IPC: H04N19/597 ,  H04N19/137 ,  H04N19/167 ,  H04N5/232 ,  H04N5/225 ,  H04N13/00 ,  H04N19/107

Abstract: Systems and methods for providing panoramic image and/or video content using spatially selective encoding and/or decoding. Panoramic content may include stitched spherical (360-degree) images and/or VR video. In some implementations, selective encoding functionality may be embodied in a spherical image capture device that may include two lenses configured to capture pairs of hemispherical images. Encoded source images may be decoded and stitched in order to obtain a combined image characterized by a greater field of view as compared to source images. The stitched image may be encoded using a selective encoding methodology including: partitioning a stitched image into multiple portions, determining if a portion is to be re-encoded. If the image portion is to be re-encoded, re-encoding the image portion. If an image portion is not to be re-encoded, copying previously encoded image portion in lieu of encoding.

公开(公告)号：US20190325915A1

公开(公告)日：2019-10-24

申请号：US16456673

申请日：2019-06-28

Applicant: GoPro, Inc.

Inventor： Scott Patrick Campbell ,  Zhinian Jing ,  Timothy Macmillan ,  David A. Newman ,  Balineedu Chowdary Adsumilli

IPC: G11B27/30 ,  H04N9/82 ,  H04N9/806 ,  H04N5/232 ,  H04N5/77

Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.