公开(公告)号：US20190246126A1

公开(公告)日：2019-08-08

申请号：US16234214

申请日：2018-12-27

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Balineedu Chowdary Adsumilli ,  David Newman

IPC: H04N19/30 ,  H04N19/29 ,  H04N19/167 ,  H04N19/146 ,  H04N19/59 ,  H04N19/187

CPC classification number: H04N19/30 ,  H04N19/146 ,  H04N19/167 ,  H04N19/187 ,  H04N19/29 ,  H04N19/59

Abstract: Apparatus and methods for digital video data compression via a scalable, multi-resolution approach. In one embodiment, the video content may be encoded using a multi-resolution and/or multi-quality scalable coding approach that reduces computational and/or energy load on a client device. In one implementation, a low fidelity image is obtained based on a first full resolution image. The low fidelity image may be encoded to obtain a low fidelity bitstream. A second full resolution image may be obtained based on the low fidelity bitstream. A portion of a difference image obtained based on the second full resolution image and the first full resolution may be encoded to obtain a high fidelity bitstream. The low fidelity bitstream and the high fidelity bitstream may be provided to e.g., a receiving device.

公开(公告)号：US10313686B2

公开(公告)日：2019-06-04

申请号：US15466559

申请日：2017-03-22

Applicant: GoPro, Inc.

Inventor： Adeel Abbas

IPC: H04N19/176 ,  H04N19/597 ,  H04N19/105 ,  H04N19/147 ,  H04N19/85

Abstract: Apparatus and methods for encoding panoramic content, such as by a wide field of view and large image size. In one implementation, a panoramic image may be mapped to a cube, equirectangular or any other projection e.g., icosahedron or octahedron. Projection may be selected adaptively based on evaluation of the panoramic content. Content evaluation may include obtaining rate distortion cost metric for a given projection configuration including projection type, projection arrangement, and projection orientation. Projection configuration with the lowest cost may be selected as target projection for encoding content. As content composition changes (e.g., object motion, texture presence and/or location) projection may be adaptively selected to match changes in the content. Adaptive content selection methodology may provide for a lower encoded bitrate for a given encoded quality and/or higher quality for a given bitrate.

公开(公告)号：US10244167B2

公开(公告)日：2019-03-26

申请号：US15432700

申请日：2017-02-14

Applicant: GoPro, Inc.

Inventor： Balineedu Chowdary Adsumilli ,  Adeel Abbas ,  Sumit Chawla

IPC: G06K9/00 ,  H04N5/232 ,  H04N19/597 ,  H04N19/122 ,  H04N19/115 ,  H04N19/117 ,  H04N19/126 ,  H04N19/167 ,  H04N19/57 ,  H04N13/243 ,  H04N13/344 ,  H04N13/296 ,  H04N13/178

Abstract: Methods and apparatus for encoding and decoding image data based on one or more parameters. In one embodiment, various spatial portions or regions of image data (e.g., a still or moving image) are weighted according to the perceived or measured quality. Processing for these weighted regions can be selectively altered or adjusted so as to optimize one or more operational parameters including for example processing and/or memory requirements, or speed.

公开(公告)号：US10198862B2

公开(公告)日：2019-02-05

申请号：US15611465

申请日：2017-06-01

Applicant: GOPRO, INC.

Inventor： Adeel Abbas

IPC: H04N7/00 ,  G06T19/00 ,  G06T1/00

Abstract: Apparatus and methods for providing a rotated spherical viewpoint (RSV). In one or more embodiments, the RSV is implemented using equirectangular projections (ERPs). The RSV methodologies described herein are particularly suitable for panning within virtual reality (VR) or 360° panoramic content as there is minimal, if any, geometric distortions at the edge of a given viewport. Moreover, the RSV methodologies described herein may reduce the bandwidth requirements of, for example, devices operating in a client-server architecture. Additionally, the computation requirements for providing RSV are minimal and can be provided using relatively simple rotation transforms.

公开(公告)号：US10194097B2

公开(公告)日：2019-01-29

申请号：US15406175

申请日：2017-01-13

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Cesar Douady-Pleven ,  Timothy Macmillan

IPC: H04N5/265 ,  H04N7/18 ,  H04N5/232 ,  H04N5/247

Abstract: Apparatus and methods for stitching images, or re-stitching previously stitched images. Specifically, the disclosed systems in one implementation save stitching information and/or original overlap source data during an original stitching process. During subsequent retrieval, rendering, and/or display of the stitched images, the originally stitched image can be flexibly augmented, and/or re-stitched to improve the original stitch quality. Practical applications of the disclosed solutions enable, among other things, a user to create and stitch a wide field of view (FOV) panorama from multiple source images on a device with limited processing capability (such as a mobile phone or other capture device). Moreover, post-processing stitching allows for the user to convert from one image projection to another without fidelity loss (or with an acceptable level of loss).

公开(公告)号：US20180276800A1

公开(公告)日：2018-09-27

申请号：US15467730

申请日：2017-03-23

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  David Newman

IPC: G06T5/00 ,  H04N5/232 ,  G09G5/00

CPC classification number: G06T5/009 ,  G06F3/147 ,  G06T9/001 ,  G06T2200/32 ,  G06T2207/10024 ,  G06T2207/20208 ,  G06T2207/20221 ,  G09G5/005 ,  G09G5/14 ,  G09G2320/0261 ,  G09G2320/066 ,  G09G2340/0428 ,  G09G2340/06 ,  G09G2340/12 ,  H04N5/2251 ,  H04N5/23238 ,  H04N7/18 ,  H04N13/243 ,  H04N19/597

Abstract: Apparatus and methods for source dynamic range processing of panoramic and/or spherical imaging content. In one exemplary embodiment, apparatus and methods are disclosed in which capturing the aforementioned panoramic and/or spherical imaging content in a source dynamic range, receiving a viewport position for the panoramic and/or spherical imaging content, stitching (if necessary) the panoramic and/or spherical imaging content in the source dynamic range, and rendering the viewport in the source dynamic range. In a variant, the viewport in the source dynamic range is developed into a display dynamic range, encoded in the display dynamic range and shared with a viewer of the viewport. In another variant, the rendered viewport in the source dynamic range is encoded in the source dynamic range, transmitted and decoded in the source dynamic range and rendered in the display dynamic range.

公开(公告)号：US20180176541A1

公开(公告)日：2018-06-21

申请号：US15385759

申请日：2016-12-20

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  David A. Newman ,  Timothy Macmillan

IPC: H04N13/02 ,  G06K9/46 ,  G06T7/33 ,  G06T17/00 ,  G06T7/292 ,  H04N5/232

CPC classification number: H04N13/243 ,  G01S3/00 ,  G06K9/209 ,  G06K2009/363 ,  G06T3/4038 ,  G06T3/4053 ,  G06T7/33 ,  G06T2207/10028 ,  H04N5/2258 ,  H04N5/232 ,  H04N5/247 ,  H04N5/2624 ,  H04N13/296

Abstract: A method and system are described. The method includes capturing a set of images from a 2×2 array of cameras, each camera of the array of cameras having an overlapping field of view (FOV) with an adjacent camera of the array of cameras. The method further includes synchronously capturing a supplemental image from a fifth camera, the fifth camera having an at least partially overlapping FOV with every camera of the array of cameras. Supplemental information is extracted by comparing the supplemental image with the set of four images. Portions of the set of images are stitched based in part on the supplemental information to produce a combined stitched image, the combined stitched image having a higher resolution than each image of the set of images

公开(公告)号：US09940697B2

公开(公告)日：2018-04-10

申请号：US15347610

申请日：2016-11-09

Applicant: GoPro, Inc.

Inventor： Balineedu Chowdary Adsumilli ,  Adeel Abbas ,  David Newman

IPC: G06T5/00 ,  G06T3/00 ,  G06T5/20 ,  G06T3/40

CPC classification number: G06T5/001 ,  G06T3/0087 ,  G06T3/0093 ,  G06T3/4038 ,  G06T5/006 ,  G06T5/20 ,  G06T5/50 ,  G06T2207/10012

Abstract: Systems and methods for capturing and/or processing of panoramic imaging content using spatial redundancy-based mapping. Panoramic imaging content may be processed using a processing pipeline that may operate on a portion of the image. Images may be transformed prior to processing. Image transformation may introduce distortion and/or data redundancy. Image partitioning for the pipeline processing may be configured based on spatial redundancy associated with the transformation. Windowing operation may include partitioning an image using non-rectangular and/or non-equal windows.

公开(公告)号：US20170366814A1

公开(公告)日：2017-12-21

申请号：US15432700

申请日：2017-02-14

Applicant: GoPro, Inc.

Inventor： Balineedu Chowdary Adsumilli ,  Adeel Abbas ,  Sumit Chawla

IPC: H04N19/154 ,  H04N19/86 ,  H04N19/172 ,  H04N5/232 ,  H04N19/147

CPC classification number: H04N5/23238 ,  H04N13/178 ,  H04N13/243 ,  H04N13/296 ,  H04N19/115 ,  H04N19/117 ,  H04N19/122 ,  H04N19/126 ,  H04N19/167 ,  H04N19/57 ,  H04N19/597

Abstract: Methods and apparatus for encoding and decoding image data based on one or more parameters. In one embodiment, various spatial portions or regions of image data (e.g., a still or moving image) are weighted according to the perceived or measured quality. Processing for these weighted regions can be selectively altered or adjusted so as to optimize one or more operational parameters including for example processing and/or memory requirements, or speed.

公开(公告)号：US20170345129A1

公开(公告)日：2017-11-30

申请号：US15607152

申请日：2017-05-26

Applicant: GoPro, Inc.

Inventor： Sandeep Doshi ,  Adeel Abbas

IPC: G06T3/40 ,  H04N7/18 ,  H04N5/232 ,  H04N13/02 ,  H04N19/85

CPC classification number: G06T3/4038 ,  H04N5/23238 ,  H04N5/247 ,  H04N7/181 ,  H04N9/045

Abstract: Methods and apparatus for the stitching of images from a multi-camera array. In one embodiment, stitching is performed for a first image and a second image with an overlapping field of view by: encoding the first image to produce a first encoded image; encoding the second image to produce a second uncompressed encoded image; stitching the first image with the second image by: decoding the first encoded image to produce a decoded first image; storing the decoded first image in memory; accessing, by a stitching engine, the decoded first image from memory; accessing, by the stitching engine, the second uncompressed encoded image; stitching, by the stitching engine, the decoded first image with the accessed second uncompressed encoded image to produce a stitched image; and outputting, by the stitching engine, the stitched image.