公开(公告)号：US10560682B2

公开(公告)日：2020-02-11

申请号：US15665202

申请日：2017-07-31

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  David Newman

IPC: H04N13/00 ,  H04N13/161 ,  H04N5/232 ,  G06T3/40 ,  H04N19/597 ,  H04N19/124 ,  H04N19/40 ,  H04N19/70 ,  H04N13/156 ,  H04N13/178 ,  H04N7/015 ,  H04N19/59

Abstract: Apparatus and methods for providing a frame packing arrangement for the encoding/decoding of, for example, panoramic content. In one embodiment, an encoder apparatus is disclosed. In a variant, the encoder apparatus is configured to encode Segmented Sphere Projections (SSP) imaging data and/or Rotated Sphere Projections (RSP) imaging data into an extant imaging format. In another variant, a decoder apparatus is disclosed. In one embodiment, the decoder apparatus is configured to decode SSP imaging data and/or RSP imaging data from an extant imaging format. Computing devices, computer-readable storage apparatus, integrated circuits and methods for using the aforementioned encoder and decoder are also disclosed.

公开(公告)号：US20190385273A1

公开(公告)日：2019-12-19

申请号：US16459482

申请日：2019-07-01

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Timothy Macmillan ,  Cesar Douady-Pleven

IPC: G06T3/00 ,  H04N5/232 ,  H04N5/225 ,  G06T3/40

Abstract: Apparatus and methods for the stitch zone calculation of a generated projection of a spherical image. In one embodiment, a computing device is disclosed which includes logic configured to: obtain a plurality of images; map the plurality of images onto a spherical image; re-orient the spherical image in accordance with a desired stitch line and a desired projection for the desired stitch line; and map the spherical image to the desired projection having the desired stitch line. In a variant, the desired stitch line is mapped onto an optimal stitch zone, the optimal stitch zone characterized as a set of points that defines a single line on the desired projection in which the set of points along the desired projection lie closest to the spherical image in a mean square sense.

公开(公告)号：US10404901B2

公开(公告)日：2019-09-03

申请号：US15996016

申请日：2018-06-01

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Joshua P. Davies ,  William H. Tolbert

IPC: G02B7/02 ,  G02B13/06 ,  G03B17/12 ,  G03B37/04 ,  H04N5/225 ,  H04N5/232

Abstract: Dual-lens assemblies and cameras including dual lens-assemblies that include a first lens barrel securing a first lens having a first optical axis and a second lens barrel securing a second lens having a second optical axis are disclosed. In one dual-lens assembly, the first optical axis is approximately parallel to and spaced from the second optical axis by a lateral offset, axial lengths of the first lens barrel and the second lens barrel are approximately equal, and the first lens and the second lens are oriented in opposite directions at opposing ends of the first lens barrel and the second lens barrel.

公开(公告)号：US10397549B2

公开(公告)日：2019-08-27

申请号：US15385759

申请日：2016-12-20

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  David A. Newman ,  Timothy Macmillan

IPC: G06K9/46 ,  H04N5/232 ,  H04N13/243 ,  G06T7/33 ,  G06T17/00 ,  H04N13/296 ,  G06T3/40 ,  G01S3/00 ,  H04N5/225 ,  H04N5/247 ,  H04N5/262 ,  G06K9/20 ,  G06K9/36

Abstract: A method and system are described. The method includes capturing a set of images from a 2×2 array of cameras, each camera of the array of cameras having an overlapping field of view (FOV) with an adjacent camera of the array of cameras. The method further includes synchronously capturing a supplemental image from a fifth camera, the fifth camera having an at least partially overlapping FOV with every camera of the array of cameras. Supplemental information is extracted by comparing the supplemental image with the set of four images. Portions of the set of images are stitched based in part on the supplemental information to produce a combined stitched image, the combined stitched image having a higher resolution than each image of the set of images.

公开(公告)号：US10212438B2

公开(公告)日：2019-02-19

申请号：US15799837

申请日：2017-10-31

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Balineedu Chowdary Adsumilli ,  David Newman

IPC: H04N19/30 ,  H04N19/146 ,  H04N19/59 ,  H04N19/187 ,  H04N19/167 ,  H04N19/29

Abstract: Apparatus and methods for digital video data compression via a scalable, multi-resolution approach. In one embodiment, the video content may be encoded using a multi-resolution and/or multi-quality scalable coding approach that reduces computational and/or energy load on a client device. In one implementation, a low fidelity image is obtained based on a first full resolution image. The low fidelity image may be encoded to obtain a low fidelity bitstream. A second full resolution image may be obtained based on the low fidelity bitstream. A portion of a difference image obtained based on the second full resolution image and the first full resolution may be encoded to obtain a high fidelity bitstream. The low fidelity bitstream and the high fidelity bitstream may be provided to e.g., a receiving device.

公开(公告)号：US20180288436A1

公开(公告)日：2018-10-04

申请号：US15719291

申请日：2017-09-28

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  David Newman

IPC: H04N19/597 ,  H04N19/33 ,  H04N19/124

Abstract: Apparatus and methods for providing in-loop padding techniques for projection formats, such as, Rotated Sphere Projections (RSP). In one embodiment, methods and apparatus for the encoding of video data is disclosed, the video data includes a projection format that has redundant data, the apparatus and methods include obtaining a frame of video data, the frame of video data including reduced quality areas within the frame of video data; transmitting the obtained frame of the video data to a reconstruction engine; reconstructing the reduced quality areas to nearly original quality within the frame by using other portions of the frame of video data in order to construct a high fidelity frame of video data; storing the high fidelity frame of video data within a reference picture list; and using the high fidelity frame of video data stored within the reference picture list for encoding of subsequent frames of the video data. Methods and apparatus for the decoding of encoded video data are also disclosed.

公开(公告)号：US20180278818A1

公开(公告)日：2018-09-27

申请号：US15996016

申请日：2018-06-01

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Joshua P. Davies ,  William H. Tolbert

IPC: H04N5/225 ,  G03B17/12 ,  G02B7/02 ,  G03B37/04 ,  G02B13/06 ,  H04N5/232

CPC classification number: H04N5/2254 ,  G02B7/02 ,  G02B7/021 ,  G02B13/06 ,  G03B17/12 ,  G03B37/04 ,  H04N5/2252 ,  H04N5/2258 ,  H04N5/23238

Abstract: Dual-lens assemblies and cameras including dual lens-assemblies that include a first lens barrel securing a first lens having a first optical axis and a second lens barrel securing a second lens having a second optical axis are disclosed. In one dual-lens assembly, the first optical axis is approximately parallel to and spaced from the second optical axis by a lateral offset, axial lengths of the first lens barrel and the second lens barrel are approximately equal, and the first lens and the second lens are oriented in opposite directions at opposing ends of the first lens barrel and the second lens barrel.

公开(公告)号：US20180176573A1

公开(公告)日：2018-06-21

申请号：US15385383

申请日：2016-12-20

Applicant: GoPro, Inc.

Inventor： Sumit Chawla ,  Adeel Abbas ,  Sandeep Doshi

IPC: H04N19/137 ,  G06K9/62 ,  G06K9/52

CPC classification number: H04N19/137 ,  G06K9/00744 ,  G06K9/4642 ,  G06K9/4652 ,  G06K9/52 ,  G06K9/6201 ,  H04N19/105 ,  H04N19/107 ,  H04N19/124 ,  H04N19/136 ,  H04N19/142 ,  H04N19/154 ,  H04N19/436 ,  H04N19/57

Abstract: Methods and apparatus for the encoding of imaging data using pre-stored imaging statistics. Many extant image capture devices, including without limitation, smartphones, handheld video cameras, and other types of image capture devices, typically include, for example, auto-exposure (AE), auto-white balance (AWB) and auto-focus (AF) modules in an image signal processing (ISP) pipeline. These modules within the ISP pipeline generate various imaging statistics which can be repurposed for the encoding process of video data. These imaging statistics can be utilized for a number of encoding processes including, without limitation, adjusting an encoder parameter value for the encoding process, adjustment of the motion estimation search range, insertion of intra-frames within the video data and the determination of whether to use explicit or implicit weighting prediction.

公开(公告)号：US09992394B2

公开(公告)日：2018-06-05

申请号：US15395500

申请日：2016-12-30

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Joshua P. Davies ,  William H. Tolbert

IPC: H04N5/225 ,  H04N5/232 ,  G02B13/06 ,  G02B7/02

CPC classification number: H04N5/2254 ,  G02B7/02 ,  G02B7/021 ,  G02B13/06 ,  G03B17/12 ,  G03B37/04 ,  H04N5/2252 ,  H04N5/2258 ,  H04N5/23238

Abstract: Dual-lens assemblies and cameras including dual lens-assemblies that include a first lens barrel securing a first lens having a first optical axis and a second lens barrel securing a second lens having a second optical axis are disclosed. In one dual-lens assembly, the first optical axis is approximately parallel to and spaced from the second optical axis by a lateral offset, axial lengths of the first lens barrel and the second lens barrel are approximately equal, and the first lens and the second lens are oriented in opposite directions at opposing ends of the first lens barrel and the second lens barrel.

公开(公告)号：US20180054624A1

公开(公告)日：2018-02-22

申请号：US15799837

申请日：2017-10-31

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Balineedu Chowdary Adsumilli ,  David Newman

IPC: H04N19/30 ,  H04N19/29 ,  H04N19/167 ,  H04N19/146 ,  H04N19/59 ,  H04N19/187

CPC classification number: H04N19/30 ,  H04N19/146 ,  H04N19/167 ,  H04N19/187 ,  H04N19/29 ,  H04N19/59

Abstract: Apparatus and methods for digital video data compression via a scalable, multi-resolution approach. In one embodiment, the video content may be encoded using a multi-resolution and/or multi-quality scalable coding approach that reduces computational and/or energy load on a client device. In one implementation, a low fidelity image is obtained based on a first full resolution image. The low fidelity image may be encoded to obtain a low fidelity bitstream. A second full resolution image may be obtained based on the low fidelity bitstream. A portion of a difference image obtained based on the second full resolution image and the first full resolution may be encoded to obtain a high fidelity bitstream. The low fidelity bitstream and the high fidelity bitstream may be provided to e.g., a receiving device.