公开(公告)号：US20180027226A1

公开(公告)日：2018-01-25

申请号：US15654617

申请日：2017-07-19

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Timothy Macmillan

IPC: H04N13/02 ,  H04N13/00 ,  H04N13/04

Abstract: Apparatus and methods for providing a frame packing arrangement for the encoding/decoding of, for example, panoramic content. In one embodiment, the frame packing arrangement utilizes overlapping imaging data so as to enable, for example, a post-decode stitching operation to be performed. The frame packing arrangement may utilize a number of projection formats, such as a cubemap projection, and may utilize any number of differing aspect ratios such as, without limitation, 4×3, 3×2, 4×2, 2×4 aspect ratios. Additionally, the overlapping imaging data may be positioned within the frame packing arrangement chosen so as to improve upon coding efficiency. For example, the overlapping imaging data may be positioned within the frame packing arrangement so as to emphasize image continuity. An encoder apparatus and decoder apparatus for use with the aforementioned frame packing arrangements are also disclosed.

公开(公告)号：US20170366812A1

公开(公告)日：2017-12-21

申请号：US15414426

申请日：2017-01-24

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Balineedu Chowdary Adsumilli ,  Vadim Polonichko

IPC: H04N19/137 ,  G06T19/00 ,  H04N19/176 ,  H04N19/167 ,  H04N19/154 ,  H04N19/146 ,  H04N19/14 ,  H04N5/232 ,  H04N19/11

CPC classification number: H04N19/137 ,  H04N5/2258 ,  H04N5/23238 ,  H04N13/00 ,  H04N13/111 ,  H04N13/161 ,  H04N13/20 ,  H04N13/239 ,  H04N13/243 ,  H04N19/107 ,  H04N19/167 ,  H04N19/597

Abstract: Systems and methods for providing panoramic image and/or video content using spatially selective encoding and/or decoding. Panoramic content may include stitched spherical (360-degree) images and/or VR video. In some implementations, selective encoding functionality may be embodied in a spherical image capture device that may include two lenses configured to capture pairs of hemispherical images. Encoded source images may be decoded and stitched in order to obtain a combined image characterized by a greater field of view as compared to source images. The stitched image may be encoded using a selective encoding methodology including: partitioning a stitched image into multiple portions, determining if a portion is to be re-encoded. If the image portion is to be re-encoded, re-encoding the image portion. If an image portion is not to be re-encoded, copying previously encoded image portion in lieu of encoding.

公开(公告)号：US20170111559A1

公开(公告)日：2017-04-20

申请号：US15395500

申请日：2016-12-30

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Joshua P. Davies ,  William H. Tolbert

IPC: H04N5/225 ,  G02B13/06 ,  G02B7/02 ,  H04N5/232

CPC classification number: H04N5/2254 ,  G02B7/02 ,  G02B7/021 ,  G02B13/06 ,  G03B17/12 ,  G03B37/04 ,  H04N5/2252 ,  H04N5/2258 ,  H04N5/23238

Abstract: Dual-lens assemblies and cameras including dual lens-assemblies that include a first lens barrel securing a first lens having a first optical axis and a second lens barrel securing a second lens having a second optical axis are disclosed. In one dual-lens assembly, the first optical axis is approximately parallel to and spaced from the second optical axis by a lateral offset, axial lengths of the first lens barrel and the second lens barrel are approximately equal, and the first lens and the second lens are oriented in opposite directions at opposing ends of the first lens barrel and the second lens barrel.

公开(公告)号：US20240129636A1

公开(公告)日：2024-04-18

申请号：US18137021

申请日：2023-04-20

Applicant: GoPro, Inc.

Inventor： Balineedu Chowdary Adsumilli ,  Adeel Abbas ,  Sumit Chawla

IPC: H04N23/698 ,  H04N13/178 ,  H04N13/243 ,  H04N13/296 ,  H04N13/344 ,  H04N19/115 ,  H04N19/117 ,  H04N19/122 ,  H04N19/126 ,  H04N19/167 ,  H04N19/57 ,  H04N19/597

CPC classification number: H04N23/698 ,  H04N13/178 ,  H04N13/243 ,  H04N13/296 ,  H04N13/344 ,  H04N19/115 ,  H04N19/117 ,  H04N19/122 ,  H04N19/126 ,  H04N19/167 ,  H04N19/57 ,  H04N19/597

Abstract: Visual content that includes spatial portions is obtained. A determination is made that one of the spatial portions includes a face. Based on the determination, encoding quality parameters for the one of the spatial portions is identified. The encoding quality parameters are obtained by combining a first distortion model related to the obtaining the visual content with a second model that emphasizes the one of the spatial portions The visual content is encoded. The encoding quality parameters are stored, in association with but separate from, the one of the spatial portions. After decoding, the one of the spatial portions are rendered based on the encoding quality parameters. The encoding quality parameters are obtained by combining a first distortion model related to the obtaining the visual content with a second model that emphasizes the one of the spatial portions.

公开(公告)号：US11671712B2

公开(公告)日：2023-06-06

申请号：US17215362

申请日：2021-03-29

Applicant: GoPro, Inc.

Inventor： Balineedu Chowdary Adsumilli ,  Adeel Abbas ,  Sumit Chawla

IPC: G06K9/00 ,  H04N23/698 ,  H04N19/597 ,  H04N19/122 ,  H04N19/115 ,  H04N19/117 ,  H04N19/126 ,  H04N19/167 ,  H04N19/57 ,  H04N13/243 ,  H04N13/296 ,  H04N13/178 ,  H04N13/344

CPC classification number: H04N23/698 ,  H04N13/178 ,  H04N13/243 ,  H04N13/296 ,  H04N13/344 ,  H04N19/115 ,  H04N19/117 ,  H04N19/122 ,  H04N19/126 ,  H04N19/167 ,  H04N19/57 ,  H04N19/597

Abstract: A method includes obtaining visual content comprising spatial portions; determining respective spatial qualities of the spatial portions, wherein the respective spatial qualities are based on locations of the spatial portions within the visual content; and encoding the spatial portions of the visual content based on the respective spatial qualities. An apparatus includes a camera, a display, and a processor. The processor is configured to identify, using facial recognition, a face of a user of the apparatus; identify a distance of the face of the user to the display; and render visual content on the display using a quality that is based on the distance.

公开(公告)号：US11647204B2

公开(公告)日：2023-05-09

申请号：US17378065

申请日：2021-07-16

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Balineedu Chowdary Adsumilli ,  Vadim Polonichko

IPC: H04N5/232 ,  H04N19/137 ,  H04N19/167 ,  H04N5/225 ,  H04N13/00 ,  H04N19/107 ,  H04N19/597

CPC classification number: H04N19/137 ,  H04N5/2258 ,  H04N5/23238 ,  H04N13/00 ,  H04N19/107 ,  H04N19/167 ,  H04N19/597

Abstract: A method for encoding images includes decoding a first encoded image to obtain a first decoded image, where the first decoded image includes a first decoded portion corresponding to a first encoded portion of the first encoded image and a second decoded portion corresponding to a second encoded portion of the first encoded image; decoding a second encoded image to obtain a second decoded image; combining the first decoded image and the second decoded image to obtain a single decoded image; and encoding the single decoded image to obtain a single encoded image that includes a third and a fourth encoded portions. Encoding the single decoded image includes obtaining the third encoded portion of the single encoded image by copying the first encoded portion of the first encoded image; and obtaining the fourth encoded portion of the single encoded image by encoding the second decoded portion using an encoder.

公开(公告)号：US20230009943A1

公开(公告)日：2023-01-12

申请号：US17932391

申请日：2022-09-15

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Cesar Douady ,  Timothy MacMillan

IPC: H04N5/265 ,  H04N7/18 ,  H04N5/232 ,  H04N5/247

Abstract: Apparatus and methods for stitching images, or re-stitching previously stitched images. Specifically, the disclosed systems in one implementation save stitching information and/or original overlap source data during an original stitching process. During subsequent retrieval, rendering, and/or display of the stitched images, the originally stitched image can be flexibly augmented, and/or re-stitched to improve the original stitch quality. Practical applications of the disclosed solutions enable, among other things, a user to create and stitch a wide field of view (FOV) panorama from multiple source images on a device with limited processing capability (such as a mobile phone or other capture device). Moreover, post-processing stitching allows for the user to convert from one image projection to another without fidelity loss (or with an acceptable level of loss).

公开(公告)号：US20220038750A1

公开(公告)日：2022-02-03

申请号：US17502852

申请日：2021-10-15

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  David Newman

IPC: H04N19/86 ,  H04N19/597 ,  H04N19/85 ,  H04N19/82

Abstract: Reducing artifacts in decoded images includes decoding a first facet of an image, where the first facet includes first edge pixels. A second facet of the image that includes second edge pixels is decoded. The first edge pixels are not adjacent to the second edge pixels and the second facet is decoded independently of the first facet. The first edge pixels are copied to an area adjacent to the second edge pixels. The second edge pixels are filtered using the copied first edge pixels. The second edge pixels are copied to an area adjacent to the first edge pixels. The first edge pixels are filtered using the copied second edge pixels.

公开(公告)号：US11218676B2

公开(公告)日：2022-01-04

申请号：US17020362

申请日：2020-09-14

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  David Newman

IPC: H04N9/31 ,  H04N5/232 ,  G06T15/20

Abstract: Apparatus and methods for projection conversion decoding for applications eco-systems are disclosed. In one embodiment, a decoder apparatus is utilized to read formatting information from an intermediate projection format; convert the intermediate projection format to a display projection format; apply a rotation operation to the display projection format in accordance with the reading of the formatting information; and transmit the display projection format for use by an application. In some implementations, the intermediate projection format has been stabilized prior to encoding in order to improve upon the encoding efficiency for the intermediate projection format. The application of the rotation operation may then be utilized to reverse the stabilized imaging data. Methods and computing systems are also disclosed.

公开(公告)号：US11166047B2

公开(公告)日：2021-11-02

申请号：US16821744

申请日：2020-03-17

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  David Newman

IPC: H04N19/86 ,  H04N19/597 ,  H04N19/85 ,  H04N19/82 ,  H04N5/341 ,  H04N5/232

Abstract: Panoramic content may be characterized by a wide field of view and large image size. Panoramic image may be mapped to cube projection. When encoding/decoding cube-projected images, the disclosure exploits content continuity between cube facets. One facet may be encoded/decoded independently from other facets to obtain a seed facet. One or more transformed versions of the seed facet may be obtained, for example, one corresponding to a 90° counterclockwise rotation, another to a 90° clockwise rotation, and one to an 180° rotation. Transformed versions may be used to form an augmented image. The remained facets of the cube may be encoded using transformed versions within the augmented image. Boundary filtering may be applied to one or more edges of one or more facets.