公开(公告)号：US20250039397A1

公开(公告)日：2025-01-30

申请号：US18915869

申请日：2024-10-15

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Balineedu Chowdary Adsumilli ,  Vadim Polonichko

IPC: H04N19/137 ,  H04N13/00 ,  H04N19/107 ,  H04N19/167 ,  H04N19/597 ,  H04N23/45 ,  H04N23/698

Abstract: A panoramic video frame is partitioned into a plurality of tiles. A viewport corresponding to a field of view within the panoramic video frame is identified. First tiles of the plurality of tiles corresponding to the viewport are encoded at a first bitrate to obtain first encoded tiles. Second tiles of the plurality of tiles outside the viewport are encoded at a second bitrate lower than the first bitrate to obtain second encoded tiles. The first encoded tiles and the second encoded tiles are transmitted to a user device for rendering.

公开(公告)号：US11743416B2

公开(公告)日：2023-08-29

申请号：US17932391

申请日：2022-09-15

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Cesar Douady ,  Timothy MacMillan

IPC: H04N5/265 ,  H04N7/18 ,  H04N23/90 ,  H04N23/698

CPC classification number: H04N5/265 ,  H04N7/181 ,  H04N23/698 ,  H04N23/90

Abstract: Apparatus and methods for stitching images, or re-stitching previously stitched images. Specifically, the disclosed systems in one implementation save stitching information and/or original overlap source data during an original stitching process. During subsequent retrieval, rendering, and/or display of the stitched images, the originally stitched image can be flexibly augmented, and/or re-stitched to improve the original stitch quality. Practical applications of the disclosed solutions enable, among other things, a user to create and stitch a wide field of view (FOV) panorama from multiple source images on a device with limited processing capability (such as a mobile phone or other capture device). Moreover, post-processing stitching allows for the user to convert from one image projection to another without fidelity loss (or with an acceptable level of loss).

公开(公告)号：US11475534B2

公开(公告)日：2022-10-18

申请号：US17080693

申请日：2020-10-26

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Timothy Macmillan ,  Cesar Douady-Pleven

IPC: G06T3/00 ,  H04N5/232 ,  H04N5/225 ,  G06T3/40

Abstract: Apparatus and methods for the stitch zone calculation of a generated projection of a spherical image. In one embodiment, a computing device is disclosed which includes logic configured to: obtain a plurality of images; map the plurality of images onto a spherical image; re-orient the spherical image in accordance with a desired stitch line and a desired projection for the desired stitch line; and map the spherical image to the desired projection having the desired stitch line. In a variant, the desired stitch line is mapped onto an optimal stitch zone, the optimal stitch zone characterized as a set of points that defines a single line on the desired projection in which the set of points along the desired projection lie closest to the spherical image in a mean square sense.

公开(公告)号：US20210344927A1

公开(公告)日：2021-11-04

申请号：US17378065

申请日：2021-07-16

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Balineedu Chowdary Adsumilli ,  Vadim Polonichko

IPC: H04N19/137 ,  H04N19/167 ,  H04N5/232 ,  H04N5/225 ,  H04N13/00 ,  H04N19/107 ,  H04N19/597

Abstract: A method for encoding images includes decoding a first encoded image to obtain a first decoded image, where the first decoded image includes a first decoded portion corresponding to a first encoded portion of the first encoded image and a second decoded portion corresponding to a second encoded portion of the first encoded image; decoding a second encoded image to obtain a second decoded image; combining the first decoded image and the second decoded image to obtain a single decoded image; and encoding the single decoded image to obtain a single encoded image that includes a third and a fourth encoded portions. Encoding the single decoded image includes obtaining the third encoded portion of the single encoded image by copying the first encoded portion of the first encoded image; and obtaining the fourth encoded portion of the single encoded image by encoding the second decoded portion using an encoder.

公开(公告)号：US11122271B2

公开(公告)日：2021-09-14

申请号：US16666094

申请日：2019-10-28

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Balineedu Chowdary Adsumilli ,  Vadim Polonichko

IPC: H04N19/137 ,  H04N19/167 ,  H04N5/232 ,  H04N5/225 ,  H04N13/00 ,  H04N19/107 ,  H04N19/597

Abstract: Systems and methods for providing panoramic image and/or video content using spatially selective encoding and/or decoding. Panoramic content may include stitched spherical (360-degree) images and/or VR video. In some implementations, selective encoding functionality may be embodied in a spherical image capture device that may include two lenses configured to capture pairs of hemispherical images. Encoded source images may be decoded and stitched in order to obtain a combined image characterized by a greater field of view as compared to source images. The stitched image may be encoded using a selective encoding methodology including: partitioning a stitched image into multiple portions, determining if a portion is to be re-encoded. If the image portion is to be re-encoded, re-encoding the image portion. If an image portion is not to be re-encoded, copying previously encoded image portion in lieu of encoding.

公开(公告)号：US11030717B2

公开(公告)日：2021-06-08

申请号：US16656396

申请日：2019-10-17

Applicant: GoPro, Inc.

Inventor： Balineedu Chowdary Adsumilli ,  Adeel Abbas

IPC: H04N5/232 ,  G06T3/40

Abstract: Systems and methods for providing panoramic image and/or video content using multi-resolution stitching. Panoramic content may include stitched spherical (360-degree) images and/or VR video. In some implementations, multi-resolution stitching functionality may be embodied in a spherical image capture device that may include two lenses configured to capture pairs of hemispherical images. The capture device may obtain images (e.g., representing left and right hemispheres) that may be characterized by 180-degree (or greater) field of view. Source images may be combined using multi-resolution stitching methodology. Source images may be transformed to obtain multiple image components characterized by two or more image resolutions. The stitched image may be encoded using selective encoding methodology including: partitioning source images into a low resolution/frequency and a high resolution/frequency components; stitching low resolution/frequency components using coarse stitching operation, stitching high resolution/high frequency components using a refined stitch operation; combining stitched LF components and stitched HF components.

公开(公告)号：US20210090214A1

公开(公告)日：2021-03-25

申请号：US16234396

申请日：2018-12-27

Applicant: GOPRO, INC.

Inventor： David Newman ,  Daryl Stimm ,  Adeel Abbas

IPC: G06T3/40 ,  G06T3/00 ,  H04N19/80

Abstract: Methods and apparatus for multi-encoder processing of high resolution content. In one embodiment, the method includes capturing high resolution imaging content; splitting up the captured high resolution imaging content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In another embodiment, the method includes retrieving and/or receiving an A/V container; splitting up the retrieved and/or received A/V container into respective portions; feeding the split up portions to respective imaging decoders; stitching the decoded imaging portions into a common imaging portion; and storing and/or displaying at least a portion of the common imaging portion.

公开(公告)号：US20210042876A1

公开(公告)日：2021-02-11

申请号：US17080693

申请日：2020-10-26

Applicant: GoPro, Inc

Inventor： Adeel Abbas ,  Timothy Macmillan ,  Cesar Douady-Pleven

IPC: G06T3/00 ,  G06T3/40 ,  H04N5/232 ,  H04N5/225

Abstract: Apparatus and methods for the stitch zone calculation of a generated projection of a spherical image. In one embodiment, a computing device is disclosed which includes logic configured to: obtain a plurality of images; map the plurality of images onto a spherical image; re-orient the spherical image in accordance with a desired stitch line and a desired projection for the desired stitch line; and map the spherical image to the desired projection having the desired stitch line. In a variant, the desired stitch line is mapped onto an optimal stitch zone, the optimal stitch zone characterized as a set of points that defines a single line on the desired projection in which the set of points along the desired projection lie closest to the spherical image in a mean square sense.

公开(公告)号：US10904414B2

公开(公告)日：2021-01-26

申请号：US16799198

申请日：2020-02-24

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Joshua P. Davies ,  William H. Tolbert

IPC: H04N5/225 ,  G02B7/02 ,  H04N5/232 ,  G02B13/06 ,  G03B17/12 ,  G03B37/04

Abstract: Dual-lens assemblies and cameras including dual lens-assemblies that include a first lens barrel securing a first lens having a first optical axis and a second lens barrel securing a second lens having a second optical axis are disclosed. In one dual-lens assembly, the first optical axis is approximately parallel to and spaced from the second optical axis by a lateral offset, axial lengths of the first lens barrel and the second lens barrel are approximately equal, and the first lens and the second lens are oriented in opposite directions at opposing ends of the first lens barrel and the second lens barrel.

公开(公告)号：US10827176B2

公开(公告)日：2020-11-03

申请号：US16410919

申请日：2019-05-13

Applicant: GoPro, Inc.

Inventor： Balineedu Chowdary Adsumilli ,  Adeel Abbas ,  David Newman

IPC: H04N19/124 ,  H04N21/218 ,  H04N21/2343 ,  H04N21/81 ,  H04N19/167 ,  H04N19/154 ,  H04N19/17

Abstract: Systems and methods for providing video content using spatially adaptive video encoding. Panoramic and/or virtual reality content may be viewed by a client device using a viewport with viewing dimension(s) configured smaller than available dimension(s) of the content. Client device may include a portable media device characterized by given energy and/or computational resources. Video content may be encoded using spatially varying encoding. For image playback, portions of panoramic image may be pre-encoded using multiple quality bands. Pre-encoded image portions, matching the viewport, may be provided and reduce computational and/or energy load on the client device during consumption of panoramic content. Quality distribution may include gradual quality transition area allowing for small movements of the viewport without triggering image re-encoding. Larger movements of the viewport may automatically trigger transition to another spatial encoding distribution.