公开(公告)号：US20180012335A1

公开(公告)日：2018-01-11

申请号：US15643123

申请日：2017-07-06

Applicant: GoPro, Inc.

Inventor： Balineedu Chowdary Adsumilli ,  Adeel Abbas

IPC: G06T3/40 ,  H04N5/232

CPC classification number: G06T3/4038 ,  G06T3/4084 ,  H04N5/23238

Abstract: Systems and methods for providing panoramic image and/or video content using multi-resolution stitching. Panoramic content may include stitched spherical (360-degree) images and/or VR video. In some implementations, multi-resolution stitching functionality may be embodied in a spherical image capture device that may include two lenses configured to capture pairs of hemispherical images. The capture device may obtain images (e.g., representing left and right hemispheres) that may be characterized by 180-degree (or greater) field of view. Source images may be combined using multi-resolution stitching methodology. Source images may be transformed to obtain multiple image components characterized by two or more image resolutions. The stitched image may be encoded using selective encoding methodology including: partitioning source images into a low resolution/frequency and a high resolution/frequency components; stitching low resolution/frequency components using coarse stitching operation, stitching high resolution/high frequency components using a refined stitch operation; combining stitched LF components and stitched HF components.

公开(公告)号：US12126809B2

公开(公告)日：2024-10-22

申请号：US18144574

申请日：2023-05-08

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Balineedu Chowdary Adsumilli ,  Vadim Polonichko

IPC: H04N19/597 ,  H04N13/00 ,  H04N19/107 ,  H04N19/137 ,  H04N19/167 ,  H04N23/45 ,  H04N23/698

CPC classification number: H04N19/137 ,  H04N13/00 ,  H04N19/107 ,  H04N19/167 ,  H04N19/597 ,  H04N23/45 ,  H04N23/698

Abstract: Encoded content is accessed. The encoded content includes an encoded first centrally located tile corresponding to a first centrally located tile of a first image, an encoded first peripherally located tile of the first image, and an encoded second peripherally located tile of a second image. The encoded first peripherally located tile is decoded to obtain a decoded first peripherally located tile. The encoded second peripherally located tile is decoded to obtain a decoded second peripherally located tile. The decoded first peripherally located tile and the decoded second peripherally located tile are stitched to obtain a stitched image portion. The stitched image portion is encoded to obtain an encoded stitched image portion. An encoded stitched image of the first image and the second image is obtained by combining the encoded first centrally located tile, and the encoded stitched image portion.

公开(公告)号：US12022227B2

公开(公告)日：2024-06-25

申请号：US18349929

申请日：2023-07-10

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Cesar Douady ,  Timothy MacMillan

IPC: H04N5/265 ,  H04N7/18 ,  H04N23/698 ,  H04N23/90

CPC classification number: H04N5/265 ,  H04N7/181 ,  H04N23/698 ,  H04N23/90

Abstract: Apparatus and methods for stitching images, or re-stitching previously stitched images. Specifically, the disclosed systems in one implementation save stitching information and/or original overlap source data during an original stitching process. During subsequent retrieval, rendering, and/or display of the stitched images, the originally stitched image can be flexibly augmented, and/or re-stitched to improve the original stitch quality. Practical applications of the disclosed solutions enable, among other things, a user to create and stitch a wide field of view (FOV) panorama from multiple source images on a device with limited processing capability (such as a mobile phone or other capture device). Moreover, post-processing stitching allows for the user to convert from one image projection to another without fidelity loss (or with an acceptable level of loss).

公开(公告)号：US11983839B2

公开(公告)日：2024-05-14

申请号：US18225850

申请日：2023-07-25

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Timothy Macmillan ,  Cesar Douady-Pleven

IPC: G06T3/08 ,  G06T3/12 ,  G06T3/14 ,  G06T3/4038 ,  H04N23/45 ,  H04N23/698

CPC classification number: G06T3/08 ,  G06T3/12 ,  G06T3/14 ,  G06T3/4038 ,  H04N23/45 ,  H04N23/698

Abstract: Apparatus and methods for the stitch zone calculation of a generated projection of a spherical image. In one embodiment, a non-transitory computer-readable apparatus comprising a storage apparatus, the storage apparatus comprising instructions configured to, when executed by a processor apparatus, cause a computerized apparatus to identify a stitch line associated with an equatorial area of a plurality of spherical images; re-orient the plurality of spherical images in accordance with the stitch line; and project the re-oriented plurality of spherical images to a selected image projection type.

公开(公告)号：US20230362319A1

公开(公告)日：2023-11-09

申请号：US18349929

申请日：2023-07-10

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Cesar Douady ,  Timothy MacMillan

IPC: H04N5/265 ,  H04N7/18 ,  H04N23/90 ,  H04N23/698

CPC classification number: H04N5/265 ,  H04N7/181 ,  H04N23/90 ,  H04N23/698

Abstract: Apparatus and methods for stitching images, or re-stitching previously stitched images. Specifically, the disclosed systems in one implementation save stitching information and/or original overlap source data during an original stitching process. During subsequent retrieval, rendering, and/or display of the stitched images, the originally stitched image can be flexibly augmented, and/or re-stitched to improve the original stitch quality. Practical applications of the disclosed solutions enable, among other things, a user to create and stitch a wide field of view (FOV) panorama from multiple source images on a device with limited processing capability (such as a mobile phone or other capture device). Moreover, post-processing stitching allows for the user to convert from one image projection to another without fidelity loss (or with an acceptable level of loss).

公开(公告)号：US11790488B2

公开(公告)日：2023-10-17

申请号：US17332953

申请日：2021-05-27

Applicant: GoPro, Inc.

Inventor： David Newman ,  Daryl Stimm ,  Adeel Abbas

IPC: G06T3/40 ,  H04N19/80 ,  G06T3/00

CPC classification number: G06T3/4038 ,  G06T3/0018 ,  G06T3/0062 ,  H04N19/80

Abstract: Methods and apparatus for multi-encoder processing of high resolution content. In one embodiment, the method includes capturing high resolution imaging content; splitting up the captured high resolution imaging content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In another embodiment, the method includes retrieving and/or receiving an A/V container; splitting up the retrieved and/or received A/V container into respective portions; feeding the split up portions to respective imaging decoders; stitching the decoded imaging portions into a common imaging portion; and storing and/or displaying at least a portion of the common imaging portion.

公开(公告)号：US20230276054A1

公开(公告)日：2023-08-31

申请号：US18144574

申请日：2023-05-08

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Balineedu Chowdary Adsumilli ,  Vadim Polonichko

IPC: H04N19/137 ,  H04N19/167 ,  H04N13/00 ,  H04N19/107 ,  H04N19/597 ,  H04N23/45 ,  H04N23/698

CPC classification number: H04N19/137 ,  H04N19/167 ,  H04N13/00 ,  H04N19/107 ,  H04N19/597 ,  H04N23/45 ,  H04N23/698

Abstract: Encoded content is accessed. The encoded content includes an encoded first centrally located tile corresponding to a first centrally located tile of a first image, an encoded first peripherally located tile of the first image, and an encoded second peripherally located tile of a second image. The encoded first peripherally located tile is decoded to obtain a decoded first peripherally located tile. The encoded second peripherally located tile is decoded to obtain a decoded second peripherally located tile. The decoded first peripherally located tile and the decoded second peripherally located tile are stitched to obtain a stitched image portion. The stitched image portion is encoded to obtain an encoded stitched image portion. An encoded stitched image of the first image and the second image is obtained by combining the encoded first centrally located tile, and the encoded stitched image portion.

公开(公告)号：US11477395B2

公开(公告)日：2022-10-18

申请号：US17240868

申请日：2021-04-26

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Cesar Douady ,  Timothy MacMillan

IPC: H04N5/265 ,  H04N7/18 ,  H04N5/232 ,  H04N5/247

Abstract: Apparatus and methods for stitching images, or re-stitching previously stitched images. Specifically, the disclosed systems in one implementation save stitching information and/or original overlap source data during an original stitching process. During subsequent retrieval, rendering, and/or display of the stitched images, the originally stitched image can be flexibly augmented, and/or re-stitched to improve the original stitch quality. Practical applications of the disclosed solutions enable, among other things, a user to create and stitch a wide field of view (FOV) panorama from multiple source images on a device with limited processing capability (such as a mobile phone or other capture device). Moreover, post-processing stitching allows for the user to convert from one image projection to another without fidelity loss (or with an acceptable level of loss).

公开(公告)号：US11330245B2

公开(公告)日：2022-05-10

申请号：US16823118

申请日：2020-03-18

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Timothy Macmillan

IPC: H04N19/00 ,  H04N13/243 ,  H04N5/232 ,  G06T3/00 ,  G06T7/38 ,  G06T7/73 ,  G06T7/593 ,  G06V10/42 ,  G06V10/44 ,  G06V10/75 ,  H04N19/136 ,  H04N19/44 ,  G06K9/62 ,  G06T3/20 ,  G06T7/00 ,  G06T11/60 ,  G06T15/20 ,  H04N13/302 ,  H04N13/344 ,  H04N13/10 ,  H04N13/334 ,  H04N13/282 ,  G06T7/55 ,  H04N5/265 ,  H04N13/161

Abstract: Apparatus and methods for providing a frame packing arrangement for the encoding/decoding of, for example, panoramic content. In one embodiment, the frame packing arrangement utilizes overlapping imaging data so as to enable, for example, a post-decode stitching operation to be performed. The frame packing arrangement may utilize a number of projection formats, such as a cubemap projection, and may utilize any number of differing aspect ratios such as, without limitation, 4×3, 3×2, 4×2, 2×4 aspect ratios. Additionally, the overlapping imaging data may be positioned within the frame packing arrangement chosen so as to improve upon coding efficiency. For example, the overlapping imaging data may be positioned within the frame packing arrangement so as to emphasize image continuity. An encoder apparatus and decoder apparatus for use with the aforementioned frame packing arrangements are also disclosed.

公开(公告)号：US11265527B2

公开(公告)日：2022-03-01

申请号：US16786283

申请日：2020-02-10

Applicant: GoPro, inc.

Inventor： Adeel Abbas ,  David A. Newman

IPC: H04N13/00 ,  H04N13/161 ,  H04N5/232 ,  G06T3/40 ,  H04N19/597 ,  H04N19/124 ,  H04N19/40 ,  H04N19/70 ,  H04N13/156 ,  H04N13/178 ,  H04N7/015 ,  H04N19/59

Abstract: Apparatus and methods for providing a frame packing arrangement for the encoding/decoding of, for example, panoramic content. In one embodiment, an encoder apparatus is disclosed. In a variant, the encoder apparatus is configured to encode Segmented Sphere Projections (SSP) imaging data and/or Rotated Sphere Projections (RSP) imaging data into an extant imaging format. In another variant, a decoder apparatus is disclosed. In one embodiment, the decoder apparatus is configured to decode SSP imaging data and/or RSP imaging data from an extant imaging format. Computing devices, computer-readable storage apparatus, integrated circuits and methods for using the aforementioned encoder and decoder are also disclosed.