-
公开(公告)号:US20210287337A1
公开(公告)日:2021-09-16
申请号:US17332953
申请日:2021-05-27
Applicant: GoPro, Inc.
Inventor: David Newman , Daryl Stimm , Adeel Abbas
Abstract: Methods and apparatus for multi-encoder processing of high resolution content. In one embodiment, the method includes capturing high resolution imaging content; splitting up the captured high resolution imaging content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In another embodiment, the method includes retrieving and/or receiving an A/V container; splitting up the retrieved and/or received A/V container into respective portions; feeding the split up portions to respective imaging decoders; stitching the decoded imaging portions into a common imaging portion; and storing and/or displaying at least a portion of the common imaging portion.
-
公开(公告)号:US20210264565A1
公开(公告)日:2021-08-26
申请号:US17314217
申请日:2021-05-07
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Adeel Abbas
Abstract: Systems and methods for providing panoramic image and/or video content using multi-resolution stitching. Panoramic content may include stitched spherical (360-degree) images and/or VR video. In some implementations, multi-resolution stitching functionality may be embodied in a spherical image capture device that may include two lenses configured to capture pairs of hemispherical images. The capture device may obtain images (e.g., representing left and right hemispheres) that may be characterized by 180-degree (or greater) field of view. Source images may be combined using multi-resolution stitching methodology. Source images may be transformed to obtain multiple image components characterized by two or more image resolutions. The stitched image may be encoded using selective encoding methodology including: partitioning source images into a low resolution/frequency and a high resolution/frequency components; stitching low resolution/frequency components using coarse stitching operation, stitching high resolution/high frequency components using a refined stitch operation; combining stitched LF components and stitched HF components.
-
公开(公告)号:US11024008B1
公开(公告)日:2021-06-01
申请号:US16781953
申请日:2020-02-04
Applicant: GoPro, Inc.
Inventor: David Newman , Daryl Stimm , Adeel Abbas
Abstract: Methods and apparatus for multi-encoder processing of high resolution content. In one embodiment, the method includes capturing high resolution imaging content; splitting up the captured high resolution imaging content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In another embodiment, the method includes retrieving and/or receiving an A/V container; splitting up the retrieved and/or received A/V container into respective portions; feeding the split up portions to respective imaging decoders; stitching the decoded imaging portions into a common imaging portion; and storing and/or displaying at least a portion of the common imaging portion.
-
公开(公告)号:US11004176B1
公开(公告)日:2021-05-11
申请号:US16781946
申请日:2020-02-04
Applicant: GoPro, Inc.
Inventor: David Newman , Daryl Stimm , Adeel Abbas
Abstract: Methods and apparatus for multi-encoder processing of high resolution content. In one embodiment, the method includes capturing high resolution imaging content; splitting up the captured high resolution imaging content into respective portions; feeding the split up portions to respective imaging encoders; packing encoded content from the respective imaging encoders into an A/V container; and storing and/or transmitting the A/V container. In another embodiment, the method includes retrieving and/or receiving an A/V container; splitting up the retrieved and/or received A/V container into respective portions; feeding the split up portions to respective imaging decoders; stitching the decoded imaging portions into a common imaging portion; and storing and/or displaying at least a portion of the common imaging portion.
-
105.
公开(公告)号:US10817978B2
公开(公告)日:2020-10-27
申请号:US16459482
申请日:2019-07-01
Applicant: GoPro, Inc.
Inventor: Adeel Abbas , Timothy Macmillan , Cesar Douady-Pleven
Abstract: Apparatus and methods for the stitch zone calculation of a generated projection of a spherical image. In one embodiment, a computing device is disclosed which includes logic configured to: obtain a plurality of images; map the plurality of images onto a spherical image; re-orient the spherical image in accordance with a desired stitch line and a desired projection for the desired stitch line; and map the spherical image to the desired projection having the desired stitch line. In a variant, the desired stitch line is mapped onto an optimal stitch zone, the optimal stitch zone characterized as a set of points that defines a single line on the desired projection in which the set of points along the desired projection lie closest to the spherical image in a mean square sense.
-
公开(公告)号:US10735712B2
公开(公告)日:2020-08-04
申请号:US16508384
申请日:2019-07-11
Applicant: GoPro, Inc.
Inventor: Adeel Abbas , David A. Newman , Timothy Macmillan
IPC: G06K9/46 , G06T7/33 , G06T17/00 , G06T7/292 , H04N5/232 , H04N5/247 , H04N13/243 , H04N13/296 , G01S3/00 , G06K9/20 , G06T3/40 , H04N5/225 , H04N5/262 , G06K9/36
Abstract: A method and system are described. The method includes capturing a set of images from an array of cameras, each camera of the array of cameras having an overlapping field of view (FOV) with an adjacent camera of the array of cameras. The method further includes synchronously capturing a supplemental image from an additional camera, the additional camera having an at least partially overlapping FOV with every camera of the array of cameras. Supplemental information is extracted by comparing the supplemental image with the set of images. Portions of the set of images are stitched based in part on the supplemental information to produce a combined stitched image, the combined stitched image having a higher resolution than each image of the set of images.
-
公开(公告)号:US10536702B1
公开(公告)日:2020-01-14
申请号:US15415002
申请日:2017-01-25
Applicant: GOPRO, INC.
Inventor: Adeel Abbas
IPC: G06T7/20 , H04N19/137 , H04N19/182 , H04N19/172 , H04N19/426 , H04N19/44 , H04N19/46
Abstract: Systems and methods for utilizing on-device sensor information to improve video encoding quality are discussed herein. Specifically, the systems and methods may utilize on-device sensor information to efficiently determine whether to encode a particular frame within a set of frames as an intra frame. When captured on video, a particular arrangement of a group of pixels within a frame may comprise a visual representation of an object within the frame. When encoding video footage, motion information characterizing motion of an image capturing device over time may be used to predict the modification of an arrangement of a group of pixels between frames. These predictions may be used to efficiently determine whether to encode a particular frame as an intra frame.
-
108.
公开(公告)号:US10484664B2
公开(公告)日:2019-11-19
申请号:US16208327
申请日:2018-12-03
Applicant: GoPro, Inc.
Inventor: Timothy Macmillan , Adeel Abbas
IPC: H04N19/136 , H04N13/243 , H04N5/232 , H04N19/44 , G06K9/46 , G06K9/52 , G06K9/62 , G06T3/00 , G06T3/20 , G06T7/00 , G06T11/60 , G06T15/20 , H04N13/302 , H04N13/344 , H04N13/10 , H04N13/334 , H04N13/282 , G06T7/38 , G06T7/73 , G06T7/593 , G06T7/55 , H04N5/265 , H04N13/161
Abstract: A system captures a first hemispherical image and a second hemispherical image, each hemispherical image including an overlap portion, the overlap portion capturing a same field of view, the two hemispherical images collectively comprising a spherical FOV and separated along a longitudinal plane. The system maps a modified first hemispherical image to a first portion of the 2D projection of a cubic image, the modified first hemispherical image including a non-overlap portion of the first hemispherical image, and maps a modified second hemispherical image to a second portion of the 2D projection of the cubic image, the modified second hemispherical image also including a non-overlap portion. The system maps the overlap portions of the first hemispherical image and the second hemispherical image to the 2D projection of the cubic image, and encodes the 2D projection of the cubic image to generate an encoded image representative of the spherical FOV.
-
公开(公告)号:US10462466B2
公开(公告)日:2019-10-29
申请号:US15414426
申请日:2017-01-24
Applicant: GoPro, Inc.
Inventor: Adeel Abbas , Balineedu Chowdary Adsumilli , Vadim Polonichko
IPC: H04N19/597 , H04N19/137 , H04N19/167 , H04N5/232 , H04N5/225 , H04N13/00 , H04N19/107
Abstract: Systems and methods for providing panoramic image and/or video content using spatially selective encoding and/or decoding. Panoramic content may include stitched spherical (360-degree) images and/or VR video. In some implementations, selective encoding functionality may be embodied in a spherical image capture device that may include two lenses configured to capture pairs of hemispherical images. Encoded source images may be decoded and stitched in order to obtain a combined image characterized by a greater field of view as compared to source images. The stitched image may be encoded using a selective encoding methodology including: partitioning a stitched image into multiple portions, determining if a portion is to be re-encoded. If the image portion is to be re-encoded, re-encoding the image portion. If an image portion is not to be re-encoded, copying previously encoded image portion in lieu of encoding.
-
110.
公开(公告)号:US20190289223A1
公开(公告)日:2019-09-19
申请号:US16234330
申请日:2018-12-27
Applicant: GoPro, Inc.
Inventor: Adeel Abbas , Cesar Douady-Pleven , Timothy Macmillan
Abstract: Apparatus and methods for stitching images, or re-stitching previously stitched images. Specifically, the disclosed systems in one implementation save stitching information and/or original overlap source data during an original stitching process. During subsequent retrieval, rendering, and/or display of the stitched images, the originally stitched image can be flexibly augmented, and/or re-stitched to improve the original stitch quality. Practical applications of the disclosed solutions enable, among other things, a user to create and stitch a wide field of view (FOV) panorama from multiple source images on a device with limited processing capability (such as a mobile phone or other capture device). Moreover, post-processing stitching allows for the user to convert from one image projection to another without fidelity loss (or with an acceptable level of loss).
-
-
-
-
-
-
-
-
-