-
81.
公开(公告)号:US10602124B2
公开(公告)日:2020-03-24
申请号:US15654617
申请日:2017-07-19
Applicant: GoPro, Inc.
Inventor: Adeel Abbas , Timothy Macmillan
IPC: H04N13/00 , H04N13/243 , H04N5/232 , G06T3/00 , G06T7/38 , G06T7/73 , G06T7/593 , H04N19/136 , H04N19/44 , G06K9/46 , G06K9/52 , G06K9/62 , G06T3/20 , G06T7/00 , G06T11/60 , G06T15/20 , H04N13/302 , H04N13/344 , H04N13/10 , H04N13/334 , H04N13/282 , G06T7/55 , H04N5/265 , H04N13/161
Abstract: Apparatus and methods for providing a frame packing arrangement for the encoding/decoding of, for example, panoramic content. In one embodiment, the frame packing arrangement utilizes overlapping imaging data so as to enable, for example, a post-decode stitching operation to be performed. The frame packing arrangement may utilize a number of projection formats, such as a cubemap projection, and may utilize any number of differing aspect ratios such as, without limitation, 4×3, 3×2, 4×2, 2×4 aspect ratios. Additionally, the overlapping imaging data may be positioned within the frame packing arrangement chosen so as to improve upon coding efficiency. For example, the overlapping imaging data may be positioned within the frame packing arrangement so as to emphasize image continuity. An encoder apparatus and decoder apparatus for use with the aforementioned frame packing arrangements are also disclosed.
-
公开(公告)号:US20200084394A1
公开(公告)日:2020-03-12
申请号:US16687559
申请日:2019-11-18
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Adeel Abbas , David Newman
IPC: H04N5/247 , H04N5/232 , H04N19/124 , G06T3/20 , H04N19/17 , H04N19/167 , H04N19/36 , H04N19/85 , H04N19/597
Abstract: Systems and methods for providing imaging content using spatially varying encoding quality. Imaging content may be acquired using spherical lenses (e.g., fisheye). When viewing spherical imaging content, spherical to planar image transformations may be utilized. Such transformations (e.g., equirectangular) may be characterized by spatially varying image distortion. Transformed images may be encoded. Encoding process may be configured based on spatially varying encoding quality. Encoding quality may be configured based on the transformation such that portions of the transformed image characterized by greater distortion may be encoded using lower quality (e.g. greater QP values); portions of the transformed image characterized by lower distortion may be encoded using greater quality (e.g. lower QP values). Such encoding may produce a bitstream characterized by a lower bitrate for a given quality and/or better quality for a given bitrate as compared to an encoding process that may apply a uniform encoding quality.
-
公开(公告)号:US10484621B2
公开(公告)日:2019-11-19
申请号:US15414403
申请日:2017-01-24
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Adeel Abbas , David Newman
IPC: H04N5/247 , G06T3/20 , H04N19/124 , H04N5/232 , H04N19/597 , H04N19/17 , H04N19/167 , H04N19/85 , H04N19/36 , G06T19/00
Abstract: Systems and methods for providing imaging content using spatially varying encoding quality. Imaging content may be acquired using spherical lenses (e.g., fisheye). When viewing spherical imaging content, spherical to planar image transformations may be utilized. Such transformations (e.g., equirectangular) may be characterized by spatially varying image distortion. Transformed images may be encoded. Encoding process may be configured based on spatially varying encoding quality. Encoding quality may be configured based on the transformation such that portions of the transformed image characterized by greater distortion may be encoded using lower quality (e.g. greater QP values); portions of the transformed image characterized by lower distortion may be encoded using greater quality (e.g. lower QP values). Such encoding may produce a bitstream characterized by a lower bitrate for a given quality and/or better quality for a given bitrate as compared to an encoding process that may apply a uniform encoding quality.
-
公开(公告)号:US20190335159A1
公开(公告)日:2019-10-31
申请号:US16508384
申请日:2019-07-11
Applicant: GoPro, Inc.
Inventor: Adeel Abbas , David A. Newman , Timothy Macmillan
IPC: H04N13/243 , H04N5/225 , G06T7/33 , G06K9/20 , H04N5/262 , H04N5/247 , H04N5/232 , H04N13/296 , G01S3/00 , G06T3/40
Abstract: A method and system are described. The method includes capturing a set of images from an array of cameras, each camera of the array of cameras having an overlapping field of view (FOV) with an adjacent camera of the array of cameras. The method further includes synchronously capturing a supplemental image from an additional camera, the additional camera having an at least partially overlapping FOV with every camera of the array of cameras. Supplemental information is extracted by comparing the supplemental image with the set of images. Portions of the set of images are stitched based in part on the supplemental information to produce a combined stitched image, the combined stitched image having a higher resolution than each image of the set of images.
-
公开(公告)号:US10462384B2
公开(公告)日:2019-10-29
申请号:US16234330
申请日:2018-12-27
Applicant: GoPro, Inc.
Inventor: Adeel Abbas , Cesar Douady-Pleven , Timothy Macmillan
Abstract: Apparatus and methods for stitching images, or re-stitching previously stitched images. Specifically, the disclosed systems in one implementation save stitching information and/or original overlap source data during an original stitching process. During subsequent retrieval, rendering, and/or display of the stitched images, the originally stitched image can be flexibly augmented, and/or re-stitched to improve the original stitch quality. Practical applications of the disclosed solutions enable, among other things, a user to create and stitch a wide field of view (FOV) panorama from multiple source images on a device with limited processing capability (such as a mobile phone or other capture device). Moreover, post-processing stitching allows for the user to convert from one image projection to another without fidelity loss (or with an acceptable level of loss).
-
86.
公开(公告)号:US20190289302A1
公开(公告)日:2019-09-19
申请号:US16428786
申请日:2019-05-31
Applicant: GoPro, Inc.
Inventor: Adeel Abbas
IPC: H04N19/176 , H04N19/85 , H04N19/597 , H04N19/105 , H04N19/147
Abstract: Apparatus and methods for encoding panoramic content, such as by a wide field of view and large image size. In one implementation, a panoramic image may be mapped to a cube, equirectangular or any other projection e.g., icosahedron or octahedron. Projection may be selected adaptively based on evaluation of the panoramic content. Content evaluation may include obtaining rate distortion cost metric for a given projection configuration including projection type, projection arrangement, and projection orientation. Projection configuration with the lowest cost may be selected as target projection for encoding content. As content composition changes (e.g., object motion, texture presence and/or location) projection may be adaptively selected to match changes in the content. Adaptive content selection methodology may provide for a lower encoded bitrate for a given encoded quality and/or higher quality for a given bitrate.
-
公开(公告)号:US20190244424A1
公开(公告)日:2019-08-08
申请号:US16234346
申请日:2018-12-27
Applicant: GoPro, Inc.
Inventor: Adeel Abbas
CPC classification number: G06T19/003 , G06T1/0007 , G06T3/0062
Abstract: Apparatus and methods for providing a rotated spherical viewpoint (RSV). In one or more embodiments, the RSV is implemented using equirectangular projections (ERPs). The RSV methodologies described herein are particularly suitable for panning within virtual reality (VR) or 360° panoramic content as there is minimal, if any, geometric distortions at the edge of a given viewport. Moreover, the RSV methodologies described herein may reduce the bandwidth requirements of, for example, devices operating in a client-server architecture. Additionally, the computation requirements for providing RSV are minimal and can be provided using relatively simple rotation transforms.
-
88.
公开(公告)号:US20190182473A1
公开(公告)日:2019-06-13
申请号:US16208327
申请日:2018-12-03
Applicant: GoPro, Inc.
Inventor: Timothy Macmillan , Adeel Abbas
IPC: H04N13/243 , H04N5/232 , H04N19/136 , G06T7/73 , G06T7/38 , H04N5/265 , G06T7/55 , G06T7/593 , G06T15/20 , G06T11/60 , G06T3/00 , H04N13/282 , H04N13/334 , H04N13/10 , H04N13/344 , H04N13/302 , H04N19/44 , G06K9/46 , G06K9/52 , G06K9/62 , G06T3/20 , G06T7/00
CPC classification number: H04N13/243 , G06K9/4609 , G06K9/52 , G06K9/6201 , G06K9/6212 , G06T3/0043 , G06T3/0068 , G06T3/20 , G06T7/0002 , G06T7/38 , G06T7/55 , G06T7/593 , G06T7/73 , G06T11/60 , G06T15/20 , G06T2200/04 , G06T2207/20221 , H04N5/23238 , H04N5/265 , H04N13/10 , H04N13/161 , H04N13/282 , H04N13/302 , H04N13/334 , H04N13/344 , H04N19/136 , H04N19/44
Abstract: A system captures a first hemispherical image and a second hemispherical image, each hemispherical image including an overlap portion, the overlap potions capturing a same field of view, the two hemispherical images collectively comprising a spherical FOV and separated along a longitudinal plane. The system maps a modified first hemispherical image to a first portion of the 2D projection of a cubic image, the modified first hemispherical image including a non-overlap portion of the first hemispherical image, and maps a modified second hemispherical image to a second portion of the 2D projection of the cubic image, the modified second hemispherical image also including a non-overlap portion. The system maps the overlap portions of the first hemispherical image and the second hemispherical image to the 2D projection of the cubic image, and encodes the 2D projection of the cubic image to generate an encoded image representative of the spherical FOV.
-
89.
公开(公告)号:US20180205889A1
公开(公告)日:2018-07-19
申请号:US15406175
申请日:2017-01-13
Applicant: GoPro, Inc.
Inventor: Adeel Abbas , Cesar Douady-Pleven , Timothy Macmillan
CPC classification number: H04N5/265 , H04N5/23238 , H04N5/247 , H04N7/181
Abstract: Apparatus and methods for stitching images, or re-stitching previously stitched images. Specifically, the disclosed systems in one implementation save stitching information and/or original overlap source data during an original stitching process. During subsequent retrieval, rendering, and/or display of the stitched images, the originally stitched image can be flexibly augmented, and/or re-stitched to improve the original stitch quality. Practical applications of the disclosed solutions enable, among other things, a user to create and stitch a wide field of view (FOV) panorama from multiple source images on a device with limited processing capability (such as a mobile phone or other capture device). Moreover, post-processing stitching allows for the user to convert from one image projection to another without fidelity loss (or with an acceptable level of loss).
-
90.
公开(公告)号:US20180025467A1
公开(公告)日:2018-01-25
申请号:US15357968
申请日:2016-11-21
Applicant: GoPro, Inc.
Inventor: Timothy Macmillan , Adeel Abbas
IPC: G06T3/20 , G06T7/00 , H04N19/44 , G06K9/52 , G06T15/20 , G06K9/62 , G06T3/00 , G06K9/46 , H04N19/136 , G06T11/60
CPC classification number: H04N13/243 , G06K9/4609 , G06K9/52 , G06K9/6201 , G06K9/6212 , G06T3/0043 , G06T3/0068 , G06T3/20 , G06T7/0002 , G06T7/38 , G06T7/55 , G06T7/593 , G06T7/73 , G06T11/60 , G06T15/20 , G06T2200/04 , G06T2207/20221 , H04N5/23238 , H04N5/265 , H04N13/10 , H04N13/161 , H04N13/282 , H04N13/302 , H04N13/334 , H04N13/344 , H04N19/136 , H04N19/44
Abstract: A system receives an encoded image representative of the 2D projection of a cubic image, the encoded image generated from two overlapping hemispherical images separated along a longitudinal plane of a sphere. The system decodes the encoded image to produce a decoded 2D projection of the cubic image, and perform a stitching operation to portions of the decoded 2D projection representative of overlapping portions of the hemispherical images to produce stitched overlapping portions. The system combine the stitched overlapping portions with portions of the decoded 2D projection representative of the non-overlapping portions of the hemispherical images to produce a stitched 2D projection of the cubic image, and encode the stitched 2D projection of the cubic image to produce an encoded cubic projection of the stitched hemispherical images.
-
-
-
-
-
-
-
-
-