-
51.
公开(公告)号:US20200162720A1
公开(公告)日:2020-05-21
申请号:US16687375
申请日:2019-11-18
Applicant: GoPro, Inc.
Inventor: Timothy MacMillan , Adeel Abbas
IPC: H04N13/243 , H04N5/265 , G06T7/55 , H04N13/282 , H04N13/334 , H04N13/10 , H04N13/344 , H04N13/302 , G06T15/20 , G06T11/60 , G06T7/00 , G06T3/20 , G06T3/00 , G06K9/62 , G06K9/52 , G06K9/46 , H04N19/44 , H04N19/136 , G06T7/593 , G06T7/73 , G06T7/38 , H04N5/232
Abstract: A system captures a first hemispherical image and a second hemispherical image, each hemispherical image including an overlap portion, the overlap portions capturing a same field of view, the two hemispherical images collectively comprising a spherical FOV and separated along a longitudinal plane. The system maps a modified first hemispherical image to a first portion of the 2D projection of a cubic image, the modified first hemispherical image including a non-overlap portion of the first hemispherical image, and maps a modified second hemispherical image to a second portion of the 2D projection of the cubic image, the modified second hemispherical image also including a non-overlap portion. The system maps the overlap portions of the first hemispherical image and the second hemispherical image to the 2D projection of the cubic image, and encodes the 2D projection of the cubic image to generate an encoded image representative of the spherical FOV.
-
公开(公告)号:US10650592B2
公开(公告)日:2020-05-12
申请号:US16234346
申请日:2018-12-27
Applicant: GoPro, Inc.
Inventor: Adeel Abbas
Abstract: Apparatus and methods for providing a rotated spherical viewpoint (RSV). In one or more embodiments, the RSV is implemented using equirectangular projections (ERPs). The RSV methodologies described herein are particularly suitable for panning within virtual reality (VR) or 360° panoramic content as there is minimal, if any, geometric distortions at the edge of a given viewport. Moreover, the RSV methodologies described herein may reduce the bandwidth requirements of, for example, devices operating in a client-server architecture. Additionally, the computation requirements for providing RSV are minimal and can be provided using relatively simple rotation transforms.
-
公开(公告)号:US10574871B2
公开(公告)日:2020-02-25
申请号:US16513954
申请日:2019-07-17
Applicant: GoPro, Inc.
Inventor: Adeel Abbas , Joshua P. Davies , William H. Tolbert
Abstract: Dual-lens assemblies and cameras including dual lens-assemblies that include a first lens barrel securing a first lens having a first optical axis and a second lens barrel securing a second lens having a second optical axis are disclosed. In one dual-lens assembly, the first optical axis is approximately parallel to and spaced from the second optical axis by a lateral offset, axial lengths of the first lens barrel and the second lens barrel are approximately equal, and the first lens and the second lens are oriented in opposite directions at opposing ends of the first lens barrel and the second lens barrel.
-
公开(公告)号:US10482574B2
公开(公告)日:2019-11-19
申请号:US15643123
申请日:2017-07-06
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Adeel Abbas
Abstract: Systems and methods for providing panoramic image and/or video content using multi-resolution stitching. Panoramic content may include stitched spherical (360-degree) images and/or VR video. In some implementations, multi-resolution stitching functionality may be embodied in a spherical image capture device that may include two lenses configured to capture pairs of hemispherical images. The capture device may obtain images (e.g., representing left and right hemispheres) that may be characterized by 180-degree (or greater) field of view. Source images may be combined using multi-resolution stitching methodology. Source images may be transformed to obtain multiple image components characterized by two or more image resolutions. The stitched image may be encoded using selective encoding methodology including: partitioning source images into a low resolution/frequency and a high resolution/frequency components; stitching low resolution/frequency components using coarse stitching operation, stitching high resolution/high frequency components using a refined stitch operation; combining stitched LF components and stitched HF components.
-
公开(公告)号:US20190342476A1
公开(公告)日:2019-11-07
申请号:US16513954
申请日:2019-07-17
Applicant: GoPro, Inc.
Inventor: Adeel Abbas , Joshua P. Davies , William H. Tolbert
Abstract: Dual-lens assemblies and cameras including dual lens-assemblies that include a first lens barrel securing a first lens having a first optical axis and a second lens barrel securing a second lens having a second optical axis are disclosed. In one dual-lens assembly, the first optical axis is approximately parallel to and spaced from the second optical axis by a lateral offset, axial lengths of the first lens barrel and the second lens barrel are approximately equal, and the first lens and the second lens are oriented in opposite directions at opposing ends of the first lens barrel and the second lens barrel.
-
公开(公告)号:US20190289322A1
公开(公告)日:2019-09-19
申请号:US15462580
申请日:2017-03-17
Applicant: GOPRO, INC.
Inventor: Adeel Abbas , Sandeep Doshi , Sumit Chawla
IPC: H04N19/593 , H04N19/134 , H04N19/51 , H04N19/86 , H04N19/114 , H04N19/177 , H04N5/232
Abstract: Systems and methods for utilizing on-camera sensor information to improve video and/or image encoding quality are discussed herein. Specifically, the systems and methods described herein may utilize on-camera sensor information to adaptively adjust an intra frame insertion rate associated with a sequence of frames. The intra frame insertion rate associated with a sequence of frames may be adjusted based on the motion of the image capturing device while capturing the sequence of frames and a predefined motion threshold associated with the intra frame insertion rate of the sequence of frames. In some implementations, the intra frame insertion rate may be adjusted based on the activity being performed during the capture of the sequence of frames. As such, the encoding of one or more frames within a sequence of frames may be adaptively adjusted to better suit the scene depicted by the sequence of frames.
-
57.
公开(公告)号:US20190182462A1
公开(公告)日:2019-06-13
申请号:US16212408
申请日:2018-12-06
Applicant: GoPro, Inc.
Inventor: Adeel Abbas , David Newman
Abstract: Apparatus and methods for projection conversion decoding for applications eco-systems are disclosed. In one embodiment, a decoder apparatus is utilized to read formatting information from an intermediate projection format; convert the intermediate projection format to a display projection format; apply a rotation operation to the display projection format in accordance with the reading of the formatting information; and transmit the display projection format for use by an application. In some implementations, the intermediate projection format has been stabilized prior to encoding in order to improve upon the encoding efficiency for the intermediate projection format. The application of the rotation operation may then be utilized to reverse the stabilized imaging data. Methods and computing systems are also disclosed.
-
公开(公告)号:US10291910B2
公开(公告)日:2019-05-14
申请号:US15334213
申请日:2016-10-25
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Adeel Abbas , David Newman
IPC: H04N19/124 , H04N19/154 , H04N19/17 , H04N21/218 , H04N21/2343 , H04N21/81 , H04N19/167
Abstract: Systems and methods for providing video content using spatially adaptive video encoding. Panoramic and/or virtual reality content may be viewed by a client device using a viewport with viewing dimension(s) configured smaller than available dimension(s) of the content. Client device may include a portable media device characterized by given energy and/or computational resources. Video content may be encoded using spatially varying encoding. For image playback, portions of panoramic image may be pre-encoded using multiple quality bands. Pre-encoded image portions, matching the viewport, may be provided and reduce computational and/or energy load on the client device during consumption of panoramic content. Quality distribution may include gradual quality transition area allowing for small movements of the viewport without triggering image re-encoding. Larger movements of the viewport may automatically trigger transition to another spatial encoding distribution.
-
59.
公开(公告)号:US20190141322A1
公开(公告)日:2019-05-09
申请号:US16143224
申请日:2018-09-26
Applicant: GoPro, Inc.
Inventor: Adeel Abbas , David Newman
IPC: H04N19/119 , H04N19/172 , H04N19/14 , H04N19/124
Abstract: Apparatus and methods for providing block-based layouts for non-rectangular regions between non-contiguous imaging regions in projections such as, for example, Rotated Sphere Projections (RSP). In one embodiment, methods and apparatus for selecting coding unit block sizes for non-rectangular regions disposed between non-contiguous imaging portions is disclosed. The methods and apparatus may be configured to obtain a frame of captured imaging content, the frame of captured imaging content including the non-rectangular regions disposed between the non-contiguous imaging portions; select a plurality of differing coding block sizes for each of a plurality of regions located within the non-rectangular regions disposed between the non-contiguous imaging portions; determine which one of the plurality of differing coding block sizes optimizes an encoding efficiency for the obtained frame of captured imaging content; and encode the obtained frame of captured imaging content in accordance with the determined one off the plurality of differing coding block sizes.
-
60.
公开(公告)号:US10277886B2
公开(公告)日:2019-04-30
申请号:US15357968
申请日:2016-11-21
Applicant: GoPro, Inc.
Inventor: Timothy Macmillan , Adeel Abbas
IPC: G06T9/00 , G06T17/00 , H04N13/243 , H04N5/232 , H04N19/136 , H04N19/44 , G06K9/46 , G06K9/52 , G06K9/62 , G06T3/00 , G06T3/20 , G06T7/00 , G06T11/60 , G06T15/20 , H04N13/302 , H04N13/344 , H04N13/10 , H04N13/334 , H04N13/282 , G06T7/38 , G06T7/73 , G06T7/593 , G06T7/55 , H04N5/265 , H04N13/161
Abstract: A system receives an encoded image representative of the 2D projection of a cubic image, the encoded image generated from two overlapping hemispherical images separated along a longitudinal plane of a sphere. The system decodes the encoded image to produce a decoded 2D projection of the cubic image, and perform a stitching operation to portions of the decoded 2D projection representative of overlapping portions of the hemispherical images to produce stitched overlapping portions. The system combine the stitched overlapping portions with portions of the decoded 2D projection representative of the non-overlapping portions of the hemispherical images to produce a stitched 2D projection of the cubic image, and encode the stitched 2D projection of the cubic image to produce an encoded cubic projection of the stitched hemispherical images.
-
-
-
-
-
-
-
-
-