Methods and apparatus for providing rotated spherical viewpoints

    公开(公告)号:US10650592B2

    公开(公告)日:2020-05-12

    申请号:US16234346

    申请日:2018-12-27

    Applicant: GoPro, Inc.

    Inventor: Adeel Abbas

    Abstract: Apparatus and methods for providing a rotated spherical viewpoint (RSV). In one or more embodiments, the RSV is implemented using equirectangular projections (ERPs). The RSV methodologies described herein are particularly suitable for panning within virtual reality (VR) or 360° panoramic content as there is minimal, if any, geometric distortions at the edge of a given viewport. Moreover, the RSV methodologies described herein may reduce the bandwidth requirements of, for example, devices operating in a client-server architecture. Additionally, the computation requirements for providing RSV are minimal and can be provided using relatively simple rotation transforms.

    Camera and lens assembly
    53.
    发明授权

    公开(公告)号:US10574871B2

    公开(公告)日:2020-02-25

    申请号:US16513954

    申请日:2019-07-17

    Applicant: GoPro, Inc.

    Abstract: Dual-lens assemblies and cameras including dual lens-assemblies that include a first lens barrel securing a first lens having a first optical axis and a second lens barrel securing a second lens having a second optical axis are disclosed. In one dual-lens assembly, the first optical axis is approximately parallel to and spaced from the second optical axis by a lateral offset, axial lengths of the first lens barrel and the second lens barrel are approximately equal, and the first lens and the second lens are oriented in opposite directions at opposing ends of the first lens barrel and the second lens barrel.

    Systems and methods for multi-resolution image stitching

    公开(公告)号:US10482574B2

    公开(公告)日:2019-11-19

    申请号:US15643123

    申请日:2017-07-06

    Applicant: GoPro, Inc.

    Abstract: Systems and methods for providing panoramic image and/or video content using multi-resolution stitching. Panoramic content may include stitched spherical (360-degree) images and/or VR video. In some implementations, multi-resolution stitching functionality may be embodied in a spherical image capture device that may include two lenses configured to capture pairs of hemispherical images. The capture device may obtain images (e.g., representing left and right hemispheres) that may be characterized by 180-degree (or greater) field of view. Source images may be combined using multi-resolution stitching methodology. Source images may be transformed to obtain multiple image components characterized by two or more image resolutions. The stitched image may be encoded using selective encoding methodology including: partitioning source images into a low resolution/frequency and a high resolution/frequency components; stitching low resolution/frequency components using coarse stitching operation, stitching high resolution/high frequency components using a refined stitch operation; combining stitched LF components and stitched HF components.

    CAMERA AND LENS ASSEMBLY
    55.
    发明申请

    公开(公告)号:US20190342476A1

    公开(公告)日:2019-11-07

    申请号:US16513954

    申请日:2019-07-17

    Applicant: GoPro, Inc.

    Abstract: Dual-lens assemblies and cameras including dual lens-assemblies that include a first lens barrel securing a first lens having a first optical axis and a second lens barrel securing a second lens having a second optical axis are disclosed. In one dual-lens assembly, the first optical axis is approximately parallel to and spaced from the second optical axis by a lateral offset, axial lengths of the first lens barrel and the second lens barrel are approximately equal, and the first lens and the second lens are oriented in opposite directions at opposing ends of the first lens barrel and the second lens barrel.

    VIDEO ENCODING QUALITY THROUGH THE USE OF ONCAMERA SENSOR INFORMATION

    公开(公告)号:US20190289322A1

    公开(公告)日:2019-09-19

    申请号:US15462580

    申请日:2017-03-17

    Applicant: GOPRO, INC.

    Abstract: Systems and methods for utilizing on-camera sensor information to improve video and/or image encoding quality are discussed herein. Specifically, the systems and methods described herein may utilize on-camera sensor information to adaptively adjust an intra frame insertion rate associated with a sequence of frames. The intra frame insertion rate associated with a sequence of frames may be adjusted based on the motion of the image capturing device while capturing the sequence of frames and a predefined motion threshold associated with the intra frame insertion rate of the sequence of frames. In some implementations, the intra frame insertion rate may be adjusted based on the activity being performed during the capture of the sequence of frames. As such, the encoding of one or more frames within a sequence of frames may be adaptively adjusted to better suit the scene depicted by the sequence of frames.

    METHODS AND APPARATUS FOR PROJECTION CONVERSION DECODING FOR APPLICATIONS ECO-SYSTEMS

    公开(公告)号:US20190182462A1

    公开(公告)日:2019-06-13

    申请号:US16212408

    申请日:2018-12-06

    Applicant: GoPro, Inc.

    Abstract: Apparatus and methods for projection conversion decoding for applications eco-systems are disclosed. In one embodiment, a decoder apparatus is utilized to read formatting information from an intermediate projection format; convert the intermediate projection format to a display projection format; apply a rotation operation to the display projection format in accordance with the reading of the formatting information; and transmit the display projection format for use by an application. In some implementations, the intermediate projection format has been stabilized prior to encoding in order to improve upon the encoding efficiency for the intermediate projection format. The application of the rotation operation may then be utilized to reverse the stabilized imaging data. Methods and computing systems are also disclosed.

    Systems and methods for spatially adaptive video encoding

    公开(公告)号:US10291910B2

    公开(公告)日:2019-05-14

    申请号:US15334213

    申请日:2016-10-25

    Applicant: GoPro, Inc.

    Abstract: Systems and methods for providing video content using spatially adaptive video encoding. Panoramic and/or virtual reality content may be viewed by a client device using a viewport with viewing dimension(s) configured smaller than available dimension(s) of the content. Client device may include a portable media device characterized by given energy and/or computational resources. Video content may be encoded using spatially varying encoding. For image playback, portions of panoramic image may be pre-encoded using multiple quality bands. Pre-encoded image portions, matching the viewport, may be provided and reduce computational and/or energy load on the client device during consumption of panoramic content. Quality distribution may include gradual quality transition area allowing for small movements of the viewport without triggering image re-encoding. Larger movements of the viewport may automatically trigger transition to another spatial encoding distribution.

    METHODS AND APPARATUS FOR BLOCK-BASED LAYOUT FOR NON-RECTANGULAR REGIONS BETWEEN NON-CONTIGUOUS IMAGING REGIONS

    公开(公告)号:US20190141322A1

    公开(公告)日:2019-05-09

    申请号:US16143224

    申请日:2018-09-26

    Applicant: GoPro, Inc.

    Abstract: Apparatus and methods for providing block-based layouts for non-rectangular regions between non-contiguous imaging regions in projections such as, for example, Rotated Sphere Projections (RSP). In one embodiment, methods and apparatus for selecting coding unit block sizes for non-rectangular regions disposed between non-contiguous imaging portions is disclosed. The methods and apparatus may be configured to obtain a frame of captured imaging content, the frame of captured imaging content including the non-rectangular regions disposed between the non-contiguous imaging portions; select a plurality of differing coding block sizes for each of a plurality of regions located within the non-rectangular regions disposed between the non-contiguous imaging portions; determine which one of the plurality of differing coding block sizes optimizes an encoding efficiency for the obtained frame of captured imaging content; and encode the obtained frame of captured imaging content in accordance with the determined one off the plurality of differing coding block sizes.

Patent Agency Ranking