公开(公告)号：US09940697B2

公开(公告)日：2018-04-10

申请号：US15347610

申请日：2016-11-09

Applicant: GoPro, Inc.

Inventor： Balineedu Chowdary Adsumilli ,  Adeel Abbas ,  David Newman

IPC: G06T5/00 ,  G06T3/00 ,  G06T5/20 ,  G06T3/40

CPC classification number: G06T5/001 ,  G06T3/0087 ,  G06T3/0093 ,  G06T3/4038 ,  G06T5/006 ,  G06T5/20 ,  G06T5/50 ,  G06T2207/10012

Abstract: Systems and methods for capturing and/or processing of panoramic imaging content using spatial redundancy-based mapping. Panoramic imaging content may be processed using a processing pipeline that may operate on a portion of the image. Images may be transformed prior to processing. Image transformation may introduce distortion and/or data redundancy. Image partitioning for the pipeline processing may be configured based on spatial redundancy associated with the transformation. Windowing operation may include partitioning an image using non-rectangular and/or non-equal windows.

公开(公告)号：US09892760B1

公开(公告)日：2018-02-13

申请号：US15458794

申请日：2017-03-14

Applicant: GOPRO, INC.

Inventor： David Newman

IPC: H04N5/935 ,  H04N5/77 ,  G11B27/19 ,  H04N21/84 ,  H04N21/45 ,  H04N21/435

CPC classification number: G11B27/19 ,  G11B27/034 ,  G11B27/3027 ,  H04N5/77 ,  H04N5/772 ,  H04N9/8205 ,  H04N21/435 ,  H04N21/4524 ,  H04N21/84

Abstract: Apparatus and methods for combining metadata with video into a video stream using a 32-bit aligned payload, that is computer storage efficient and human discernable. The metadata is stored in a track in a self-describing structure. Metadata track may be decoded using an identifier reference table that is substantially smaller than typical fourCC identifier tables. The combined metadata/video stream is compatible with a standard video stream convention and may be played using conventional media player applications that reads media files compliant with MP4/MOV container format. The proposed format may enable decoding of metadata during streaming, partitioning of combined video stream without loss of metadata. The proposed format and/or metadata protocol provides for temporal synchronization of metadata with video frames.

公开(公告)号：US20170301065A1

公开(公告)日：2017-10-19

申请号：US15347610

申请日：2016-11-09

Applicant: GoPro, Inc.

Inventor： Balineedu Chowdary Adsumilli ,  Adeel Abbas ,  David Newman

IPC: G06T5/00 ,  G06T3/00 ,  G06T3/40 ,  G06T5/20

CPC classification number: G06T5/001 ,  G06T3/0087 ,  G06T3/0093 ,  G06T3/4038 ,  G06T5/006 ,  G06T5/20 ,  G06T5/50 ,  G06T2207/10012

Abstract: Systems and methods for capturing and/or processing of panoramic imaging content using spatial redundancy-based mapping. Panoramic imaging content may be processed using a processing pipeline that may operate on a portion of the image. Images may be transformed prior to processing. Image transformation may introduce distortion and/or data redundancy. Image partitioning for the pipeline processing may be configured based on spatial redundancy associated with the transformation. Windowing operation may include partitioning an image using non-rectangular and/or non-equal windows.

公开(公告)号：US20170295356A1

公开(公告)日：2017-10-12

申请号：US15259512

申请日：2016-09-08

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Balineedu Chowdary Adsumilli ,  David Newman

IPC: H04N13/00 ,  G06T3/40 ,  H04N19/52 ,  H04N13/02

CPC classification number: H04N13/161 ,  H04N5/2251 ,  H04N5/23238 ,  H04N13/111 ,  H04N13/194 ,  H04N13/243 ,  H04N13/282 ,  H04N13/344 ,  H04N19/597

Abstract: Apparatus and methods for characterizing panoramic content, such as by a wide field of view and large image size. In one implementation, a panoramic image may be mapped to a cube or any other projection e.g icosahedron or octahedron. The disclosure exploits content continuity between facets, such as in the case of encoding/decoding cube-projected images. One facet may be encoded/decoded independently from other facets to obtain a seed facet. One or more transformed versions of the seed facet may be obtained; e.g., one corresponding to a 90° counterclockwise rotation, another to a 90° clockwise rotation, and one to an 180° rotation. Transformed versions may be used to form an augmented image. The remaining facets of the cube may be encoded using transformed versions within the augmented image. Continuity between transformed facets in the top row of the augmented image and facets in the middle row of the augmented image may be utilized for motion or intra prediction, and to obtain greater encoding performance compared to encoding facets independently.

公开(公告)号：US20170251208A1

公开(公告)日：2017-08-31

申请号：US15414403

申请日：2017-01-24

Applicant: GoPro, Inc.

Inventor： Balineedu Chowdary Adsumilli ,  Adeel Abbas ,  David Newman

IPC: H04N19/103 ,  H04N5/247 ,  H04N5/232 ,  H04N19/127 ,  G06T3/20 ,  H04N19/124

Abstract: Systems and methods for providing imaging content using spatially varying encoding quality. Imaging content may be acquired using spherical lenses (e.g., fisheye). When viewing spherical imaging content, spherical to planar image transformations may be utilized. Such transformations (e.g., equirectangular) may be characterized by spatially varying image distortion. Transformed images may be encoded. Encoding process may be configured based on spatially varying encoding quality. Encoding quality may be configured based on the transformation such that portions of the transformed image characterized by greater distortion may be encoded using lower quality (e.g. greater QP values); portions of the transformed image characterized by lower distortion may be encoded using greater quality (e.g. lower QP values). Such encoding may produce a bitstream characterized by a lower bitrate for a given quality and/or better quality for a given bitrate as compared to an encoding process that may apply a uniform encoding quality.

公开(公告)号：US20170244945A1

公开(公告)日：2017-08-24

申请号：US15050275

申请日：2016-02-22

Applicant: GOPRO, INC.

Inventor： Joven Matias ,  David Newman ,  Ha Phan ,  Timothy Bucklin

IPC: H04N9/87 ,  H04N5/77 ,  G11B27/34 ,  H04N5/232

CPC classification number: G11B27/34 ,  H04N5/23238 ,  H04N5/23293 ,  H04N5/772

Abstract: Systems and methods for presenting and viewing a spherical video segment is provided. The spherical video segment including tag information associated with an event of interest may be obtained. The tag information may identify a point in time and a viewing angle at which the event of interest is viewable in the spherical video segment. An orientation of a two dimensional display may be determined based upon output signals of a sensor. A display field of view within the spherical video segment may be determined and presented on the display based upon the orientation of the display. The display field of view may be captured as a two dimensional video segment. If the viewing angle of the event of interest is outside the display field of view proximate the point in time, a notification may be presented within the display field of view.

公开(公告)号：US20170223368A1

公开(公告)日：2017-08-03

申请号：US15250748

申请日：2016-08-29

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Balineedu Chowdary Adsumilli ,  David Newman

IPC: H04N19/30 ,  H04N19/59 ,  H04N19/146

CPC classification number: H04N19/30 ,  H04N19/146 ,  H04N19/167 ,  H04N19/187 ,  H04N19/29 ,  H04N19/59

Abstract: Apparatus and methods for digital video data compression via a scalable, multi-resolution approach. In one embodiment, the video content may be encoded using a multi-resolution and/or multi-quality scalable coding approach that reduces computational and/or energy load on a client device. In one implementation, a low fidelity image is obtained based on a first full resolution image. The low fidelity image may be encoded to obtain a low fidelity bitstream. A second full resolution image may be obtained based on the low fidelity bitstream. A portion of a difference image obtained based on the second full resolution image and the first full resolution may be encoded to obtain a high fidelity bitstream. The low fidelity bitstream and the high fidelity bitstream may be provided to e.g., a receiving device.

公开(公告)号：US12262119B2

公开(公告)日：2025-03-25

申请号：US18594896

申请日：2024-03-04

Applicant: GoPro, Inc.

Inventor： David Newman

IPC: H04N23/68 ,  G06T3/4038 ,  H04N19/15

Abstract: Apparatus and methods for the pre-processing of image data so as to enhance quality of subsequent encoding and rendering. In one embodiment, a capture device is disclosed that includes a processing apparatus and a non-transitory computer readable apparatus comprising a storage medium have one or more instructions stored thereon. The one or more instructions, when executed by the processing apparatus, are configured to: receive captured image data (such as that sourced from two or more separate image sensors) and pre-process the data to enable stabilization of the corresponding images prior to encoding. In some implementations, the pre-processing includes combination (e.g., stitching) of the captured image data associated with the two or more sensors to facilitates the stabilization. Advantageously, undesirable artifacts such as object “jitter” can be reduced or eliminated. Methods and non-transitory computer readable apparatus are also disclosed.

公开(公告)号：US12159379B1

公开(公告)日：2024-12-03

申请号：US17872772

申请日：2022-07-25

Applicant: GoPro, Inc.

Inventor： David Newman ,  Robert McIntosh

IPC: G06T5/70 ,  G06T5/50 ,  H04N23/68 ,  H04N23/951

Abstract: Video frames are captured by an image capture device and stabilized to generate stabilized video frames. Multiple stabilized video frames are combined into single motion blurred video frames. Combination of multiple stabilized video frames into single motion blurred video frames produces motion blur within the single motion blurred video frames that is both physical and real.

公开(公告)号：US20230410251A1

公开(公告)日：2023-12-21

申请号：US18458939

申请日：2023-08-30

Applicant: GoPro, Inc.

Inventor： Daryl Stimm ,  David Newman ,  Kyler William Schwartz ,  William Edward MacDonald

IPC: G06T3/40 ,  G06T7/13 ,  G06T3/00 ,  H04N7/08 ,  H04N23/698

CPC classification number: G06T3/4038 ,  G06T7/13 ,  G06T3/0062 ,  G06T3/0093 ,  H04N7/08 ,  H04N23/698

Abstract: Apparatus and methods for optimized stitching of overcapture content. In one embodiment, the optimized stitching of the overcapture content includes capturing the overcapture content; producing overlap bands associated with the captured overcapture content; downsampling the produced overlap bands; generating derivative images from the downsampled overlap bands; generating a cost map associated with the generated derivative images; determining shortest path information for the generated cost map; generating a warp file based on the determined shortest path information, the generated warp file being utilized for the optimized stitching of the overcapture content. Camera apparatus and a non-transitory computer-readable apparatus are also disclosed.