-
公开(公告)号:US11475538B2
公开(公告)日:2022-10-18
申请号:US17314217
申请日:2021-05-07
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Adeel Abbas
Abstract: Systems and methods for providing panoramic image and/or video content using multi-resolution stitching. Panoramic content may include stitched spherical (360-degree) images and/or VR video. In some implementations, multi-resolution stitching functionality may be embodied in a spherical image capture device that may include two lenses configured to capture pairs of hemispherical images. The capture device may obtain images (e.g., representing left and right hemispheres) that may be characterized by 180-degree (or greater) field of view. Source images may be combined using multi-resolution stitching methodology. Source images may be transformed to obtain multiple image components characterized by two or more image resolutions. The stitched image may be encoded using selective encoding methodology including: partitioning source images into a low resolution/frequency and a high resolution/frequency components; stitching low resolution/frequency components using coarse stitching operation, stitching high resolution/high frequency components using a refined stitch operation; combining stitched LF components and stitched HF components.
-
公开(公告)号:US11228749B2
公开(公告)日:2022-01-18
申请号:US16866447
申请日:2020-05-04
Applicant: GoPro, Inc.
Inventor: Adeel Abbas , Balineedu Chowdary Adsumilli , David Newman
IPC: H04N13/111 , H04N13/194 , H04N13/243 , H04N13/344 , H04N13/161 , H04N13/282 , H04N5/232 , H04N19/597 , H04N5/225
Abstract: Apparatus and methods for characterizing panoramic content, such as by a wide field of view and large image size. In one implementation, a panoramic image may be mapped to a cube or any other projection e.g icosahedron or octahedron. The disclosure exploits content continuity between facets, such as in the case of encoding/decoding cube-projected images. One facet may be encoded/decoded independently from other facets to obtain a seed facet. One or more transformed versions of the seed facet may be obtained; e.g., one corresponding to a 90° counterclockwise rotation, another to a 90° clockwise rotation, and one to an 180° rotation. Transformed versions may be used to form an augmented image. The remaining facets of the cube may be encoded using transformed versions within the augmented image. Continuity between transformed facets in the top row of the augmented image and facets in the middle row of the augmented image may be utilized for motion or intra prediction, and to obtain greater encoding performance compared to encoding facets independently.
-
93.
公开(公告)号:US11095833B2
公开(公告)日:2021-08-17
申请号:US16833185
申请日:2020-03-27
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Ryan Lustig
IPC: H04N5/272 , G06T15/50 , H04N13/128 , G06T11/60 , G06T7/11 , G06T7/143 , G06T7/194 , G06T7/174 , G06T7/254 , G06T5/00 , G06T7/20 , H04N5/235 , H04N13/00
Abstract: A processing device generates composite images from a sequence of images. The composite images may be used as frames of video. A foreground/background segmentation is performed at selected frames to extract a plurality of foreground object images depicting a foreground object at different locations as it moves across a scene. The foreground object images are stored to a foreground object list. The foreground object images in the foreground object list are overlaid onto subsequent video frames that follow the respective frames from which they were extracted, thereby generating a composite video.
-
94.
公开(公告)号:US20210042877A1
公开(公告)日:2021-02-11
申请号:US17079404
申请日:2020-10-23
Applicant: GoPro, Inc.
Inventor: David Newman , Balineedu Chowdary Adsumilli
Abstract: Systems and methods for modifying image distortion (curvature) for viewing distance in post capture. Presentation of imaging content on a content display device may be characterized by a presentation field of view (FOV). Presentation FOV may be configured based on screen dimensions of the display device and distance between the viewer and the screen. Imaging content may be obtained by an activity capture device characterized by a wide capture field of view lens (e.g., fish-eye). Images may be transformed into rectilinear representation for viewing. When viewing images using presentation FOV that may narrower than capture FOV, transformed rectilinear images may appear distorted. A transformation operation may be configured to account for presentation FOV—capture FOV mismatch. In some implementations, the transformation may include fish-eye to rectilinear transformation characterized by a transformation strength that may be configured based on a ratio of the presentation FOV to the capture FOV.
-
公开(公告)号:US10679676B2
公开(公告)日:2020-06-09
申请号:US16721561
申请日:2019-12-19
Applicant: GoPro, Inc.
Inventor: Scott Patrick Campbell , Zhinian Jing , Timothy Macmillan , David A. Newman , Balineedu Chowdary Adsumilli
Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.
-
公开(公告)号:US10652558B2
公开(公告)日:2020-05-12
申请号:US16234214
申请日:2018-12-27
Applicant: GoPro, Inc.
Inventor: Adeel Abbas , Balineedu Chowdary Adsumilli , David Newman
IPC: H04N19/30 , H04N19/187 , H04N19/167 , H04N19/29 , H04N19/146 , H04N19/59
Abstract: Apparatus and methods for digital video data compression via a scalable, multi-resolution approach. In one embodiment, the video content may be encoded using a multi-resolution and/or multi-quality scalable coding approach that reduces computational and/or energy load on a client device. In one implementation, a low fidelity image is obtained based on a first full resolution image. The low fidelity image may be encoded to obtain a low fidelity bitstream. A second full resolution image may be obtained based on the low fidelity bitstream. A portion of a difference image obtained based on the second full resolution image and the first full resolution may be encoded to obtain a high fidelity bitstream. The low fidelity bitstream and the high fidelity bitstream may be provided to e.g., a receiving device.
-
97.
公开(公告)号:US10609307B2
公开(公告)日:2020-03-31
申请号:US15080299
申请日:2016-03-24
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Ryan Lustig
IPC: H04N5/272 , G06T15/50 , H04N13/128 , G06T11/60 , G06T7/11 , G06T7/143 , G06T7/194 , G06T7/174 , G06T7/254 , G06T5/00 , G06T7/20 , H04N5/235 , H04N13/00
Abstract: A processing device generates composite images from a sequence of images. The composite images may be used as frames of video. A foreground/background segmentation is performed at selected frames to extract a plurality of foreground object images depicting a foreground object at different locations as it moves across a scene. The foreground object images are stored to a foreground object list. The foreground object images in the foreground object list are overlaid onto subsequent video frames that follow the respective frames from which they were extracted, thereby generating a composite video.
-
公开(公告)号:US20200084394A1
公开(公告)日:2020-03-12
申请号:US16687559
申请日:2019-11-18
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Adeel Abbas , David Newman
IPC: H04N5/247 , H04N5/232 , H04N19/124 , G06T3/20 , H04N19/17 , H04N19/167 , H04N19/36 , H04N19/85 , H04N19/597
Abstract: Systems and methods for providing imaging content using spatially varying encoding quality. Imaging content may be acquired using spherical lenses (e.g., fisheye). When viewing spherical imaging content, spherical to planar image transformations may be utilized. Such transformations (e.g., equirectangular) may be characterized by spatially varying image distortion. Transformed images may be encoded. Encoding process may be configured based on spatially varying encoding quality. Encoding quality may be configured based on the transformation such that portions of the transformed image characterized by greater distortion may be encoded using lower quality (e.g. greater QP values); portions of the transformed image characterized by lower distortion may be encoded using greater quality (e.g. lower QP values). Such encoding may produce a bitstream characterized by a lower bitrate for a given quality and/or better quality for a given bitrate as compared to an encoding process that may apply a uniform encoding quality.
-
公开(公告)号:US10573351B2
公开(公告)日:2020-02-25
申请号:US16456673
申请日:2019-06-28
Applicant: GoPro, Inc.
Inventor: Scott Patrick Campbell , Zhinian Jing , Timothy Macmillan , David A. Newman , Balineedu Chowdary Adsumilli
Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.
-
公开(公告)号:US10484621B2
公开(公告)日:2019-11-19
申请号:US15414403
申请日:2017-01-24
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Adeel Abbas , David Newman
IPC: H04N5/247 , G06T3/20 , H04N19/124 , H04N5/232 , H04N19/597 , H04N19/17 , H04N19/167 , H04N19/85 , H04N19/36 , G06T19/00
Abstract: Systems and methods for providing imaging content using spatially varying encoding quality. Imaging content may be acquired using spherical lenses (e.g., fisheye). When viewing spherical imaging content, spherical to planar image transformations may be utilized. Such transformations (e.g., equirectangular) may be characterized by spatially varying image distortion. Transformed images may be encoded. Encoding process may be configured based on spatially varying encoding quality. Encoding quality may be configured based on the transformation such that portions of the transformed image characterized by greater distortion may be encoded using lower quality (e.g. greater QP values); portions of the transformed image characterized by lower distortion may be encoded using greater quality (e.g. lower QP values). Such encoding may produce a bitstream characterized by a lower bitrate for a given quality and/or better quality for a given bitrate as compared to an encoding process that may apply a uniform encoding quality.
-
-
-
-
-
-
-
-
-