-
公开(公告)号:US20200336725A1
公开(公告)日:2020-10-22
申请号:US16866447
申请日:2020-05-04
Applicant: GoPro, Inc.
Inventor: Adeel Abbas , Balineedu Chowdary Adsumilli , David Newman
IPC: H04N13/161 , H04N13/111 , H04N13/194 , H04N13/243 , H04N13/282 , H04N5/232 , H04N5/225 , H04N19/597 , H04N13/344
Abstract: Apparatus and methods for characterizing panoramic content, such as by a wide field of view and large image size. In one implementation, a panoramic image may be mapped to a cube or any other projection e.g icosahedron or octahedron. The disclosure exploits content continuity between facets, such as in the case of encoding/decoding cube-projected images. One facet may be encoded/decoded independently from other facets to obtain a seed facet. One or more transformed versions of the seed facet may be obtained; e.g., one corresponding to a 90° counterclockwise rotation, another to a 90° clockwise rotation, and one to an 180° rotation. Transformed versions may be used to form an augmented image. The remaining facets of the cube may be encoded using transformed versions within the augmented image. Continuity between transformed facets in the top row of the augmented image and facets in the middle row of the augmented image may be utilized for motion or intra prediction, and to obtain greater encoding performance compared to encoding facets independently.
-
132.
公开(公告)号:US20200228730A1
公开(公告)日:2020-07-16
申请号:US16833185
申请日:2020-03-27
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Ryan Lustig
IPC: H04N5/272 , G06T15/50 , H04N13/128 , G06T11/60 , G06T7/11 , G06T7/143 , G06T7/194 , G06T7/174 , G06T7/254 , G06T5/00 , G06T7/20 , H04N5/235
Abstract: A processing device generates composite images from a sequence of images. The composite images may be used as frames of video. A foreground/background segmentation is performed at selected frames to extract a plurality of foreground object images depicting a foreground object at different locations as it moves across a scene. The foreground object images are stored to a foreground object list. The foreground object images in the foreground object list are overlaid onto subsequent video frames that follow the respective frames from which they were extracted, thereby generating a composite video.
-
公开(公告)号:US20200135238A1
公开(公告)日:2020-04-30
申请号:US16721561
申请日:2019-12-19
Applicant: GoPro, Inc.
Inventor: Scott Patrick Campbell , Zhinian Jing , Timothy Macmillan , David A. Newman , Balineedu Chowdary Adsumilli
Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.
-
公开(公告)号:US20200077022A1
公开(公告)日:2020-03-05
申请号:US16538641
申请日:2019-08-12
Applicant: GoPro, Inc.
Inventor: Ryan Lustig , Balineedu Chowdary Adsumilli
IPC: H04N5/232
Abstract: A target image captured from a fisheye lens or other lens with known distortion parameters may be transformed to align it to a reference image. Corresponding features may be detected in the target image and the reference image. The features may be transformed to a spherical coordinate space. In the spherical space, images may be re-pointed or rotated in three dimensions to align all or a subset of the features of the target image to the corresponding features of the reference image. For example, in a sequence of images, background features of the target image in the spherical image space may be aligned to background features of the reference image in the spherical image space to compensate for camera motion while preserving foreground motion. An inverse transformation may then be applied to bring the images back into the original image space.
-
公开(公告)号:US10212438B2
公开(公告)日:2019-02-19
申请号:US15799837
申请日:2017-10-31
Applicant: GoPro, Inc.
Inventor: Adeel Abbas , Balineedu Chowdary Adsumilli , David Newman
IPC: H04N19/30 , H04N19/146 , H04N19/59 , H04N19/187 , H04N19/167 , H04N19/29
Abstract: Apparatus and methods for digital video data compression via a scalable, multi-resolution approach. In one embodiment, the video content may be encoded using a multi-resolution and/or multi-quality scalable coding approach that reduces computational and/or energy load on a client device. In one implementation, a low fidelity image is obtained based on a first full resolution image. The low fidelity image may be encoded to obtain a low fidelity bitstream. A second full resolution image may be obtained based on the low fidelity bitstream. A portion of a difference image obtained based on the second full resolution image and the first full resolution may be encoded to obtain a high fidelity bitstream. The low fidelity bitstream and the high fidelity bitstream may be provided to e.g., a receiving device.
-
公开(公告)号:US20180316861A1
公开(公告)日:2018-11-01
申请号:US15967364
申请日:2018-04-30
Applicant: GoPro, Inc.
Inventor: Ryan Lustig , Balineedu Chowdary Adsumilli
IPC: H04N5/232
CPC classification number: H04N5/23258 , H04N5/23267 , H04N5/2328
Abstract: A target image captured from a fisheye lens or other lens with known distortion parameters may be transformed to align it to a reference image. Corresponding features may be detected in the target image and the reference image. The features may be transformed to a spherical coordinate space. In the spherical space, images may be re-pointed or rotated in three dimensions to align all or a subset of the features of the target image to the corresponding features of the reference image. For example, in a sequence of images, background features of the target image in the spherical image space may be aligned to background features of the reference image in the spherical image space to compensate for camera motion while preserving foreground motion. An inverse transformation may then be applied to bring the images back into the original image space.
-
公开(公告)号:US10056115B2
公开(公告)日:2018-08-21
申请号:US15396385
申请日:2016-12-30
Applicant: GoPro, Inc.
Inventor: Scott Patrick Campbell , Zhinian Jing , Timothy Macmillan , David A. Newman , Balineedu Chowdary Adsumilli
CPC classification number: G11B27/3081 , H04N5/23238 , H04N5/77 , H04N9/806 , H04N9/8205 , H04N9/8211
Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.
-
公开(公告)号:US10044944B2
公开(公告)日:2018-08-07
申请号:US15080286
申请日:2016-03-24
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Ryan Lustig
IPC: H04N5/272 , G06T7/20 , H04N13/00 , H04N5/235 , G06T5/00 , G06T7/00 , G06T15/50 , G06T11/60 , G06T7/11 , G06T7/143 , G06T7/194 , G06T7/174 , G06T7/254
Abstract: A processing device generates composite images from a sequence of images. The composite images may be used as frames of video. A foreground/background segmentation is performed at selected frames to extract a plurality of foreground object images depicting a foreground object at different locations as it moves across a scene. The foreground object images are stored to a foreground object list. The foreground object images in the foreground object list are overlaid onto subsequent video frames that follow the respective frames from which they were extracted, thereby generating a composite video.
-
公开(公告)号:US10015469B2
公开(公告)日:2018-07-03
申请号:US14875690
申请日:2015-10-05
Applicant: GoPro, Inc.
Inventor: Scott Patrick Campbell , Balineedu Chowdary Adsumilli
CPC classification number: H04N13/204 , G06T5/002 , G06T7/571 , G06T7/593 , G06T2200/04 , G06T2207/10028 , G06T2207/10148 , H04N5/262 , H04N5/2621 , H04N13/122 , H04N13/271 , H04N2013/0081 , H04N2013/0088 , H04N2013/0096
Abstract: Blurring is simulated in post-processing for captured images. A 3D image is received from a 3D camera, and depth information in the 3D image is used to determine the relative distances of objects in the image. One object is chosen as the subject of the image, and an additional object in the image is identified. Image blur is applied to the identified additional object based on the distance between the 3D camera and the subject object, the distance between the subject object and the additional object, and a virtual focal length and virtual f-number.
-
公开(公告)号:US09965883B2
公开(公告)日:2018-05-08
申请号:US15724532
申请日:2017-10-04
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Timothy MacMillan
CPC classification number: G06T11/60 , G06T3/4038 , G06T7/50 , G06T7/73 , G06T2207/20021 , G06T2207/20221 , G06T2207/30244
Abstract: A unified image processing algorithm results in better post-processing quality for combined images that are made up of multiple single-capture images. To ensure that each single-capture image is processed in the context of the entire combined image, the combined image is analyzed to determine portions of the image (referred to as “zones”) that should be processed with the same parameters for various image processing algorithms. These zones may be determined based on the content of the combined image. Alternatively, these zones may be determined based on the position of each single-capture image with respect to the entire combined image or the other single-capture images. Once zones and their corresponding image processing parameters are determined for the combined image, they are translated to corresponding zones each of the single-capture images. Finally, the image processing algorithms are applied to each of the single-capture images using the zone-specified parameters.
-
-
-
-
-
-
-
-
-