公开(公告)号：US20180082404A1

公开(公告)日：2018-03-22

申请号：US15270971

申请日：2016-09-20

Applicant: GoPro, Inc.

Inventor： Balineedu Chowdary Adsumilli ,  Ryan Lustig ,  Aaron Staranowicz

IPC: G06T5/00 ,  G06T3/40

CPC classification number: G06T5/002 ,  G06T3/4007 ,  G06T5/003 ,  G06T7/248 ,  G06T2207/10016 ,  G06T2207/10024

Abstract: Apparatus and methods for video image post-processing for segmentation based interpolation. In one embodiment, a computerized apparatus is utilized in order to obtain a first frame of video data; segment one or more objects within the first frame of video data; obtain a second frame of video data; segment one or more objects within the second frame of video data; match at least a portion of the one or more objects within the first frame of video data with the one or more objects within the second frame of video data; compute the motion of the pixels for the matched portion of the one or more objects; compute the motion of pixels associated with a background image; and generate an interpolated frame of video data, the interpolated frame of video data residing temporally between the first frame of video data and the second frame of video data.

公开(公告)号：US09886961B2

公开(公告)日：2018-02-06

申请号：US14598134

申请日：2015-01-15

Applicant: GoPro, Inc.

Inventor： Balineedu Chowdary Adsumilli

IPC: G10L19/018 ,  H04N19/467 ,  H04N19/48 ,  H04N1/32 ,  G06T1/00

CPC classification number: G10L19/018 ,  G06T1/0028 ,  G06T1/005 ,  G06T2201/0052 ,  G06T2201/0202 ,  H04N1/32187 ,  H04N1/32203 ,  H04N1/32277 ,  H04N19/467 ,  H04N19/48

Abstract: Watermark data is converted to watermark coefficients, which may be embedded in an image by converting the image to a frequency domain, embedding the watermark in image coefficients corresponding to medium-frequency components, and converting the modified coefficients to the spatial domain. The watermark data is extracted from the modified image by converting the modified image to a frequency domain, extracting the watermark coefficients from the image coefficients, and determining the watermark data from the watermark coefficients. The watermark data may be truncated image data bits such as truncated least significant data bits. After extraction from the watermark, the truncated image data bits may be combined with data bits representing the original image to increase the bit depth of the image. Watermark data may include audio data portions corresponding to a video frame, reference frames temporally proximate to a video frame, high-frequency content, sensor calibration information, or other image data.

公开(公告)号：US20180025524A1

公开(公告)日：2018-01-25

申请号：US15724532

申请日：2017-10-04

Applicant: GoPro, Inc.

Inventor： Balineedu Chowdary Adsumilli ,  Timothy MacMillan

IPC: G06T11/60 ,  G06T3/40 ,  G06T7/50 ,  G06T7/73

CPC classification number: G06T11/60 ,  G06T3/4038 ,  G06T7/50 ,  G06T7/73 ,  G06T2207/20021 ,  G06T2207/20221 ,  G06T2207/30244

Abstract: A unified image processing algorithm results in better post-processing quality for combined images that are made up of multiple single-capture images. To ensure that each single-capture image is processed in the context of the entire combined image, the combined image is analyzed to determine portions of the image (referred to as “zones”) that should be processed with the same parameters for various image processing algorithms. These zones may be determined based on the content of the combined image. Alternatively, these zones may be determined based on the position of each single-capture image with respect to the entire combined image or the other single-capture images. Once zones and their corresponding image processing parameters are determined for the combined image, they are translated to corresponding zones each of the single-capture images. Finally, the image processing algorithms are applied to each of the single-capture images using the zone-specified parameters.

公开(公告)号：US20170366814A1

公开(公告)日：2017-12-21

申请号：US15432700

申请日：2017-02-14

Applicant: GoPro, Inc.

Inventor： Balineedu Chowdary Adsumilli ,  Adeel Abbas ,  Sumit Chawla

IPC: H04N19/154 ,  H04N19/86 ,  H04N19/172 ,  H04N5/232 ,  H04N19/147

CPC classification number: H04N5/23238 ,  H04N13/178 ,  H04N13/243 ,  H04N13/296 ,  H04N19/115 ,  H04N19/117 ,  H04N19/122 ,  H04N19/126 ,  H04N19/167 ,  H04N19/57 ,  H04N19/597

Abstract: Methods and apparatus for encoding and decoding image data based on one or more parameters. In one embodiment, various spatial portions or regions of image data (e.g., a still or moving image) are weighted according to the perceived or measured quality. Processing for these weighted regions can be selectively altered or adjusted so as to optimize one or more operational parameters including for example processing and/or memory requirements, or speed.

公开(公告)号：US20170366755A1

公开(公告)日：2017-12-21

申请号：US15249347

申请日：2016-08-26

Applicant: GoPro, Inc.

Inventor： Ryan Lustig ,  Balineedu Chowdary Adsumilli

IPC: H04N5/232

CPC classification number: H04N5/23258 ,  H04N5/23267 ,  H04N5/2328

Abstract: A target image captured from a fisheye lens or other lens with known distortion parameters may be transformed to align it to a reference image. Corresponding features may be detected in the target image and the reference image. The features may be transformed to a spherical coordinate space. In the spherical space, images may be re-pointed or rotated in three dimensions to align all or a subset of the features of the target image to the corresponding features of the reference image. For example, in a sequence of images, background features of the target image in the spherical image space may be aligned to background features of the reference image in the spherical image space to compensate for camera motion while preserving foreground motion. An inverse transformation may then be applied to bring the images back into the original image space.

公开(公告)号：US20170357880A1

公开(公告)日：2017-12-14

申请号：US15177310

申请日：2016-06-08

Applicant: GoPro, Inc.

Inventor： Balineedu Chowdary Adsumilli ,  Ryan Lustig

IPC: G06K9/62 ,  G06N99/00 ,  G06K9/00

CPC classification number: G06K9/6262 ,  G06K9/00228 ,  G06K9/00744 ,  G06K9/6227 ,  G06K9/6229 ,  G06K9/6256 ,  G06N3/126 ,  G06N99/005

Abstract: An algorithm for performing an image or video processing task is generated that may be used to combine a plurality of different independent solutions to the image or video processing task in an optimized manner. A plurality of base algorithms may be applied to a training set of images or video and a first generation of different combining algorithms may be applied to combine the respective solutions from each of the respective base algorithms into respective combined solutions. The respective combined solutions may be evaluated to generate respective fitness scores representing measures of how well the plurality of different combining algorithms each perform the image or video processing task. The algorithms may be iteratively updated to generate an optimized combining algorithm that may be applied to an input image or video.

公开(公告)号：US20170301065A1

公开(公告)日：2017-10-19

申请号：US15347610

申请日：2016-11-09

Applicant: GoPro, Inc.

Inventor： Balineedu Chowdary Adsumilli ,  Adeel Abbas ,  David Newman

IPC: G06T5/00 ,  G06T3/00 ,  G06T3/40 ,  G06T5/20

CPC classification number: G06T5/001 ,  G06T3/0087 ,  G06T3/0093 ,  G06T3/4038 ,  G06T5/006 ,  G06T5/20 ,  G06T5/50 ,  G06T2207/10012

Abstract: Systems and methods for capturing and/or processing of panoramic imaging content using spatial redundancy-based mapping. Panoramic imaging content may be processed using a processing pipeline that may operate on a portion of the image. Images may be transformed prior to processing. Image transformation may introduce distortion and/or data redundancy. Image partitioning for the pipeline processing may be configured based on spatial redundancy associated with the transformation. Windowing operation may include partitioning an image using non-rectangular and/or non-equal windows.

公开(公告)号：US20170295356A1

公开(公告)日：2017-10-12

申请号：US15259512

申请日：2016-09-08

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Balineedu Chowdary Adsumilli ,  David Newman

IPC: H04N13/00 ,  G06T3/40 ,  H04N19/52 ,  H04N13/02

CPC classification number: H04N13/161 ,  H04N5/2251 ,  H04N5/23238 ,  H04N13/111 ,  H04N13/194 ,  H04N13/243 ,  H04N13/282 ,  H04N13/344 ,  H04N19/597

Abstract: Apparatus and methods for characterizing panoramic content, such as by a wide field of view and large image size. In one implementation, a panoramic image may be mapped to a cube or any other projection e.g icosahedron or octahedron. The disclosure exploits content continuity between facets, such as in the case of encoding/decoding cube-projected images. One facet may be encoded/decoded independently from other facets to obtain a seed facet. One or more transformed versions of the seed facet may be obtained; e.g., one corresponding to a 90° counterclockwise rotation, another to a 90° clockwise rotation, and one to an 180° rotation. Transformed versions may be used to form an augmented image. The remaining facets of the cube may be encoded using transformed versions within the augmented image. Continuity between transformed facets in the top row of the augmented image and facets in the middle row of the augmented image may be utilized for motion or intra prediction, and to obtain greater encoding performance compared to encoding facets independently.

公开(公告)号：US20170251208A1

公开(公告)日：2017-08-31

申请号：US15414403

申请日：2017-01-24

Applicant: GoPro, Inc.

Inventor： Balineedu Chowdary Adsumilli ,  Adeel Abbas ,  David Newman

IPC: H04N19/103 ,  H04N5/247 ,  H04N5/232 ,  H04N19/127 ,  G06T3/20 ,  H04N19/124

Abstract: Systems and methods for providing imaging content using spatially varying encoding quality. Imaging content may be acquired using spherical lenses (e.g., fisheye). When viewing spherical imaging content, spherical to planar image transformations may be utilized. Such transformations (e.g., equirectangular) may be characterized by spatially varying image distortion. Transformed images may be encoded. Encoding process may be configured based on spatially varying encoding quality. Encoding quality may be configured based on the transformation such that portions of the transformed image characterized by greater distortion may be encoded using lower quality (e.g. greater QP values); portions of the transformed image characterized by lower distortion may be encoded using greater quality (e.g. lower QP values). Such encoding may produce a bitstream characterized by a lower bitrate for a given quality and/or better quality for a given bitrate as compared to an encoding process that may apply a uniform encoding quality.

公开(公告)号：US20170223368A1

公开(公告)日：2017-08-03

申请号：US15250748

申请日：2016-08-29

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Balineedu Chowdary Adsumilli ,  David Newman

IPC: H04N19/30 ,  H04N19/59 ,  H04N19/146

CPC classification number: H04N19/30 ,  H04N19/146 ,  H04N19/167 ,  H04N19/187 ,  H04N19/29 ,  H04N19/59

Abstract: Apparatus and methods for digital video data compression via a scalable, multi-resolution approach. In one embodiment, the video content may be encoded using a multi-resolution and/or multi-quality scalable coding approach that reduces computational and/or energy load on a client device. In one implementation, a low fidelity image is obtained based on a first full resolution image. The low fidelity image may be encoded to obtain a low fidelity bitstream. A second full resolution image may be obtained based on the low fidelity bitstream. A portion of a difference image obtained based on the second full resolution image and the first full resolution may be encoded to obtain a high fidelity bitstream. The low fidelity bitstream and the high fidelity bitstream may be provided to e.g., a receiving device.