-
公开(公告)号:US20200059649A1
公开(公告)日:2020-02-20
申请号:US16666094
申请日:2019-10-28
Applicant: GoPro, Inc.
Inventor: Adeel Abbas , Balineedu Chowdary Adsumilli , Vadim Polonichko
IPC: H04N19/137 , H04N5/232 , H04N19/167 , H04N19/597 , H04N19/107 , H04N13/00 , H04N5/225
Abstract: Systems and methods for providing panoramic image and/or video content using spatially selective encoding and/or decoding. Panoramic content may include stitched spherical (360-degree) images and/or VR video. In some implementations, selective encoding functionality may be embodied in a spherical image capture device that may include two lenses configured to capture pairs of hemispherical images. Encoded source images may be decoded and stitched in order to obtain a combined image characterized by a greater field of view as compared to source images. The stitched image may be encoded using a selective encoding methodology including: partitioning a stitched image into multiple portions, determining if a portion is to be re-encoded. If the image portion is to be re-encoded, re-encoding the image portion. If an image portion is not to be re-encoded, copying previously encoded image portion in lieu of encoding.
-
公开(公告)号:US20190335177A1
公开(公告)日:2019-10-31
申请号:US16410919
申请日:2019-05-13
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Adeel Abbas , David Newman
IPC: H04N19/124 , H04N19/167 , H04N21/81 , H04N21/2343 , H04N19/154 , H04N21/218 , H04N19/17
Abstract: Systems and methods for providing video content using spatially adaptive video encoding. Panoramic and/or virtual reality content may be viewed by a client device using a viewport with viewing dimension(s) configured smaller than available dimension(s) of the content. Client device may include a portable media device characterized by given energy and/or computational resources. Video content may be encoded using spatially varying encoding. For image playback, portions of panoramic image may be pre-encoded using multiple quality bands. Pre-encoded image portions, matching the viewport, may be provided and reduce computational and/or energy load on the client device during consumption of panoramic content. Quality distribution may include gradual quality transition area allowing for small movements of the viewport without triggering image re-encoding. Larger movements of the viewport may automatically trigger transition to another spatial encoding distribution.
-
33.
公开(公告)号:US20190289208A1
公开(公告)日:2019-09-19
申请号:US16363668
申请日:2019-03-25
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Adeel Abbas , Sumit Chawla
IPC: H04N5/232 , H04N13/178 , H04N13/296 , H04N13/243 , H04N13/344 , H04N19/57 , H04N19/597 , H04N19/126 , H04N19/117 , H04N19/115 , H04N19/122 , H04N19/167
Abstract: Methods and apparatus for encoding and decoding image data based on one or more parameters. In one embodiment, various spatial portions or regions of image data (e.g., a still or moving image) are weighted according to the perceived or measured quality. Processing for these weighted regions can be selectively altered or adjusted so as to optimize one or more operational parameters including for example processing and/or memory requirements, or speed.
-
公开(公告)号:US10382683B2
公开(公告)日:2019-08-13
申请号:US15967364
申请日:2018-04-30
Applicant: GoPro, Inc.
Inventor: Ryan Lustig , Balineedu Chowdary Adsumilli
IPC: H04N5/232
Abstract: A target image captured from a fisheye lens or other lens with known distortion parameters may be transformed to align it to a reference image. Corresponding features may be detected in the target image and the reference image. The features may be transformed to a spherical coordinate space. In the spherical space, images may be re-pointed or rotated in three dimensions to align all or a subset of the features of the target image to the corresponding features of the reference image. For example, in a sequence of images, background features of the target image in the spherical image space may be aligned to background features of the reference image in the spherical image space to compensate for camera motion while preserving foreground motion. An inverse transformation may then be applied to bring the images back into the original image space.
-
公开(公告)号:US20180322369A1
公开(公告)日:2018-11-08
申请号:US15973184
申请日:2018-05-07
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Ryan Lustig
CPC classification number: G06K9/6262 , G06K9/00228 , G06K9/00744 , G06K9/6227 , G06K9/6229 , G06K9/6256 , G06N3/126 , G06N7/005 , G06N20/00
Abstract: An algorithm for performing an image or video processing task is generated that may be used to combine a plurality of different independent solutions to the image or video processing task in an optimized manner. A plurality of base algorithms may be applied to a training set of images or video and a first generation of different combining algorithms may be applied to combine the respective solutions from each of the respective base algorithms into respective combined solutions. The respective combined solutions may be evaluated to generate respective fitness scores representing measures of how well the plurality of different combining algorithms each perform the image or video processing task. The algorithms may be iteratively updated to generate an optimized combining algorithm that may be applied to an input image or video.
-
公开(公告)号:US20180198989A1
公开(公告)日:2018-07-12
申请号:US15863638
申请日:2018-01-05
Applicant: GoPro, Inc.
Inventor: Timothy Macmillan , Balineedu Chowdary Adsumilli
CPC classification number: H04N5/247 , H04N5/23229 , H04N5/23238 , H04N5/265
Abstract: A phased camera array captures images from a plurality of image sensor assemblies, each image sensor assembly capturing at a framerate and a resolution. The phased camera array is configured to generate images captured from the independent image sensor assemblies to be stitched into a single composite image with a higher resolution than the independent images. The higher resolution composite images can then be phased together to generate a video with a higher framerate than what the independent images were captured at. The image sensor assemblies of the camera system are positioned in such a way to minimize the footprint of the camera system and minimize negative effects from image stitching and video phasing.
-
公开(公告)号:US20180091768A1
公开(公告)日:2018-03-29
申请号:US15278976
申请日:2016-09-28
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Ryan Lustig
IPC: H04N7/01
CPC classification number: H04N7/0137 , G06T3/40 , H04N7/0127 , H04N7/014
Abstract: Apparatus and methods for the generation of interpolated frames of video data. In one embodiment, a computerized apparatus is disclosed that includes a video data interface configured to receive frames of video data; a processing apparatus in data communication with the video data interface; and a storage apparatus in data communication with the processing apparatus. The computerized apparatus is further configured to: receive frames of captured video data; retrieve capture parameters associated with the frames of captured video data; generate optical flow parameters from the frames of captured video data; ascribe differing weights based on the capture parameters and/or the optical flow parameters; generate frames of interpolated video data for the frames of captured video data based at least in part on the ascribed weights; and compile a resultant video stream using the frames of interpolated video data and the frames of captured video data.
-
公开(公告)号:US09886733B2
公开(公告)日:2018-02-06
申请号:US15206606
申请日:2016-07-11
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli
IPC: G06T1/00 , H04N19/467 , H04N5/262 , H04N1/32 , H04N1/21
CPC classification number: G06T1/0028 , G06T1/005 , G06T2201/0052 , G06T2201/0202 , H04N1/2112 , H04N1/32197 , H04N1/32251 , H04N1/32277 , H04N1/32309 , H04N5/2621 , H04N19/467 , H04N2201/0084 , H04N2201/3233
Abstract: Watermark data is converted to watermark coefficients, which may be embedded in an image by converting the image to a frequency domain, embedding the watermark in image coefficients corresponding to medium-frequency components, and converting the modified coefficients to the spatial domain. The watermark data is extracted from the modified image by converting the modified image to a frequency domain, extracting the watermark coefficients from the image coefficients, and determining the watermark data from the watermark coefficients. The watermark data may be truncated image data bits such as truncated least significant data bits. After extraction from the watermark, the truncated image data bits may be combined with data bits representing the original image to increase the bit depth of the image. Watermark data may include audio data portions corresponding to a video frame, reference frames temporally proximate to a video frame, high-frequency content, sensor calibration information, or other image data.
-
公开(公告)号:US20170366896A1
公开(公告)日:2017-12-21
申请号:US15187695
申请日:2016-06-20
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Timothy Macmillan
CPC classification number: H04R1/406 , G01S3/7864 , G11B27/10 , H04R3/005 , H04S3/008 , H04S2400/11 , H04S2400/15
Abstract: Disclosed is a system and method for generating a model of the geometric relationships between various audio sources recorded by a multi-camera system. The spatial audio scene module associates source signals, extracted from recorded audio, of audio sources to visual objects identified in videos recorded by one or more cameras. This association may be based on estimated positions of the audio sources based on relative signal gains and delays of the source signal received at each microphone. The estimated positions of audio sources are tracked indirectly by tracking the associated visual objects with computer vision. A virtual microphone module may receive a position for a virtual microphone and synthesize a signal corresponding to the virtual microphone position based on the estimated positions of the audio sources.
-
公开(公告)号:US20170366812A1
公开(公告)日:2017-12-21
申请号:US15414426
申请日:2017-01-24
Applicant: GoPro, Inc.
Inventor: Adeel Abbas , Balineedu Chowdary Adsumilli , Vadim Polonichko
IPC: H04N19/137 , G06T19/00 , H04N19/176 , H04N19/167 , H04N19/154 , H04N19/146 , H04N19/14 , H04N5/232 , H04N19/11
CPC classification number: H04N19/137 , H04N5/2258 , H04N5/23238 , H04N13/00 , H04N13/111 , H04N13/161 , H04N13/20 , H04N13/239 , H04N13/243 , H04N19/107 , H04N19/167 , H04N19/597
Abstract: Systems and methods for providing panoramic image and/or video content using spatially selective encoding and/or decoding. Panoramic content may include stitched spherical (360-degree) images and/or VR video. In some implementations, selective encoding functionality may be embodied in a spherical image capture device that may include two lenses configured to capture pairs of hemispherical images. Encoded source images may be decoded and stitched in order to obtain a combined image characterized by a greater field of view as compared to source images. The stitched image may be encoded using a selective encoding methodology including: partitioning a stitched image into multiple portions, determining if a portion is to be re-encoded. If the image portion is to be re-encoded, re-encoding the image portion. If an image portion is not to be re-encoded, copying previously encoded image portion in lieu of encoding.
-
-
-
-
-
-
-
-
-