SYSTEMS AND METHODS FOR SPATIALLY SELECTIVE VIDEO CODING

    公开(公告)号:US20200059649A1

    公开(公告)日:2020-02-20

    申请号:US16666094

    申请日:2019-10-28

    Applicant: GoPro, Inc.

    Abstract: Systems and methods for providing panoramic image and/or video content using spatially selective encoding and/or decoding. Panoramic content may include stitched spherical (360-degree) images and/or VR video. In some implementations, selective encoding functionality may be embodied in a spherical image capture device that may include two lenses configured to capture pairs of hemispherical images. Encoded source images may be decoded and stitched in order to obtain a combined image characterized by a greater field of view as compared to source images. The stitched image may be encoded using a selective encoding methodology including: partitioning a stitched image into multiple portions, determining if a portion is to be re-encoded. If the image portion is to be re-encoded, re-encoding the image portion. If an image portion is not to be re-encoded, copying previously encoded image portion in lieu of encoding.

    SYSTEMS AND METHODS FOR SPATIALLY ADAPTIVE VIDEO ENCODING

    公开(公告)号:US20190335177A1

    公开(公告)日:2019-10-31

    申请号:US16410919

    申请日:2019-05-13

    Applicant: GoPro, Inc.

    Abstract: Systems and methods for providing video content using spatially adaptive video encoding. Panoramic and/or virtual reality content may be viewed by a client device using a viewport with viewing dimension(s) configured smaller than available dimension(s) of the content. Client device may include a portable media device characterized by given energy and/or computational resources. Video content may be encoded using spatially varying encoding. For image playback, portions of panoramic image may be pre-encoded using multiple quality bands. Pre-encoded image portions, matching the viewport, may be provided and reduce computational and/or energy load on the client device during consumption of panoramic content. Quality distribution may include gradual quality transition area allowing for small movements of the viewport without triggering image re-encoding. Larger movements of the viewport may automatically trigger transition to another spatial encoding distribution.

    Image alignment using a virtual gyroscope model

    公开(公告)号:US10382683B2

    公开(公告)日:2019-08-13

    申请号:US15967364

    申请日:2018-04-30

    Applicant: GoPro, Inc.

    Abstract: A target image captured from a fisheye lens or other lens with known distortion parameters may be transformed to align it to a reference image. Corresponding features may be detected in the target image and the reference image. The features may be transformed to a spherical coordinate space. In the spherical space, images may be re-pointed or rotated in three dimensions to align all or a subset of the features of the target image to the corresponding features of the reference image. For example, in a sequence of images, background features of the target image in the spherical image space may be aligned to background features of the reference image in the spherical image space to compensate for camera motion while preserving foreground motion. An inverse transformation may then be applied to bring the images back into the original image space.

    Phased Camera Array System For Generation of High Quality Images and Video

    公开(公告)号:US20180198989A1

    公开(公告)日:2018-07-12

    申请号:US15863638

    申请日:2018-01-05

    Applicant: GoPro, Inc.

    CPC classification number: H04N5/247 H04N5/23229 H04N5/23238 H04N5/265

    Abstract: A phased camera array captures images from a plurality of image sensor assemblies, each image sensor assembly capturing at a framerate and a resolution. The phased camera array is configured to generate images captured from the independent image sensor assemblies to be stitched into a single composite image with a higher resolution than the independent images. The higher resolution composite images can then be phased together to generate a video with a higher framerate than what the independent images were captured at. The image sensor assemblies of the camera system are positioned in such a way to minimize the footprint of the camera system and minimize negative effects from image stitching and video phasing.

    APPARATUS AND METHODS FOR FRAME INTERPOLATION BASED ON SPATIAL CONSIDERATIONS

    公开(公告)号:US20180091768A1

    公开(公告)日:2018-03-29

    申请号:US15278976

    申请日:2016-09-28

    Applicant: GoPro, Inc.

    CPC classification number: H04N7/0137 G06T3/40 H04N7/0127 H04N7/014

    Abstract: Apparatus and methods for the generation of interpolated frames of video data. In one embodiment, a computerized apparatus is disclosed that includes a video data interface configured to receive frames of video data; a processing apparatus in data communication with the video data interface; and a storage apparatus in data communication with the processing apparatus. The computerized apparatus is further configured to: receive frames of captured video data; retrieve capture parameters associated with the frames of captured video data; generate optical flow parameters from the frames of captured video data; ascribe differing weights based on the capture parameters and/or the optical flow parameters; generate frames of interpolated video data for the frames of captured video data based at least in part on the ascribed weights; and compile a resultant video stream using the frames of interpolated video data and the frames of captured video data.

    Associating Audio with Three-Dimensional Objects in Videos

    公开(公告)号:US20170366896A1

    公开(公告)日:2017-12-21

    申请号:US15187695

    申请日:2016-06-20

    Applicant: GoPro, Inc.

    Abstract: Disclosed is a system and method for generating a model of the geometric relationships between various audio sources recorded by a multi-camera system. The spatial audio scene module associates source signals, extracted from recorded audio, of audio sources to visual objects identified in videos recorded by one or more cameras. This association may be based on estimated positions of the audio sources based on relative signal gains and delays of the source signal received at each microphone. The estimated positions of audio sources are tracked indirectly by tracking the associated visual objects with computer vision. A virtual microphone module may receive a position for a virtual microphone and synthesize a signal corresponding to the virtual microphone position based on the estimated positions of the audio sources.

Patent Agency Ranking