-
公开(公告)号:US20200286204A1
公开(公告)日:2020-09-10
申请号:US16884962
申请日:2020-05-27
Applicant: GoPro, Inc.
Inventor: David A. Newman , Joshua Edward Bodinet , Otto Kenneth Sievert , Timothy MacMillan
Abstract: In a video capture system, a virtual lens is simulated when applying a crop or zoom effect to an input video. An input video frame is received from the input video that has a first field of view and an input lens distortion caused by a lens used to capture the input video frame. A selection of a sub-frame representing a portion of the input video frame is obtained that has a second field of view smaller than the first field of view. The sub-frame is processed to remap the input lens distortion to a desired lens distortion in the sub-frame. The processed sub-frame is the outputted.
-
公开(公告)号:US10701291B2
公开(公告)日:2020-06-30
申请号:US16401529
申请日:2019-05-02
Applicant: GoPro, Inc.
Inventor: Scott Patrick Campbell , David A. Newman , Brian G. Schunck
IPC: H04N5/341 , H04N5/232 , H04N19/423 , H04N19/426 , H04N1/21 , H04N19/137 , H04N19/156 , H04N5/335 , H04N1/00 , H04N19/172 , H04N19/625 , H04N19/63 , H04N19/91 , H04N9/04
Abstract: Systems and methods are disclosed that capture and compress frames of pixel data. In an implementation, an image sensor chip is configured to convert light into pixel data and generate compressed pixel data at a variable compression rate including applying a transform to pixel data associated with a pixel category from a plurality of pixel categories. The variable compression rate is within an available bandwidth of an output bus configured to output the compressed pixel data.
-
公开(公告)号:US20200135238A1
公开(公告)日:2020-04-30
申请号:US16721561
申请日:2019-12-19
Applicant: GoPro, Inc.
Inventor: Scott Patrick Campbell , Zhinian Jing , Timothy Macmillan , David A. Newman , Balineedu Chowdary Adsumilli
Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.
-
公开(公告)号:US10529052B2
公开(公告)日:2020-01-07
申请号:US16535940
申请日:2019-08-08
Applicant: GoPro, Inc.
Inventor: David A. Newman , Joshua Edward Bodinet , Otto Kenneth Sievert , Timothy MacMillan
Abstract: In a video capture system, a virtual lens is simulated when applying a crop or zoom effect to an input video. An input video frame is received from the input video that has a first field of view and an input lens distortion caused by a lens used to capture the input video frame. A selection of a sub-frame representing a portion of the input video frame is obtained that has a second field of view smaller than the first field of view. The sub-frame is processed to remap the input lens distortion to a desired lens distortion in the sub-frame. The processed sub-frame is the outputted.
-
公开(公告)号:US20190362462A1
公开(公告)日:2019-11-28
申请号:US16535886
申请日:2019-08-08
Applicant: GoPro, Inc.
Inventor: David A. Newman , Joshua Edward Bodinet , Otto Kenneth Sievert , Timothy MacMillan
Abstract: In a video capture system, a virtual lens is simulated when applying a crop or zoom effect to an input video. An input video frame is received from the input video that has a first field of view and an input lens distortion caused by a lens used to capture the input video frame. A selection of a sub-frame representing a portion of the input video frame is obtained that has a second field of view smaller than the first field of view. The sub-frame is processed to remap the input lens distortion to a desired lens distortion in the sub-frame. The processed sub-frame is the outputted.
-
公开(公告)号:US10397549B2
公开(公告)日:2019-08-27
申请号:US15385759
申请日:2016-12-20
Applicant: GoPro, Inc.
Inventor: Adeel Abbas , David A. Newman , Timothy Macmillan
IPC: G06K9/46 , H04N5/232 , H04N13/243 , G06T7/33 , G06T17/00 , H04N13/296 , G06T3/40 , G01S3/00 , H04N5/225 , H04N5/247 , H04N5/262 , G06K9/20 , G06K9/36
Abstract: A method and system are described. The method includes capturing a set of images from a 2×2 array of cameras, each camera of the array of cameras having an overlapping field of view (FOV) with an adjacent camera of the array of cameras. The method further includes synchronously capturing a supplemental image from a fifth camera, the fifth camera having an at least partially overlapping FOV with every camera of the array of cameras. Supplemental information is extracted by comparing the supplemental image with the set of four images. Portions of the set of images are stitched based in part on the supplemental information to produce a combined stitched image, the combined stitched image having a higher resolution than each image of the set of images.
-
公开(公告)号:US10389993B2
公开(公告)日:2019-08-20
申请号:US15077911
申请日:2016-03-23
Applicant: GoPro, Inc.
Inventor: Timothy Macmillan , Scott Patrick Campbell , David A. Newman , Yajie Sun
Abstract: A pair of cameras having an overlapping field of view is aligned based on images captured by image sensors of the pair of cameras. A pixel shift is identified between the images. Based on the identified pixel shift, a calibration is applied to one or both of the pair of cameras. To determine the pixel shift, the camera applies correlation methods including edge matching. Calibrating the pair of cameras may include adjusting a read window on an image sensor. The pixel shift can also be used to determine a time lag, which can be used to synchronize subsequent image captures.
-
公开(公告)号:US10056115B2
公开(公告)日:2018-08-21
申请号:US15396385
申请日:2016-12-30
Applicant: GoPro, Inc.
Inventor: Scott Patrick Campbell , Zhinian Jing , Timothy Macmillan , David A. Newman , Balineedu Chowdary Adsumilli
CPC classification number: G11B27/3081 , H04N5/23238 , H04N5/77 , H04N9/806 , H04N9/8205 , H04N9/8211
Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.
-
公开(公告)号:US09961355B2
公开(公告)日:2018-05-01
申请号:US15288836
申请日:2016-10-07
Applicant: GoPro, Inc.
Inventor: David A. Newman , Brian G. Schunck
IPC: H04N19/44 , H04N19/63 , H04N19/423 , G11B27/031 , G11B20/00
CPC classification number: H04N19/44 , G11B20/00007 , G11B27/031 , G11B2020/00072 , H04N19/423 , H04N19/63
Abstract: A system and method disposed to enable encoding, decoding and manipulation of digital video with substantially less processing load than would otherwise required. In particular, one disclosed method is directed to generating a compressed video data structure that is selectively decodable to a plurality of resolutions including the full resolution of the uncompressed stream. The desired number of data components and the content of the data components that make up the compressed video data, which determine the available video resolutions, are variable based upon the processing carried out and the resources available to decode and process the data components. During decoding, efficiency is substantially improved because only the data components necessary to generate a desired resolution are decoded. In variations, both temporal and spatial decoding are utilized to reduce frame rates, and hence, further reduce processor load. The system and method are particularly useful for real-time video editing applications.
-
公开(公告)号:US09800885B2
公开(公告)日:2017-10-24
申请号:US14340873
申请日:2014-07-25
Applicant: GoPro, Inc.
Inventor: David A. Newman , Brian G. Schunck
IPC: H04N19/44 , H04N19/423 , H04N19/63 , G11B27/031 , G11B20/00
CPC classification number: H04N19/44 , G11B20/00007 , G11B27/031 , G11B2020/00072 , H04N19/423 , H04N19/63
Abstract: A system and method disposed to enable encoding, decoding and manipulation of digital video with substantially less processing load than would otherwise be required. In particular, one disclosed method is directed to generating a compressed video data structure that is selectively decodable to a plurality of resolutions including the full resolution of the uncompressed stream. The desired number of data components and the content of the data components that make up the compressed video data, which determine the available video resolutions, are variable based upon the processing carried out and the resources available to decode and process the data components. During decoding, efficiency is substantially improved because only the data components necessary to generate a desired resolution are decoded. In variations, both temporal and spatial decoding are utilized to reduce frame rates, and hence, further reduce processor load. The system and method are particularly useful for real-time video editing applications.
-
-
-
-
-
-
-
-
-