公开(公告)号：US20210392375A1

公开(公告)日：2021-12-16

申请号：US17460880

申请日：2021-08-30

Applicant: GoPro, Inc.

Inventor： David A. Newman ,  Cesar Douady ,  Alexis Lefebvre ,  Daryl Stimm ,  Michael Kraak

IPC: H04N19/597 ,  H04N19/176 ,  H04N19/146 ,  H04N19/13

Abstract: Methods and apparatus for processing of video content to optimize codec bandwidth. In one embodiment, the method includes capturing panoramic imaging content (e.g., a 360° panorama), mapping the panoramic imaging content into an equi-angular cubemap (EAC) format, and splitting the EAC format into segments for transmission to maximize codec bandwidth. In one exemplary embodiment, the EAC segments are transmitted at a different frame rate than the subsequent display rate of the panoramic imaging content. For example, the mapping and frame rate may be chosen to enable the rendering of 8K, 360° content at 24 fps, using commodity encoder hardware and software that nominally supports 4K content at 60 fps.

公开(公告)号：US20210385473A1

公开(公告)日：2021-12-09

申请号：US17400531

申请日：2021-08-12

Applicant: GoPro, Inc.

Inventor： David A. Newman ,  Brian G. Schunck

IPC: H04N19/44 ,  G11B20/00 ,  H04N19/423 ,  H04N19/63 ,  G11B27/031

Abstract: A system and method disposed to enable encoding, decoding and manipulation of digital video with substantially less processing load than would otherwise be required. In particular, one disclosed method is directed to generating a compressed video data structure that is selectively decodable to a plurality of resolutions including the full resolution of the uncompressed stream. The desired number of data components and the content of the data components that make up the compressed video data, which determine the available video resolutions, are variable based upon the processing carried out and the resources available to decode and process the data components. During decoding, efficiency is substantially improved because only the data components necessary to generate a desired resolution are decoded. In variations, both temporal and spatial decoding are utilized to reduce frame rates, and hence, further reduce processor load. The system and method are particularly useful for real-time video editing applications.

公开(公告)号：US11109067B2

公开(公告)日：2021-08-31

申请号：US16730839

申请日：2019-12-30

Applicant: GoPro, Inc.

Inventor： David A. Newman ,  Cesar Douady ,  Alexis Lefebvre ,  Daryl Stimm ,  Michael Kraak

IPC: H04N19/597 ,  H04N19/176 ,  H04N19/146 ,  H04N19/13

Abstract: Methods and apparatus for processing of video content to optimize codec bandwidth. In one embodiment, the method includes capturing panoramic imaging content (e.g., a 360° panorama), mapping the panoramic imaging content into an equi-angular cubemap (EAC) format, and splitting the EAC format into segments for transmission to maximize codec bandwidth. In one exemplary embodiment, the EAC segments are transmitted at a different frame rate than the subsequent display rate of the panoramic imaging content. For example, the mapping and frame rate may be chosen to enable the rendering of 8K, 360-degree content at 24 fps, using commodity encoder hardware and software that nominally supports 4K content at 60 fps.

公开(公告)号：US20210124155A1

公开(公告)日：2021-04-29

申请号：US17079300

申请日：2020-10-23

Applicant: GoPro, Inc.

Inventor： David A. Newman

IPC: G02B13/16 ,  G02B3/08

Abstract: Methods and apparatus for seamlessly transitioning between lens projections. In one exemplary embodiment, a piecewise lens projection is composed of three (3) functions: (i) a first polynomial-based lens projection, (ii) a second “joining” lens projection, and (iii) a trigonometric lens projection. The piecewise lens projection characterizes virtualized lens distortion as a function of FOV; image data can be dynamically projected based on the virtualized lens distortion, regardless of FOV. In this manner, a user may achieve the visually familiar effects associated with a first lens definition for a first FOV, while still smoothly animating transitions to other lens projections (e.g., a larger FOV using stereographic projections).

公开(公告)号：US20210035261A1

公开(公告)日：2021-02-04

申请号：US17075943

申请日：2020-10-21

Applicant: GoPro, Inc.

Inventor： David A. Newman ,  Joshua Edward Bodinet ,  Otto Kenneth Sievert ,  Timothy MacMillan

IPC: G06T3/00 ,  G06T5/00 ,  G06T3/40

Abstract: In a video capture system, a virtual lens is simulated when applying a crop or zoom effect to an input video. An input video frame is received from the input video that has a first field of view and an input lens distortion caused by a lens used to capture the input video frame. A selection of a sub-frame representing a portion of the input video frame is obtained that has a second field of view smaller than the first field of view. The sub-frame is processed to remap the input lens distortion to a desired lens distortion in the sub-frame. The processed sub-frame is the outputted.

公开(公告)号：US10798365B2

公开(公告)日：2020-10-06

申请号：US16541453

申请日：2019-08-15

Applicant: GoPro, Inc.

Inventor： Timothy Macmillan ,  Scott Patrick Campbell ,  David A. Newman ,  Yajie Sun

IPC: H04N13/246 ,  H04N17/00 ,  H04N13/296 ,  H04N5/247 ,  H04N13/239 ,  H04N5/232 ,  H04N5/265 ,  H04N5/353 ,  H04N13/00

Abstract: A pair of cameras having an overlapping field of view is aligned based on images captured by image sensors of the pair of cameras. A pixel shift is identified between the images. Based on the identified pixel shift, a calibration is applied to one or both of the pair of cameras. To determine the pixel shift, the camera applies correlation methods including edge matching. Calibrating the pair of cameras may include adjusting a read window on an image sensor. The pixel shift can also be used to determine a time lag, which can be used to synchronize subsequent image captures.

公开(公告)号：US10776629B2

公开(公告)日：2020-09-15

申请号：US16124607

申请日：2018-09-07

Applicant: GoPro, Inc.

Inventor： David A. Newman ,  Adam Silver

IPC: G06K9/00 ,  G11B27/00 ,  G11B27/031 ,  G11B27/22 ,  G11B27/28 ,  G11B27/34 ,  H04N13/172 ,  H04N13/178 ,  H04N21/235 ,  H04N21/8549 ,  H04N5/232 ,  H04N5/77 ,  H04N5/91 ,  H04N9/82

Abstract: Video and corresponding metadata is accessed. Events of interest within the video are identified based on the corresponding metadata, and best scenes are identified based on the identified events of interest. A video summary can be generated including one or more of the identified best scenes. The video summary can be generated using a video summary template with slots corresponding to video clips selected from among sets of candidate video clips. Best scenes can also be identified by receiving an indication of an event of interest within video from a user during the capture of the video. Metadata patterns representing activities identified within video clips can be identified within other videos, which can subsequently be associated with the identified activities.

公开(公告)号：US10735712B2

公开(公告)日：2020-08-04

申请号：US16508384

申请日：2019-07-11

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  David A. Newman ,  Timothy Macmillan

IPC: G06K9/46 ,  G06T7/33 ,  G06T17/00 ,  G06T7/292 ,  H04N5/232 ,  H04N5/247 ,  H04N13/243 ,  H04N13/296 ,  G01S3/00 ,  G06K9/20 ,  G06T3/40 ,  H04N5/225 ,  H04N5/262 ,  G06K9/36

Abstract: A method and system are described. The method includes capturing a set of images from an array of cameras, each camera of the array of cameras having an overlapping field of view (FOV) with an adjacent camera of the array of cameras. The method further includes synchronously capturing a supplemental image from an additional camera, the additional camera having an at least partially overlapping FOV with every camera of the array of cameras. Supplemental information is extracted by comparing the supplemental image with the set of images. Portions of the set of images are stitched based in part on the supplemental information to produce a combined stitched image, the combined stitched image having a higher resolution than each image of the set of images.

公开(公告)号：US20200118240A1

公开(公告)日：2020-04-16

申请号：US16713839

申请日：2019-12-13

Applicant: GoPro, Inc.

Inventor： David A. Newman ,  Joshua Edward Bodinet ,  Otto Kenneth Sievert ,  Timothy MacMillan

IPC: G06T3/00 ,  G06T5/00 ,  G06T3/40

Abstract: In a video capture system, a virtual lens is simulated when applying a crop or zoom effect to an input video. An input video frame is received from the input video that has a first field of view and an input lens distortion caused by a lens used to capture the input video frame. A selection of a sub-frame representing a portion of the input video frame is obtained that has a second field of view smaller than the first field of view. The sub-frame is processed to remap the input lens distortion to a desired lens distortion in the sub-frame. The processed sub-frame is the outputted.

公开(公告)号：US10574898B2

公开(公告)日：2020-02-25

申请号：US16234389

申请日：2018-12-27

Applicant: GoPro, Inc.

Inventor： David A. Newman

IPC: H04N5/232 ,  H04N1/64 ,  H04N9/04 ,  H04N19/117 ,  H04N19/136 ,  H04N19/186 ,  H04N19/44 ,  G06K9/36 ,  G06T9/00 ,  G06F3/0484 ,  H04N19/85 ,  H04N5/265

Abstract: A method is described to greatly improve the efficiency of and reduce the complexity of image compression when using single-sensor color imagers for video acquisition. The method in addition allows for this new image compression type to be compatible with existing video processing tools, improving the workflow for film and television production.