公开(公告)号：US11297337B2

公开(公告)日：2022-04-05

申请号：US16799673

申请日：2020-02-24

Applicant: GoPro, Inc.

Inventor： David A. Newman

IPC: G06K9/36 ,  H04N19/186 ,  H04N1/64 ,  H04N19/117 ,  H04N19/136 ,  H04N19/44 ,  G06T9/00 ,  G06F3/0484 ,  H04N19/85 ,  H04N5/232 ,  H04N5/265

Abstract: A method is described to greatly improve the efficiency of and reduce the complexity of image compression when using single-sensor color imagers for video acquisition. The method in addition allows for this new image compression type to be compatible with existing video processing tools, improving the workflow for film and television production.

公开(公告)号：US11259009B2

公开(公告)日：2022-02-22

申请号：US16718681

申请日：2019-12-18

Applicant: GoPro, Inc.

Inventor： Nicholas D. Woodman ,  David A. Newman ,  Stephen B. Schmidt

IPC: G03B35/00 ,  H04N13/296 ,  H04N13/243 ,  H04N13/286 ,  H04N13/239 ,  G03B37/04 ,  H04N5/341 ,  H04N5/073 ,  H04N5/232 ,  H04N5/247

Abstract: A system and a process configuration generates a unitary rendered image for a video from at least two cameras. The configuration detects a communication coupling of at least two cameras and determines a master camera and a slave camera. The configuration determines an orientation of camera sensor of the master camera and the slave camera and determines a first frame of a video for a synchronization point for a start of a video capture. The configuration captures and reads images from the master camera sensor and the slave camera sensor in response to the start of the video capture and orientation of the camera sensors.

公开(公告)号：US11228781B2

公开(公告)日：2022-01-18

申请号：US16572383

申请日：2019-09-16

Applicant: GoPro, Inc.

Inventor： David A. Newman ,  Cesar Douady ,  Alexis Lefebvre ,  Daryl Stimm ,  Michael Kraak

IPC: H04N19/40 ,  H04N19/52 ,  H04N19/182 ,  H04N19/196 ,  G06T3/00

Abstract: Methods and apparatus for processing of video content to optimize codec bandwidth. In one embodiment, the method includes capturing panoramic imaging content (e.g., a 360° panorama), mapping the panoramic imaging content into an equi-angular cubemap (EAC) format, and splitting the EAC format into segments for transmission to maximize codec bandwidth. In one exemplary embodiment, the EAC segments are transmitted at a different frame rate than the subsequent display rate of the panoramic imaging content. For example, the mapping and frame rate may be chosen to enable the rendering of 8K, 360-degree content at 24 fps, using commodity encoder hardware and software that nominally supports 4K content at 60 fps.

公开(公告)号：US20210343316A1

公开(公告)日：2021-11-04

申请号：US17378324

申请日：2021-07-16

Applicant: GOPRO, INC.

Inventor： David A. Newman ,  Adam Silver

IPC: G11B27/10 ,  G06K9/00 ,  G11B27/30 ,  G11B27/031 ,  G10L25/57 ,  H04N5/91 ,  H04N9/82 ,  G11B27/28 ,  G10L15/06 ,  G10L15/22 ,  H04N5/77 ,  G11B27/13 ,  G11B27/34 ,  H04N19/513 ,  G06T7/246

Abstract: Video and corresponding metadata is accessed. Events of interest within the video are identified based on the corresponding metadata, and best scenes are identified based on the identified events of interest. A video summary can be generated including one or more of the identified best scenes. The video summary can be generated using a video summary template with slots corresponding to video clips selected from among sets of candidate video clips. Best scenes can also be identified by receiving an indication of an event of interest within video from a user during the capture of the video. Metadata patterns representing activities identified within video clips can be identified within other videos, which can subsequently be associated with the identified activities.

公开(公告)号：US11164282B2

公开(公告)日：2021-11-02

申请号：US17075943

申请日：2020-10-21

Applicant: GoPro, Inc.

Inventor： David A. Newman ,  Joshua Edward Bodinet ,  Otto Kenneth Sievert ,  Timothy MacMillan

IPC: G06T3/00 ,  G06T5/00 ,  G06T3/40

Abstract: In a video capture system, a virtual lens is simulated when applying a crop or zoom effect to an input video. An input video frame is received from the input video that has a first field of view and an input lens distortion caused by a lens used to capture the input video frame. A selection of a sub-frame representing a portion of the input video frame is obtained that has a second field of view smaller than the first field of view. The sub-frame is processed to remap the input lens distortion to a desired lens distortion in the sub-frame. The processed sub-frame is the outputted.

公开(公告)号：US11109048B2

公开(公告)日：2021-08-31

申请号：US16538693

申请日：2019-08-12

Applicant: GoPro, Inc.

Inventor： David A. Newman ,  Brian G. Schunck

IPC: H04N19/44 ,  H04N19/63 ,  H04N19/423 ,  G11B20/00 ,  G11B27/031

Abstract: A system and method disposed to enable encoding, decoding and manipulation of digital video with substantially less processing load than would otherwise required. In particular, one disclosed method is directed to generating a compressed video data structure that is selectively decodable to a plurality of resolutions including the full resolution of the uncompressed stream. The desired number of data components and the content of the data components that make up the compressed video data, which determine the available video resolutions, are variable based upon the processing carried out and the resources available to decode and process the data components. During decoding, efficiency is substantially improved because only the data components necessary to generate a desired resolution are decoded. In variations, both temporal and spatial decoding are utilized to reduce frame rates, and hence, further reduce processor load. The system and method are particularly useful for real-time video editing applications.

公开(公告)号：US20210144356A1

公开(公告)日：2021-05-13

申请号：US17061885

申请日：2020-10-02

Applicant: GoPro, Inc.

Inventor： Timothy Macmillan ,  Scott Patrick Campbell ,  David A. Newman ,  Yajie Sun

IPC: H04N13/246 ,  H04N17/00 ,  H04N13/296 ,  H04N5/247 ,  H04N13/239 ,  H04N5/232 ,  H04N5/265 ,  H04N5/353 ,  H04N13/00

Abstract: An image capture device having multiple image sensors having overlapping fields of view that aligns the image sensors based on images captured by image sensors. A pixel shift is identified between the images. Based on the identified pixel shift, a calibration is applied to one or more of the image sensors. To determine the pixel shift, a processor applies correlation methods including edge matching. Calibrating the image sensors may include adjusting a read window on an image sensor. The pixel shift can also be used to determine a time lag, which can be used to synchronize subsequent image captures.

公开(公告)号：US10559324B2

公开(公告)日：2020-02-11

申请号：US16153304

申请日：2018-10-05

Applicant: GoPro, Inc.

Inventor： Otto K. Sievert ,  Gurprit Cheema ,  David A. Newman

IPC: H04N9/80 ,  G11B27/036 ,  G11B27/10 ,  G11B27/30 ,  G06K9/00

Abstract: A video identifier uniquely identifying a video captured by a camera is generated. The video includes video frames and optionally concurrently captured audio as well as video metadata describing the video. Video data is extracted from at least two of the video's frames. By combining the extracted video data in an order specified by an identifier generation protocol, an extracted data object is generated. The extracted data object is hashed to generate the unique media identifier, which is stored in association with the video. The identifier generation protocol may indicate the portions of the video data to extract, such as video data corresponding to particular video frames and audio data corresponding to particular audio samples. The extracted data object may include a size of particular video frames, a number of audio samples in the video, or the duration of the video, for example.

公开(公告)号：US10395338B2

公开(公告)日：2019-08-27

申请号：US16229512

申请日：2018-12-21

Applicant: GoPro, Inc.

Inventor： David A. Newman ,  Joshua Edward Bodinet ,  Otto Kenneth Sievert ,  Timothy MacMillan

IPC: G06T3/00 ,  G06T5/00 ,  G06T3/40

Abstract: In a video capture system, a virtual lens is simulated when applying a crop or zoom effect to an input video. An input video frame is received from the input video that has a first field of view and an input lens distortion caused by a lens used to capture the input video frame. A selection of a sub-frame representing a portion of the input video frame is obtained that has a second field of view smaller than the first field of view. The sub-frame is processed to remap the input lens distortion to a desired lens distortion in the sub-frame. The processed sub-frame is the outputted.

公开(公告)号：US20190237107A1

公开(公告)日：2019-08-01

申请号：US16382600

申请日：2019-04-12

Applicant: GoPro, Inc.

Inventor： David A. Newman ,  Adam Silver

IPC: G11B27/10 ,  G06K9/00 ,  G11B27/13 ,  G11B27/30 ,  G11B27/031 ,  G11B27/34 ,  G10L25/57 ,  G11B27/28 ,  H04N9/82 ,  H04N5/91 ,  H04N5/77 ,  G10L15/22 ,  G10L15/06

CPC classification number: G11B27/10 ,  G06K9/00718 ,  G06K9/00751 ,  G06K2009/00738 ,  G06T7/246 ,  G10L15/063 ,  G10L15/22 ,  G10L25/54 ,  G10L25/57 ,  G10L2015/0631 ,  G10L2015/223 ,  G11B27/031 ,  G11B27/13 ,  G11B27/28 ,  G11B27/3081 ,  G11B27/34 ,  H04N5/77 ,  H04N5/772 ,  H04N5/91 ,  H04N9/8205 ,  H04N19/513

Abstract: Video and corresponding metadata is accessed. Events of interest within the video are identified based on the corresponding metadata, and best scenes are identified based on the identified events of interest. A video summary can be generated including one or more of the identified best scenes. The video summary can be generated using a video summary template with slots corresponding to video clips selected from among sets of candidate video clips. Best scenes can also be identified by receiving an indication of an event of interest within video from a user during the capture of the video. Metadata patterns representing activities identified within video clips can be identified within other videos, which can subsequently be associated with the identified activities.