公开(公告)号：US10410680B2

公开(公告)日：2019-09-10

申请号：US16105304

申请日：2018-08-20

Applicant: GoPro, Inc.

Inventor： Scott Patrick Campbell ,  Zhinian Jing ,  Timothy Macmillan ,  David A. Newman ,  Balineedu Chowdary Adsumilli

IPC: G11B27/30 ,  H04N9/82 ,  H04N9/806 ,  H04N5/77 ,  H04N5/232

Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.

公开(公告)号：US20190246126A1

公开(公告)日：2019-08-08

申请号：US16234214

申请日：2018-12-27

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Balineedu Chowdary Adsumilli ,  David Newman

IPC: H04N19/30 ,  H04N19/29 ,  H04N19/167 ,  H04N19/146 ,  H04N19/59 ,  H04N19/187

CPC classification number: H04N19/30 ,  H04N19/146 ,  H04N19/167 ,  H04N19/187 ,  H04N19/29 ,  H04N19/59

Abstract: Apparatus and methods for digital video data compression via a scalable, multi-resolution approach. In one embodiment, the video content may be encoded using a multi-resolution and/or multi-quality scalable coding approach that reduces computational and/or energy load on a client device. In one implementation, a low fidelity image is obtained based on a first full resolution image. The low fidelity image may be encoded to obtain a low fidelity bitstream. A second full resolution image may be obtained based on the low fidelity bitstream. A portion of a difference image obtained based on the second full resolution image and the first full resolution may be encoded to obtain a high fidelity bitstream. The low fidelity bitstream and the high fidelity bitstream may be provided to e.g., a receiving device.

公开(公告)号：US10244167B2

公开(公告)日：2019-03-26

申请号：US15432700

申请日：2017-02-14

Applicant: GoPro, Inc.

Inventor： Balineedu Chowdary Adsumilli ,  Adeel Abbas ,  Sumit Chawla

IPC: G06K9/00 ,  H04N5/232 ,  H04N19/597 ,  H04N19/122 ,  H04N19/115 ,  H04N19/117 ,  H04N19/126 ,  H04N19/167 ,  H04N19/57 ,  H04N13/243 ,  H04N13/344 ,  H04N13/296 ,  H04N13/178

Abstract: Methods and apparatus for encoding and decoding image data based on one or more parameters. In one embodiment, various spatial portions or regions of image data (e.g., a still or moving image) are weighted according to the perceived or measured quality. Processing for these weighted regions can be selectively altered or adjusted so as to optimize one or more operational parameters including for example processing and/or memory requirements, or speed.

公开(公告)号：US10192585B1

公开(公告)日：2019-01-29

申请号：US15467804

申请日：2017-03-23

Applicant: GOPRO, INC.

Inventor： Balineedu Chowdary Adsumilli ,  Ryan Lustig ,  David A. Newman

IPC: G11B27/10 ,  G06K9/00 ,  G10L15/22 ,  G10L15/06 ,  G11B27/031 ,  H04N5/77 ,  H04N5/91

Abstract: Video and corresponding metadata is accessed. Events of interest within the video are identified based on the corresponding metadata, and best scenes are identified based on the identified events of interest. In one example, best scenes are identified based on the motion values associated with frames or portions of a frame of a video. Motion values are determined for each frame and portions of the video including frames with the most motion are identified as best scenes. Best scenes may also be identified based on the motion profile of a video. The motion profile of a video is a measure of global or local motion within frames throughout the video. For example, best scenes are identified from portion of the video including steady global motion. A video summary can be generated including one or more of the identified best scenes.

公开(公告)号：US10134114B2

公开(公告)日：2018-11-20

申请号：US15270971

申请日：2016-09-20

Applicant: GoPro, Inc.

Inventor： Balineedu Chowdary Adsumilli ,  Ryan Lustig ,  Aaron Staranowicz

IPC: G06K9/00 ,  G06T5/00 ,  G06T3/40

Abstract: Apparatus and methods for video image post-processing for segmentation based interpolation. In one embodiment, a computerized apparatus is utilized in order to obtain a first frame of video data; segment one or more objects within the first frame of video data; obtain a second frame of video data; segment one or more objects within the second frame of video data; match at least a portion of the one or more objects within the first frame of video data with the one or more objects within the second frame of video data; compute the motion of the pixels for the matched portion of the one or more objects; compute the motion of pixels associated with a background image; and generate an interpolated frame of video data, the interpolated frame of video data residing temporally between the first frame of video data and the second frame of video data.

公开(公告)号：US10084961B2

公开(公告)日：2018-09-25

申请号：US15595881

申请日：2017-05-15

Applicant: GOPRO, INC.

Inventor： Timothy MacMillan ,  David A. Newman ,  Balineedu Chowdary Adsumilli

IPC: H04N5/93 ,  H04N5/232 ,  G06K9/00 ,  G06F17/30 ,  G06T3/00 ,  H04L29/06 ,  H04N21/234 ,  H04N21/233 ,  G03B37/04 ,  G06T7/246 ,  H04N13/106

CPC classification number: H04N5/23238 ,  G03B37/04 ,  G06F16/71 ,  G06K9/00281 ,  G06K9/00355 ,  G06K9/00711 ,  G06T3/0062 ,  G06T7/246 ,  G06T2207/10016 ,  G06T2207/30201 ,  H04L65/00 ,  H04L65/4084 ,  H04L65/602 ,  H04L67/42 ,  H04N13/106 ,  H04N21/233 ,  H04N21/23418

Abstract: A spherical content capture system captures spherical video content. A spherical video sharing platform enables users to share the captured spherical content and enables users to access spherical content shared by other users. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest.

公开(公告)号：US10045120B2

公开(公告)日：2018-08-07

申请号：US15187695

申请日：2016-06-20

Applicant: GoPro, Inc.

Inventor： Balineedu Chowdary Adsumilli ,  Timothy Macmillan

IPC: H04R1/40 ,  G01S3/786 ,  G11B27/10

Abstract: Disclosed is a system and method for generating a model of the geometric relationships between various audio sources recorded by a multi-camera system. The spatial audio scene module associates source signals, extracted from recorded audio, of audio sources to visual objects identified in videos recorded by one or more cameras. This association may be based on estimated positions of the audio sources based on relative signal gains and delays of the source signal received at each microphone. The estimated positions of audio sources are tracked indirectly by tracking the associated visual objects with computer vision. A virtual microphone module may receive a position for a virtual microphone and synthesize a signal corresponding to the virtual microphone position based on the estimated positions of the audio sources.

公开(公告)号：US09965703B2

公开(公告)日：2018-05-08

申请号：US15177310

申请日：2016-06-08

Applicant: GoPro, Inc.

Inventor： Balineedu Chowdary Adsumilli ,  Ryan Lustig

IPC: G06K9/62 ,  G06N99/00 ,  G06K9/00

CPC classification number: G06K9/6262 ,  G06K9/00228 ,  G06K9/00744 ,  G06K9/6227 ,  G06K9/6229 ,  G06K9/6256 ,  G06N3/126 ,  G06N99/005

Abstract: An algorithm for performing an image or video processing task is generated that may be used to combine a plurality of different independent solutions to the image or video processing task in an optimized manner. A plurality of base algorithms may be applied to a training set of images or video and a first generation of different combining algorithms may be applied to combine the respective solutions from each of the respective base algorithms into respective combined solutions. The respective combined solutions may be evaluated to generate respective fitness scores representing measures of how well the plurality of different combining algorithms each perform the image or video processing task. The algorithms may be iteratively updated to generate an optimized combining algorithm that may be applied to an input image or video.

公开(公告)号：US09940697B2

公开(公告)日：2018-04-10

申请号：US15347610

申请日：2016-11-09

Applicant: GoPro, Inc.

Inventor： Balineedu Chowdary Adsumilli ,  Adeel Abbas ,  David Newman

IPC: G06T5/00 ,  G06T3/00 ,  G06T5/20 ,  G06T3/40

CPC classification number: G06T5/001 ,  G06T3/0087 ,  G06T3/0093 ,  G06T3/4038 ,  G06T5/006 ,  G06T5/20 ,  G06T5/50 ,  G06T2207/10012

Abstract: Systems and methods for capturing and/or processing of panoramic imaging content using spatial redundancy-based mapping. Panoramic imaging content may be processed using a processing pipeline that may operate on a portion of the image. Images may be transformed prior to processing. Image transformation may introduce distortion and/or data redundancy. Image partitioning for the pipeline processing may be configured based on spatial redundancy associated with the transformation. Windowing operation may include partitioning an image using non-rectangular and/or non-equal windows.

公开(公告)号：US09930271B2

公开(公告)日：2018-03-27

申请号：US15080280

申请日：2016-03-24

Applicant: GoPro, Inc.

Inventor： Balineedu Chowdary Adsumilli ,  Ryan Lustig

IPC: G06K9/00 ,  H04N5/272 ,  G06T15/50 ,  G06T5/00 ,  G06T7/20 ,  H04N5/235 ,  H04N13/00 ,  G06T11/60 ,  G06T7/11 ,  G06T7/143 ,  G06T7/194 ,  G06T7/174 ,  G06T7/254

CPC classification number: H04N5/272 ,  G06T5/002 ,  G06T7/11 ,  G06T7/143 ,  G06T7/174 ,  G06T7/194 ,  G06T7/20 ,  G06T7/254 ,  G06T11/60 ,  G06T15/503 ,  G06T2207/10016 ,  G06T2207/10021 ,  G06T2207/20036 ,  H04N5/2356 ,  H04N13/128 ,  H04N2013/0085 ,  H04N2013/0092

Abstract: A processing device generates composite images from a sequence of images. The composite images may be used as frames of video. A foreground/background segmentation is performed at selected frames to extract a plurality of foreground object images depicting a foreground object at different locations as it moves across a scene. The foreground object images are stored to a foreground object list. The foreground object images in the foreground object list are overlaid onto subsequent video frames that follow the respective frames from which they were extracted, thereby generating a composite video.