公开(公告)号：US20180063551A1

公开(公告)日：2018-03-01

申请号：US15251980

申请日：2016-08-30

Applicant: GoPro, Inc.

Inventor： Balineedu Chowdary Adsumilli ,  Ryan Lustig ,  Aaron Staranowicz

IPC: H04N19/80 ,  H04N19/43 ,  H04L12/26

CPC classification number: H04N19/172 ,  H04N19/132 ,  H04N19/137 ,  H04N19/146 ,  H04N19/162 ,  H04N19/587 ,  H04N19/96

Abstract: Apparatus and methods for generating interpolated frames in digital image or video data. In one embodiment, the interpolation is based on a hierarchical tree sequence. At each level of the tree, an interpolated frame may be generated using original or interpolated frames of the video, such as those closest in time to the desired time of the frame to be generated. The sequence proceeds through lower tree levels until a desired number of interpolated frames, a desired video length, a desired level, or a desired visual quality for the video is reached. In some implementations, the sequence may use different interpolation algorithms (e.g., of varying computational complexity or types) at different levels of the tree. The interpolation algorithms can include for example those based on frame repetition, frame averaging, motion compensated frame interpolation, and motion blending.

公开(公告)号：US20180054624A1

公开(公告)日：2018-02-22

申请号：US15799837

申请日：2017-10-31

Applicant: GoPro, Inc.

Inventor： Adeel Abbas ,  Balineedu Chowdary Adsumilli ,  David Newman

IPC: H04N19/30 ,  H04N19/29 ,  H04N19/167 ,  H04N19/146 ,  H04N19/59 ,  H04N19/187

CPC classification number: H04N19/30 ,  H04N19/146 ,  H04N19/167 ,  H04N19/187 ,  H04N19/29 ,  H04N19/59

Abstract: Apparatus and methods for digital video data compression via a scalable, multi-resolution approach. In one embodiment, the video content may be encoded using a multi-resolution and/or multi-quality scalable coding approach that reduces computational and/or energy load on a client device. In one implementation, a low fidelity image is obtained based on a first full resolution image. The low fidelity image may be encoded to obtain a low fidelity bitstream. A second full resolution image may be obtained based on the low fidelity bitstream. A portion of a difference image obtained based on the second full resolution image and the first full resolution may be encoded to obtain a high fidelity bitstream. The low fidelity bitstream and the high fidelity bitstream may be provided to e.g., a receiving device.

公开(公告)号：US09818169B2

公开(公告)日：2017-11-14

申请号：US15606721

申请日：2017-05-26

Applicant: GoPro, Inc.

Inventor： Scott Patrick Campbell ,  Paul Mobbs ,  Balineedu Chowdary Adsumilli ,  Sumit Chawla

IPC: H04N5/232 ,  G06T1/20 ,  G06T3/40 ,  H04N5/374 ,  H04N19/102 ,  H04N19/42 ,  H04N9/804

CPC classification number: G06T1/20 ,  G06T3/4015 ,  H04N1/6019 ,  H04N1/6027 ,  H04N5/232 ,  H04N5/23212 ,  H04N5/23216 ,  H04N5/23222 ,  H04N5/23229 ,  H04N5/23241 ,  H04N5/23245 ,  H04N5/23254 ,  H04N5/23267 ,  H04N5/23296 ,  H04N5/2353 ,  H04N5/247 ,  H04N5/374 ,  H04N5/378 ,  H04N9/045 ,  H04N9/09 ,  H04N9/735 ,  H04N9/8042 ,  H04N19/102 ,  H04N19/12 ,  H04N19/132 ,  H04N19/156 ,  H04N19/164 ,  H04N19/172 ,  H04N19/186 ,  H04N19/1883 ,  H04N19/33 ,  H04N19/42 ,  H04N19/423 ,  H04N19/44 ,  H04N19/517 ,  H04N19/63 ,  H04N19/91

Abstract: An image capture accelerator performs accelerated processing of image data. In one embodiment, the image capture accelerator includes accelerator circuitry including a pre-processing engine and a compression engine. The pre-processing engine is configured to perform accelerated processing on received image data, and the compression engine is configured to compress processed image data received from the pre-processing engine. In one embodiment, the image capture accelerator further includes a demultiplexer configured to receive image data captured by an image sensor array implemented within, for example, an image sensor chip. The demultiplexer may output the received image data to an image signal processor when the image data is captured by the image sensor array in a standard capture mode, and may output the received image data to the accelerator circuitry when the image data is captured by the image sensor array in an accelerated capture mode.

公开(公告)号：US09786077B2

公开(公告)日：2017-10-10

申请号：US14872063

申请日：2015-09-30

Applicant: GoPro, Inc.

Inventor： Balineedu Chowdary Adsumilli ,  Timothy MacMillan

IPC: G06K9/36 ,  G06T11/60 ,  G06T3/40 ,  G06T7/73 ,  G06T7/50

CPC classification number: G06T11/60 ,  G06T3/4038 ,  G06T7/50 ,  G06T7/73 ,  G06T2207/20021 ,  G06T2207/20221 ,  G06T2207/30244

Abstract: A unified image processing algorithm results in better post-processing quality for combined images that are made up of multiple single-capture images. To ensure that each single-capture image is processed in the context of the entire combined image, the combined image is analyzed to determine portions of the image (referred to as “zones”) that should be processed with the same parameters for various image processing algorithms. These zones may be determined based on the content of the combined image. Alternatively, these zones may be determined based on the position of each single-capture image with respect to the entire combined image or the other single-capture images. Once zones and their corresponding image processing parameters are determined for the combined image, they are translated to corresponding zones each of the single-capture images. Finally, the image processing algorithms are applied to each of the single-capture images using the zone-specified parameters.

公开(公告)号：US20170262956A1

公开(公告)日：2017-09-14

申请号：US15606721

申请日：2017-05-26

Applicant: GoPro, Inc.

Inventor： Scott Patrick Campbell ,  Paul Mobbs ,  Balineedu Chowdary Adsumilli ,  Sumit Chawla

IPC: G06T1/20 ,  G06T3/40 ,  H04N5/374 ,  H04N5/232

CPC classification number: G06T1/20 ,  G06T3/4015 ,  H04N1/6019 ,  H04N1/6027 ,  H04N5/232 ,  H04N5/23212 ,  H04N5/23216 ,  H04N5/23222 ,  H04N5/23229 ,  H04N5/23241 ,  H04N5/23245 ,  H04N5/23254 ,  H04N5/23267 ,  H04N5/23296 ,  H04N5/2353 ,  H04N5/247 ,  H04N5/374 ,  H04N5/378 ,  H04N9/045 ,  H04N9/09 ,  H04N9/735 ,  H04N9/8042 ,  H04N19/102 ,  H04N19/12 ,  H04N19/132 ,  H04N19/156 ,  H04N19/164 ,  H04N19/172 ,  H04N19/186 ,  H04N19/1883 ,  H04N19/33 ,  H04N19/42 ,  H04N19/423 ,  H04N19/44 ,  H04N19/517 ,  H04N19/63 ,  H04N19/91

Abstract: An image capture accelerator performs accelerated processing of image data. In one embodiment, the image capture accelerator includes accelerator circuitry including a pre-processing engine and a compression engine. The pre-processing engine is configured to perform accelerated processing on received image data, and the compression engine is configured to compress processed image data received from the pre-processing engine. In one embodiment, the image capture accelerator further includes a demultiplexer configured to receive image data captured by an image sensor array implemented within, for example, an image sensor chip. The demultiplexer may output the received image data to an image signal processor when the image data is captured by the image sensor array in a standard capture mode, and may output the received image data to the accelerator circuitry when the image data is captured by the image sensor array in an accelerated capture mode.

公开(公告)号：US09681046B2

公开(公告)日：2017-06-13

申请号：US14754697

申请日：2015-06-30

Applicant: GoPro, Inc.

Inventor： Balineedu Chowdary Adsumilli ,  Scott Patrick Campbell

IPC: H04N5/232 ,  H04N5/265 ,  G06K9/52 ,  G06K7/00 ,  G06K9/00 ,  G06K9/46 ,  G06T7/40 ,  G06T7/50

CPC classification number: H04N5/23238 ,  G06K9/00268 ,  G06K9/46 ,  G06K9/52 ,  G06K9/6202 ,  G06T3/4038 ,  G06T7/40 ,  G06T7/50 ,  H04N5/23219 ,  H04N5/247

Abstract: Images captured by multi-camera arrays with overlap regions can be stitched together using image stitching operations. An image stitching operation can be selected for use in stitching images based on a number of factors. An image stitching operation can be selected based on a view window location of a user viewing the images to be stitched together. An image stitching operation can also be selected based on a type, priority, or depth of image features located within an overlap region. Finally, an image stitching operation can be selected based on a likelihood that a particular image stitching operation will produce visible artifacts. Once a stitching operation is selected, the images corresponding to the overlap region can be stitched using the stitching operation, and the stitched image can be stored for subsequent access.

公开(公告)号：US09652667B2

公开(公告)日：2017-05-16

申请号：US14637193

申请日：2015-03-03

Applicant: GoPro, Inc.

Inventor： Timothy MacMillan ,  David A. Newman ,  Balineedu Chowdary Adsumilli

IPC: H04N5/93 ,  G06K9/00 ,  G06T3/00 ,  H04N21/233 ,  H04N21/234 ,  G06F17/30 ,  H04L29/06 ,  H04N13/00 ,  G03B37/04 ,  H04N5/232

CPC classification number: H04N5/23238 ,  G03B37/04 ,  G06F17/30858 ,  G06K9/00281 ,  G06K9/00355 ,  G06K9/00711 ,  G06T3/0062 ,  G06T7/246 ,  G06T2207/10016 ,  G06T2207/30201 ,  H04L65/00 ,  H04L65/4084 ,  H04L65/602 ,  H04L67/42 ,  H04N13/106 ,  H04N21/233 ,  H04N21/23418

Abstract: A spherical content capture system captures spherical video content. A spherical video sharing platform enables users to share the captured spherical content and enables users to access spherical content shared by other users. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest.

公开(公告)号：US20170110155A1

公开(公告)日：2017-04-20

申请号：US15396385

申请日：2016-12-30

Applicant: GoPro, Inc.

Inventor： Scott Patrick Campbell ,  Zhinian Jing ,  Timothy Macmillan ,  David A. Newman ,  Balineedu Chowdary Adsumilli

IPC: G11B27/30 ,  H04N9/806 ,  H04N9/82 ,  H04N5/232

CPC classification number: G11B27/3081 ,  H04N5/23238 ,  H04N5/77 ,  H04N9/806 ,  H04N9/8205 ,  H04N9/8211

Abstract: A spherical content capture system captures spherical video and audio content. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest. For each sub-frame, a corresponding portion of an audio track is generated that includes a directional audio signal having a directionality based on the selected sub-frame.

公开(公告)号：US09628704B2

公开(公告)日：2017-04-18

申请号：US15049010

申请日：2016-02-20

Applicant: GoPro, Inc.

Inventor： Scott Patrick Campbell ,  Paul Mobbs ,  Balineedu Chowdary Adsumilli ,  Sumit Chawla

IPC: H04N5/232 ,  H04N19/91 ,  H04N19/63 ,  H04N19/102 ,  H04N19/169 ,  G06T3/40 ,  H04N5/378 ,  H04N9/04 ,  H04N5/235 ,  H04N9/73 ,  H04N19/164 ,  H04N19/172 ,  H04N5/247 ,  H04N19/12 ,  H04N1/60 ,  H04N9/09

CPC classification number: G06T1/20 ,  G06T3/4015 ,  H04N1/6019 ,  H04N1/6027 ,  H04N5/232 ,  H04N5/23212 ,  H04N5/23216 ,  H04N5/23222 ,  H04N5/23229 ,  H04N5/23241 ,  H04N5/23245 ,  H04N5/23254 ,  H04N5/23267 ,  H04N5/23296 ,  H04N5/2353 ,  H04N5/247 ,  H04N5/374 ,  H04N5/378 ,  H04N9/045 ,  H04N9/09 ,  H04N9/735 ,  H04N9/8042 ,  H04N19/102 ,  H04N19/12 ,  H04N19/132 ,  H04N19/156 ,  H04N19/164 ,  H04N19/172 ,  H04N19/186 ,  H04N19/1883 ,  H04N19/33 ,  H04N19/42 ,  H04N19/423 ,  H04N19/44 ,  H04N19/517 ,  H04N19/63 ,  H04N19/91

Abstract: An image capture accelerator performs accelerated processing of image data. In one embodiment, the image capture accelerator includes accelerator circuitry including a pre-processing engine and a compression engine. The pre-processing engine is configured to perform accelerated processing on received image data, and the compression engine is configured to compress processed image data received from the pre-processing engine. In one embodiment, the image capture accelerator further includes a demultiplexer configured to receive image data captured by an image sensor array implemented within, for example, an image sensor chip. The demultiplexer may output the received image data to an image signal processor when the image data is captured by the image sensor array in a standard capture mode, and may output the received image data to the accelerator circuitry when the image data is captured by the image sensor array in an accelerated capture mode.

公开(公告)号：US20170094194A1

公开(公告)日：2017-03-30

申请号：US15080292

申请日：2016-03-24

Applicant: GoPro, Inc.

Inventor： Balineedu Chowdary Adsumilli ,  Ryan Lustig

IPC: H04N5/272 ,  G06T7/20 ,  H04N13/00 ,  H04N5/235 ,  G06T5/00 ,  G06T7/00

CPC classification number: H04N5/272 ,  G06T5/002 ,  G06T7/11 ,  G06T7/143 ,  G06T7/174 ,  G06T7/194 ,  G06T7/20 ,  G06T7/254 ,  G06T11/60 ,  G06T15/503 ,  G06T2207/10016 ,  G06T2207/10021 ,  G06T2207/20036 ,  H04N5/2356 ,  H04N13/128 ,  H04N2013/0085 ,  H04N2013/0092

Abstract: A processing device generates composite images from a sequence of images. The composite images may be used as frames of video. A foreground/background segmentation is performed at selected frames to extract a plurality of foreground object images depicting a foreground object at different locations as it moves across a scene. The foreground object images are stored to a foreground object list. The foreground object images in the foreground object list are overlaid onto subsequent video frames that follow the respective frames from which they were extracted, thereby generating a composite video.