-
公开(公告)号:US20180130172A1
公开(公告)日:2018-05-10
申请号:US15727568
申请日:2017-10-07
Applicant: GoPro, Inc.
Inventor: Scott Patrick Campbell , Paul Mobbs , Balineedu Chowdary Adsumilli , Sumit Chawla
CPC classification number: G06T1/20 , G06T3/4015 , H04N1/6019 , H04N1/6027 , H04N5/232 , H04N5/23212 , H04N5/23216 , H04N5/23222 , H04N5/23229 , H04N5/23241 , H04N5/23245 , H04N5/23254 , H04N5/23267 , H04N5/23296 , H04N5/2353 , H04N5/247 , H04N5/374 , H04N5/378 , H04N9/045 , H04N9/09 , H04N9/735 , H04N9/8042 , H04N19/102 , H04N19/12 , H04N19/132 , H04N19/156 , H04N19/164 , H04N19/172 , H04N19/186 , H04N19/1883 , H04N19/33 , H04N19/42 , H04N19/423 , H04N19/44 , H04N19/517 , H04N19/63 , H04N19/91
Abstract: An image capture accelerator performs accelerated processing of image data. In one embodiment, the image capture accelerator includes accelerator circuitry including a pre-processing engine and a compression engine. The pre-processing engine is configured to perform accelerated processing on received image data, and the compression engine is configured to compress processed image data received from the pre-processing engine. In one embodiment, the image capture accelerator further includes a demultiplexer configured to receive image data captured by an image sensor array implemented within, for example, an image sensor chip. The demultiplexer may output the received image data to an image signal processor when the image data is captured by the image sensor array in a standard capture mode, and may output the received image data to the accelerator circuitry when the image data is captured by the image sensor array in an accelerated capture mode.
-
公开(公告)号:US09877036B2
公开(公告)日:2018-01-23
申请号:US14598135
申请日:2015-01-15
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli
IPC: H04N19/467 , H04N19/63 , H04N1/32 , G06T1/00
CPC classification number: H04N19/467 , G06T1/0028 , G06T2201/0052 , G06T2201/0083 , G06T2201/0202 , H04N1/32187 , H04N1/32277 , H04N1/32288 , H04N19/63
Abstract: Watermark data is converted to watermark coefficients, which may be embedded in an image by converting the image to a frequency domain, embedding the watermark in image coefficients corresponding to medium-frequency components, and converting the modified coefficients to the spatial domain. The watermark data is extracted from the modified image by converting the modified image to a frequency domain, extracting the watermark coefficients from the image coefficients, and determining the watermark data from the watermark coefficients. The watermark data may be truncated image data bits such as truncated least significant data bits. After extraction from the watermark, the truncated image data bits may be combined with data bits representing the original image to increase the bit depth of the image. Watermark data may include audio data portions corresponding to a video frame, reference frames temporally proximate to a video frame, high-frequency content, sensor calibration information, or other image data.
-
公开(公告)号:US20170295318A1
公开(公告)日:2017-10-12
申请号:US15595881
申请日:2017-05-15
Applicant: GOPRO, INC.
Inventor: Timothy MacMillan , David A. Newman , Balineedu Chowdary Adsumilli
IPC: H04N5/232 , G06F17/30 , G06T3/00 , G06T7/246 , H04N13/00 , H04N21/234 , H04N21/233 , G03B37/04 , G06K9/00 , H04L29/06
CPC classification number: H04N5/23238 , G03B37/04 , G06F17/30858 , G06K9/00281 , G06K9/00355 , G06K9/00711 , G06T3/0062 , G06T7/246 , G06T2207/10016 , G06T2207/30201 , H04L65/00 , H04L65/4084 , H04L65/602 , H04L67/42 , H04N13/106 , H04N21/233 , H04N21/23418
Abstract: A spherical content capture system captures spherical video content. A spherical video sharing platform enables users to share the captured spherical content and enables users to access spherical content shared by other users. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest.
-
公开(公告)号:US09749738B1
公开(公告)日:2017-08-29
申请号:US15187700
申请日:2016-06-20
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Timothy Macmillan
CPC classification number: H04R3/005 , G01S3/803 , G01S5/16 , G01S5/18 , G06T7/2093 , G10L25/57 , H04R2420/07 , H04R2420/09
Abstract: Disclosed is a system and method for generating a model of the geometric relationships between various audio sources recorded by a multi-camera system. The spatial audio scene module associates source signals, extracted from recorded audio, of audio sources to visual objects identified in videos recorded by one or more cameras. This association may be based on estimated positions of the audio sources based on relative signal gains and delays of the source signal received at each microphone. The estimated positions of audio sources are tracked indirectly by tracking the associated visual objects with computer vision. A virtual microphone module may receive a position for a virtual microphone and synthesize a signal corresponding to the virtual microphone position based on the estimated positions of the audio sources.
-
公开(公告)号:US20170237983A1
公开(公告)日:2017-08-17
申请号:US15334213
申请日:2016-10-25
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Adeel Abbas , David Newman
IPC: H04N19/124 , H04N19/154 , H04N19/17
CPC classification number: H04N19/124 , H04N19/154 , H04N19/167 , H04N19/17 , H04N21/21805 , H04N21/234345 , H04N21/23439 , H04N21/816
Abstract: Systems and methods for providing video content using spatially adaptive video encoding. Panoramic and/or virtual reality content may be viewed by a client device using a viewport with viewing dimension(s) configured smaller than available dimension(s) of the content. Client device may include a portable media device characterized by given energy and/or computational resources. Video content may be encoded using spatially varying encoding. For image playback, portions of panoramic image may be pre-encoded using multiple quality bands. Pre-encoded image portions, matching the viewport, may be provided and reduce computational and/or energy load on the client device during consumption of panoramic content. Quality distribution may include gradual quality transition area allowing for small movements of the viewport without triggering image re-encoding. Larger movements of the viewport may automatically trigger transition to another spatial encoding distribution.
-
公开(公告)号:US09736404B2
公开(公告)日:2017-08-15
申请号:US15396295
申请日:2016-12-30
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Timothy Macmillan
CPC classification number: H04N5/3415 , G01B2210/52 , G03G15/36 , G06T5/008 , G06T2207/20208 , H04N5/23238 , H04N5/247 , H04N5/265 , H04N5/355 , H04N9/646 , H04N9/77
Abstract: Use of separate range tone mapping for combined images can help minimize loss of image information in scenes that have drastically different luminance values, i.e., scenes that have both bright and shadowed regions. Separate range tone mapping is particularly useful for combined images, such as those from spherical camera systems, which may have a higher probability of including luminance variability. The resulting increased bit depth of separate range tone mapping can make the transition between different images that make up a combined image more subtle. Each of a plurality of images that make up a combined image can use a different tone map that is optimized for the particular image data of the image. Multiple tone maps that are applied to overlapping regions of the plurality of images can subsequently be combined to expand the bit depth of the overlapping regions.
-
公开(公告)号:US09635262B2
公开(公告)日:2017-04-25
申请号:US15282423
申请日:2016-09-30
Applicant: GoPro, Inc.
Inventor: Scott Patrick Campbell , Paul Mobbs , Balineedu Chowdary Adsumilli , Sumit Chawla
IPC: H04N5/232 , G06T3/40 , H04N5/247 , H04N19/102 , H04N19/172 , H04N19/169 , H04N1/60 , H04N19/91 , H04N19/63
CPC classification number: G06T1/20 , G06T3/4015 , H04N1/6019 , H04N1/6027 , H04N5/232 , H04N5/23212 , H04N5/23216 , H04N5/23222 , H04N5/23229 , H04N5/23241 , H04N5/23245 , H04N5/23254 , H04N5/23267 , H04N5/23296 , H04N5/2353 , H04N5/247 , H04N5/374 , H04N5/378 , H04N9/045 , H04N9/09 , H04N9/735 , H04N9/8042 , H04N19/102 , H04N19/12 , H04N19/132 , H04N19/156 , H04N19/164 , H04N19/172 , H04N19/186 , H04N19/1883 , H04N19/33 , H04N19/42 , H04N19/423 , H04N19/44 , H04N19/517 , H04N19/63 , H04N19/91
Abstract: An image capture accelerator performs accelerated processing of image data. In one embodiment, the image capture accelerator includes accelerator circuitry including a pre-processing engine and a compression engine. The pre-processing engine is configured to perform accelerated processing on received image data, and the compression engine is configured to compress processed image data received from the pre-processing engine. In one embodiment, the image capture accelerator further includes a demultiplexer configured to receive image data captured by an image sensor array implemented within, for example, an image sensor chip. The demultiplexer may output the received image data to an image signal processor when the image data is captured by the image sensor array in a standard capture mode, and may output the received image data to the accelerator circuitry when the image data is captured by the image sensor array in an accelerated capture mode.
-
公开(公告)号:US20170094196A1
公开(公告)日:2017-03-30
申请号:US15080302
申请日:2016-03-24
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Ryan Lustig
CPC classification number: H04N5/272 , G06T5/002 , G06T7/11 , G06T7/143 , G06T7/174 , G06T7/194 , G06T7/20 , G06T7/254 , G06T11/60 , G06T15/503 , G06T2207/10016 , G06T2207/10021 , G06T2207/20036 , H04N5/2356 , H04N13/128 , H04N2013/0085 , H04N2013/0092
Abstract: A processing device generates composite images from a sequence of images. The composite images may be used as frames of video. A foreground/background segmentation is performed at selected frames to extract a plurality of foreground object images depicting a foreground object at different locations as it moves across a scene. The foreground object images are stored to a foreground object list. The foreground object images in the foreground object list are overlaid onto subsequent video frames that follow the respective frames from which they were extracted, thereby generating a composite video.
-
19.
公开(公告)号:US20170094195A1
公开(公告)日:2017-03-30
申请号:US15080299
申请日:2016-03-24
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Ryan Lustig
CPC classification number: H04N5/272 , G06T5/002 , G06T7/11 , G06T7/143 , G06T7/174 , G06T7/194 , G06T7/20 , G06T7/254 , G06T11/60 , G06T15/503 , G06T2207/10016 , G06T2207/10021 , G06T2207/20036 , H04N5/2356 , H04N13/128 , H04N2013/0085 , H04N2013/0092
Abstract: A processing device generates composite images from a sequence of images. The composite images may be used as frames of video. A foreground/background segmentation is performed at selected frames to extract a plurality of foreground object images depicting a foreground object at different locations as it moves across a scene. The foreground object images are stored to a foreground object list. The foreground object images in the foreground object list are overlaid onto subsequent video frames that follow the respective frames from which they were extracted, thereby generating a composite video.
-
公开(公告)号:US20170091970A1
公开(公告)日:2017-03-30
申请号:US14872063
申请日:2015-09-30
Applicant: GoPro, Inc.
Inventor: Balineedu Chowdary Adsumilli , Timothy MacMillan
CPC classification number: G06T11/60 , G06T3/4038 , G06T7/50 , G06T7/73 , G06T2207/20021 , G06T2207/20221 , G06T2207/30244
Abstract: A unified image processing algorithm results in better post-processing quality for combined images that are made up of multiple single-capture images. To ensure that each single-capture image is processed in the context of the entire combined image, the combined image is analyzed to determine portions of the image (referred to as “zones”) that should be processed with the same parameters for various image processing algorithms. These zones may be determined based on the content of the combined image. Alternatively, these zones may be determined based on the position of each single-capture image with respect to the entire combined image or the other single-capture images. Once zones and their corresponding image processing parameters are determined for the combined image, they are translated to corresponding zones each of the single-capture images. Finally, the image processing algorithms are applied to each of the single-capture images using the zone-specified parameters.
-
-
-
-
-
-
-
-
-