-
公开(公告)号:US20190297283A1
公开(公告)日:2019-09-26
申请号:US16303428
申请日:2017-05-25
Applicant: Bruno Cesar DOUADY , Sandeep DOSHI , GoPro, Inc.
Inventor: Bruno César Douady , Sandeep Doshi
IPC: H04N5/357 , G06T7/80 , H04N5/232 , G06T3/40 , H04N5/225 , H04N5/247 , H04N19/85 , G06T3/00 , H04N17/00
Abstract: Image signal processing including generating image signal processing based encoding hints for motion estimation may include an image signal processor obtaining an input image portion of an input image from the input image signal, generating motion information for the input image portion, processing the input image portion based on the motion information, outputting processed image data, and outputting the motion information as encoding hints, such that the motion information is accessible by an encoder for generating an encoded output bitstream by obtaining the processed image data as source image data, obtaining the motion information, generating prediction data for encoding the source image data based on the motion information, generating encoded image data based on the prediction data, and including the encoded image data in an encoded output bitstream.
-
公开(公告)号:US10163029B2
公开(公告)日:2018-12-25
申请号:US15593629
申请日:2017-05-12
Applicant: GoPro, Inc.
Inventor: Sandeep Doshi
IPC: G06K9/46 , H04N9/04 , H04N19/124 , G06T1/20 , H04N19/186 , H04N19/85 , G06T7/90 , G06K9/38 , G06T7/40 , H04N5/232 , H04N5/77 , H04N9/804
Abstract: A camera system processes images based on image luminance data. The camera system includes an image sensor, an image pipeline, an encoder and a memory. The image sensor converts light incident upon the image sensor into raw image data. The image pipeline converts raw image data into color-space image data and calculates luminance levels of the color-space image data. The encoder can determine one or more of quantization levels, determining GOP structure or reference frame spacing for the color-space image data based on the luminance levels. The memory stores the color-space image data and the luminance levels.
-
公开(公告)号:US20180176573A1
公开(公告)日:2018-06-21
申请号:US15385383
申请日:2016-12-20
Applicant: GoPro, Inc.
Inventor: Sumit Chawla , Adeel Abbas , Sandeep Doshi
IPC: H04N19/137 , G06K9/62 , G06K9/52
CPC classification number: H04N19/137 , G06K9/00744 , G06K9/4642 , G06K9/4652 , G06K9/52 , G06K9/6201 , H04N19/105 , H04N19/107 , H04N19/124 , H04N19/136 , H04N19/142 , H04N19/154 , H04N19/436 , H04N19/57
Abstract: Methods and apparatus for the encoding of imaging data using pre-stored imaging statistics. Many extant image capture devices, including without limitation, smartphones, handheld video cameras, and other types of image capture devices, typically include, for example, auto-exposure (AE), auto-white balance (AWB) and auto-focus (AF) modules in an image signal processing (ISP) pipeline. These modules within the ISP pipeline generate various imaging statistics which can be repurposed for the encoding process of video data. These imaging statistics can be utilized for a number of encoding processes including, without limitation, adjusting an encoder parameter value for the encoding process, adjustment of the motion estimation search range, insertion of intra-frames within the video data and the determination of whether to use explicit or implicit weighting prediction.
-
公开(公告)号:US11153568B2
公开(公告)日:2021-10-19
申请号:US16721136
申请日:2019-12-19
Applicant: GoPro, Inc.
Inventor: Sandeep Doshi
IPC: H04N19/126 , H04N19/177 , H04N19/122 , H04N19/105 , H04N19/159 , G06K9/62 , H04N7/18
Abstract: Video information defining video content to be encoded may be obtained. Scene composition information for the video content may be obtained. The scene composition information may be determined by a convolutional neural network based on visuals represented within the video content. The video content may be encoded based on the scene composition information. The encoding of the video content may generate encoded video information defining the encoded video content.
-
公开(公告)号:US11064110B2
公开(公告)日:2021-07-13
申请号:US16556898
申请日:2019-08-30
Applicant: GoPro, Inc.
Inventor: Bruno Cesar Douady-Pleven , Sandeep Doshi , Sophana Kok
IPC: H04N5/232 , H04N5/247 , H04N17/00 , G06T7/80 , G06T3/40 , H04N19/10 , H04N19/136 , H04N19/176 , H04N19/423 , H04N19/70 , H04N19/90 , H04N13/271 , G06T5/20 , G06T5/50 , H04N19/85 , G06T3/00 , H04N5/225 , H04N5/357 , H04N13/239 , H04N13/122 , G06T5/00
Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving, by an image signal processor, one or more input image signals from one or more image sensors; determining a mapping based on the input image signal(s), wherein the mapping includes records that associate image portions of an output image with corresponding image portions of the input image signal(s); sorting the records of the mapping according to an order of the corresponding image portions of the input image signal(s); applying, by the image signal processor, image processing to image portions of the input image signal(s) to determine image portions of one or more processed images in the order; and determining, by the image signal processor, the image portions of the output image based at least in part on the mapping and the corresponding image portions of the processed image(s) in the order.
-
公开(公告)号:US20190289322A1
公开(公告)日:2019-09-19
申请号:US15462580
申请日:2017-03-17
Applicant: GOPRO, INC.
Inventor: Adeel Abbas , Sandeep Doshi , Sumit Chawla
IPC: H04N19/593 , H04N19/134 , H04N19/51 , H04N19/86 , H04N19/114 , H04N19/177 , H04N5/232
Abstract: Systems and methods for utilizing on-camera sensor information to improve video and/or image encoding quality are discussed herein. Specifically, the systems and methods described herein may utilize on-camera sensor information to adaptively adjust an intra frame insertion rate associated with a sequence of frames. The intra frame insertion rate associated with a sequence of frames may be adjusted based on the motion of the image capturing device while capturing the sequence of frames and a predefined motion threshold associated with the intra frame insertion rate of the sequence of frames. In some implementations, the intra frame insertion rate may be adjusted based on the activity being performed during the capture of the sequence of frames. As such, the encoding of one or more frames within a sequence of frames may be adaptively adjusted to better suit the scene depicted by the sequence of frames.
-
公开(公告)号:US10404926B2
公开(公告)日:2019-09-03
申请号:US15399269
申请日:2017-01-05
Applicant: GoPro, Inc.
Inventor: Bruno Cesar Douady-Pleven , Sandeep Doshi , Sophana Kok
IPC: H04N5/357 , H04N5/247 , H04N17/00 , H04N19/85 , G06T3/00 , H04N5/225 , G06T3/40 , H04N5/232 , G06T7/80
Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving, by an image signal processor, one or more input image signals from one or more image sensors; determining a mapping based on the input image signal(s), wherein the mapping includes records that associate image portions of an output image with corresponding image portions of the input image signal(s); sorting the records of the mapping according to an order of the corresponding image portions of the input image signal(s); applying, by the image signal processor, image processing to image portions of the input image signal(s) to determine image portions of one or more processed images in the order; and determining, by the image signal processor, the image portions of the output image based at least in part on the mapping and the corresponding image portions of the processed image(s) in the order.
-
公开(公告)号:US20170339390A1
公开(公告)日:2017-11-23
申请号:US15593630
申请日:2017-05-12
Applicant: GoPro, Inc.
Inventor: Sandeep Doshi
CPC classification number: G06K9/4647 , G06K9/38 , G06K9/4652 , G06T1/20 , G06T7/40 , G06T7/90 , H04N5/23232 , H04N5/77 , H04N9/045 , H04N9/8042 , H04N19/124 , H04N19/186 , H04N19/85
Abstract: A camera system processes images based on image activity data. The camera system includes an image sensor, an image pipeline, an encoder and a memory. The image sensor converts light incident upon the image sensor into raw image data. The image pipeline converts raw image data into color-space image data and calculates activity variances of the color-space image data. The encoder can determine one or more of quantization levels, block type (Intra vs Inter), determining transform size and type, and determining GOP structure or reference frame spacing for the color-space image data based on the activity variances. The memory stores the color-space image data and the activity variances.
-
公开(公告)号:US20200020087A1
公开(公告)日:2020-01-16
申请号:US16556898
申请日:2019-08-30
Applicant: GoPro, Inc.
Inventor: Bruno Cesar Douady-Pleven , Sandeep Doshi , Sophana Kok
IPC: G06T5/50 , H04N13/271 , G06T5/20
Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving, by an image signal processor, one or more input image signals from one or more image sensors; determining a mapping based on the input image signal(s), wherein the mapping includes records that associate image portions of an output image with corresponding image portions of the input image signal(s); sorting the records of the mapping according to an order of the corresponding image portions of the input image signal(s); applying, by the image signal processor, image processing to image portions of the input image signal(s) to determine image portions of one or more processed images in the order; and determining, by the image signal processor, the image portions of the output image based at least in part on the mapping and the corresponding image portions of the processed image(s) in the order.
-
公开(公告)号:US20170345129A1
公开(公告)日:2017-11-30
申请号:US15607152
申请日:2017-05-26
Applicant: GoPro, Inc.
Inventor: Sandeep Doshi , Adeel Abbas
CPC classification number: G06T3/4038 , H04N5/23238 , H04N5/247 , H04N7/181 , H04N9/045
Abstract: Methods and apparatus for the stitching of images from a multi-camera array. In one embodiment, stitching is performed for a first image and a second image with an overlapping field of view by: encoding the first image to produce a first encoded image; encoding the second image to produce a second uncompressed encoded image; stitching the first image with the second image by: decoding the first encoded image to produce a decoded first image; storing the decoded first image in memory; accessing, by a stitching engine, the decoded first image from memory; accessing, by the stitching engine, the second uncompressed encoded image; stitching, by the stitching engine, the decoded first image with the accessed second uncompressed encoded image to produce a stitched image; and outputting, by the stitching engine, the stitched image.
-
-
-
-
-
-
-
-
-