-
公开(公告)号:US10742885B1
公开(公告)日:2020-08-11
申请号:US16512105
申请日:2019-07-15
Applicant: GoPro, Inc.
Inventor: Sophana Kok
Abstract: Visual content may be captured by an image capture device during a capture duration. The rotational positions of the image capture device may change during the capture duration. The rotational positions of the image capture device may be smoothed based on a look ahead of a rotation constraint. A punchout of the visual content may be determined based on the smoothed rotational positions. The punchout of the visual content may be used to generate stabilized visual content.
-
公开(公告)号:US20200020087A1
公开(公告)日:2020-01-16
申请号:US16556898
申请日:2019-08-30
Applicant: GoPro, Inc.
Inventor: Bruno Cesar Douady-Pleven , Sandeep Doshi , Sophana Kok
IPC: G06T5/50 , H04N13/271 , G06T5/20
Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving, by an image signal processor, one or more input image signals from one or more image sensors; determining a mapping based on the input image signal(s), wherein the mapping includes records that associate image portions of an output image with corresponding image portions of the input image signal(s); sorting the records of the mapping according to an order of the corresponding image portions of the input image signal(s); applying, by the image signal processor, image processing to image portions of the input image signal(s) to determine image portions of one or more processed images in the order; and determining, by the image signal processor, the image portions of the output image based at least in part on the mapping and the corresponding image portions of the processed image(s) in the order.
-
公开(公告)号:US20230049084A1
公开(公告)日:2023-02-16
申请号:US17444154
申请日:2021-07-30
Applicant: GoPro, Inc.
Inventor: Nicolas Rahmouni , Thomas Armel Derbanne , Sophana Kok
Abstract: Systems and methods are used for calibrating a time difference between an image signal processor (ISP) and an inertial measurement unit (IMU) of an image capture device. An image capture device includes a lens, an image sensor, an IMU, and an ISP. The image sensor detects images as frames and the IMU captures motion data. The ISP detects one or more key points on the frames and matches the one or more key points between the frames. The ISP computes one or more calibration parameters. The one or more calibration parameters are based on the matched key points and a time difference between the ISP and the IMU. The ISP performs a calibration using the calibration parameters.
-
公开(公告)号:US20190364233A1
公开(公告)日:2019-11-28
申请号:US16538631
申请日:2019-08-12
Applicant: GoPro, Inc.
Inventor: Adrien Fontvielle , Sophana Kok
Abstract: Image captured with an image capture device with a rolling shutter may be deformed due to changes in imaging sensor orientation during image capture. Image deformities may occur due to rolling shutter that exposes rows of pixels to light at slightly different times during image capture. Deformities such as wobble, for example, and/or other deformities may be corrected by constructing an output image. The output image may be constructed by determining corresponding pixels within the input image. The location of the input pixel may be determined by performing one or more fixed point iterations to identify one or more input pixels within the input image. A value of the output pixel within the output image may be determined based on a value of a corresponding pixel within the input image.
-
公开(公告)号:US11064110B2
公开(公告)日:2021-07-13
申请号:US16556898
申请日:2019-08-30
Applicant: GoPro, Inc.
Inventor: Bruno Cesar Douady-Pleven , Sandeep Doshi , Sophana Kok
IPC: H04N5/232 , H04N5/247 , H04N17/00 , G06T7/80 , G06T3/40 , H04N19/10 , H04N19/136 , H04N19/176 , H04N19/423 , H04N19/70 , H04N19/90 , H04N13/271 , G06T5/20 , G06T5/50 , H04N19/85 , G06T3/00 , H04N5/225 , H04N5/357 , H04N13/239 , H04N13/122 , G06T5/00
Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving, by an image signal processor, one or more input image signals from one or more image sensors; determining a mapping based on the input image signal(s), wherein the mapping includes records that associate image portions of an output image with corresponding image portions of the input image signal(s); sorting the records of the mapping according to an order of the corresponding image portions of the input image signal(s); applying, by the image signal processor, image processing to image portions of the input image signal(s) to determine image portions of one or more processed images in the order; and determining, by the image signal processor, the image portions of the output image based at least in part on the mapping and the corresponding image portions of the processed image(s) in the order.
-
公开(公告)号:US10404926B2
公开(公告)日:2019-09-03
申请号:US15399269
申请日:2017-01-05
Applicant: GoPro, Inc.
Inventor: Bruno Cesar Douady-Pleven , Sandeep Doshi , Sophana Kok
IPC: H04N5/357 , H04N5/247 , H04N17/00 , H04N19/85 , G06T3/00 , H04N5/225 , G06T3/40 , H04N5/232 , G06T7/80
Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving, by an image signal processor, one or more input image signals from one or more image sensors; determining a mapping based on the input image signal(s), wherein the mapping includes records that associate image portions of an output image with corresponding image portions of the input image signal(s); sorting the records of the mapping according to an order of the corresponding image portions of the input image signal(s); applying, by the image signal processor, image processing to image portions of the input image signal(s) to determine image portions of one or more processed images in the order; and determining, by the image signal processor, the image portions of the output image based at least in part on the mapping and the corresponding image portions of the processed image(s) in the order.
-
公开(公告)号:US20230046465A1
公开(公告)日:2023-02-16
申请号:US17444153
申请日:2021-07-30
Applicant: GoPro, Inc.
Inventor: Nicolas Rahmouni , Thomas Armel Derbanne , Sophana Kok
Abstract: Holistic systems and methods are used for calibrating image capture devices. An image capture device includes a lens, an image sensor, an inertial measurement unit (IMU), and an image signal processor (ISP). The image sensor detects images as frames and the IMU captures motion data. The ISP detects one or more key points on the frames and matches the one or more key points between the frames. The ISP computes one or more calibration parameters. The one or more calibration parameters are based on the matched key points and a model. The model includes an optical component, an IMU component, and a sensor component. The ISP performs a calibration using the calibration parameters.
-
公开(公告)号:US20200177827A1
公开(公告)日:2020-06-04
申请号:US16784656
申请日:2020-02-07
Applicant: GoPro, Inc.
Inventor: Adrien Fontvielle , Sophana Kok
Abstract: Image captured with an image capture device with a rolling shutter may be deformed due to changes in imaging sensor orientation during image capture. Image deformities may occur due to rolling shutter that exposes rows of pixels to light at slightly different times during image capture. Deformities such as wobble, for example, and/or other deformities may be corrected by constructing an output image. The output image may be constructed by determining corresponding pixels within the input image. The location of the input pixel may be determined by performing one or more fixed point iterations to identify one or more input pixels within the input image. A value of the output pixel within the output image may be determined based on a value of a corresponding pixel within the input image.
-
公开(公告)号:US20170347044A1
公开(公告)日:2017-11-30
申请号:US15399269
申请日:2017-01-05
Applicant: GoPro, Inc.
Inventor: Bruno Cesar Douady-Pleven , Sandeep Doshi , Sophana Kok
CPC classification number: H04N5/3572 , G06T3/0093 , G06T3/4038 , G06T7/85 , G06T2207/10016 , H04N5/2258 , H04N5/23238 , H04N5/247 , H04N17/002 , H04N19/85
Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving, by an image signal processor, one or more input image signals from one or more image sensors; determining a mapping based on the input image signal(s), wherein the mapping includes records that associate image portions of an output image with corresponding image portions of the input image signal(s); sorting the records of the mapping according to an order of the corresponding image portions of the input image signal(s); applying, by the image signal processor, image processing to image portions of the input image signal(s) to determine image portions of one or more processed images in the order; and determining, by the image signal processor, the image portions of the output image based at least in part on the mapping and the corresponding image portions of the processed image(s) in the order.
-
公开(公告)号:US11153489B2
公开(公告)日:2021-10-19
申请号:US16987829
申请日:2020-08-07
Applicant: GoPro, Inc.
Inventor: Sophana Kok
Abstract: Visual content may be captured by an image capture device during a capture duration. The rotational positions of the image capture device may change during the capture duration. The rotational positions of the image capture device may be smoothed based on a look ahead of a rotation constraint. A punchout of the visual content may be determined based on the smoothed rotational positions. The punchout of the visual content may be used to generate stabilized visual content.
-
-
-
-
-
-
-
-
-