-
公开(公告)号:US20200236280A1
公开(公告)日:2020-07-23
申请号:US16841107
申请日:2020-04-06
Applicant: GoPro, Inc.
Inventor: Antoine Meler , Bruno Cesar Douady-Pleven
Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving a first image from a first image sensor; receiving a second image from a second image sensor; stitching the first image and the second image to obtain a stitched image; identifying an image portion of the stitched image that is positioned on a stitching boundary of the stitched image; and inputting the image portion to a machine learning module to obtain a score, wherein the machine learning module has been trained using training data that included image portions labeled to reflect an absence of stitching and image portions labeled to reflect a presence of stitching, wherein the image portions labeled to reflect a presence of stitching included stitching.
-
公开(公告)号:US11102465B2
公开(公告)日:2021-08-24
申请号:US16786937
申请日:2020-02-10
Applicant: GoPro, Inc.
Inventor: Adrien Fontvielle , Loïc Martin , Antoine Meler
Abstract: First visual information defining first spherical visual content, second visual information defining second spherical visual content, and/or other information may be obtained. Presentation of the first spherical visual content on a display may be effectuated. A spherical transition between the first spherical visual content and the second spherical visual content may be identified. The spherical transition may define a change in presentation of visual content on the display from the first spherical visual content to the second spherical visual content based on a transitional motion within a spherical space and/or other information. A change in presentation of the first spherical visual content on the display to presentation of the second visual content on the display may be effectuated based on the spherical transition and/or other information. The change may be determined based on the transition motion within the spherical space and/or other information.
-
公开(公告)号:US20200092475A1
公开(公告)日:2020-03-19
申请号:US16694834
申请日:2019-11-25
Applicant: GoPro, Inc.
Inventor: Antoine Meler , Thomas Derbanne
Abstract: Multiple images may be combined to obtain a composite image. Individual images may be obtained with different camera sensors and/or at different time instances. In order to obtain the composite image source images may be aligned in order to produce a seamless stitch. Source images may be characterized by a region of overlap. A disparity measure may be determined for pixels along a border region between the source images. A warp transformation may be determined using a refinement process configured to determine displacement of pixels of the border region based on the disparity. Pixel displacement at a given location may be constrained to direction configured tangential to an epipolar line corresponding to the location. The warp transformation may be propagated to pixels of the image. Spatial and/or temporal smoothing may be applied. In order to obtain refined solution, the warp transformation may be determined at multiple spatial scales.
-
公开(公告)号:US20190058811A1
公开(公告)日:2019-02-21
申请号:US15681764
申请日:2017-08-21
Applicant: GoPro, Inc.
Inventor: Bruno César Douady-Pleven , Antoine Meler , Christophe Clienti
CPC classification number: H04N1/3876 , G06T3/0093 , G06T5/005 , H04N5/2258 , H04N5/23238 , H04N5/3532
Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving a first image from a first image sensor; receiving a second image from a second image sensor; determining an electronic rolling shutter correction mapping for the first image and the second image; determining a parallax correction mapping based on the first image and the second image for stitching the first image and the second image; determining a warp mapping based on the parallax correction mapping and the electronic rolling shutter correction mapping, wherein the warp mapping applies the electronic rolling shutter correction mapping after the parallax correction mapping; applying the warp mapping to image data based on the first image and the second image to obtain a composite image; and storing, displaying, or transmitting an output image that is based on the composite image.
-
公开(公告)号:US20180332206A1
公开(公告)日:2018-11-15
申请号:US16041380
申请日:2018-07-20
Applicant: GoPro, Inc.
Inventor: Antoine Meler
CPC classification number: H04N5/2329 , G02B13/06 , G06T3/0018 , G06T3/4038 , H04N5/23238 , H04N5/247 , H04N5/3415 , H04N5/3532 , H04N5/374 , H04N7/181
Abstract: Images may be obtained using a moving camera comprised of two or more rigidly mounted image sensors. Camera motion may change camera orientation when different portions of an image are captured. Pixel acquisition time may be determined based on image exposure duration and position of the pixel in the image array (pixel row index). Orientation of the sensor may at the pixel acquisition time instance may be determined. Image transformation may be performed wherein a given portion of the image may be associated with a respective transformation characterized by the corrected sensor orientation. In some implementations of panoramic image acquisition, multiple source images may be transformed to, e.g., equirectangular plane, using sensor orientation that is corrected for the time of pixel acquisition. Use of orientation correction may improve quality of stitching by, e.g., reducing contrast of border areas between portions of the transformed image obtained by different image sensors.
-
公开(公告)号:US11962736B2
公开(公告)日:2024-04-16
申请号:US17180153
申请日:2021-02-19
Applicant: GoPro, Inc.
Inventor: Bruno César Douady-Pleven , Antoine Meler , Christophe Clienti
IPC: H04N1/387 , G06T3/00 , G06T5/00 , H04N23/45 , H04N23/698 , H04N25/531
CPC classification number: H04N1/3876 , G06T3/0093 , G06T5/005 , H04N23/45 , H04N23/698 , H04N25/531
Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving a first image from a first image sensor; receiving a second image from a second image sensor; determining an electronic rolling shutter correction mapping for the first image and the second image; determining a parallax correction mapping based on the first image and the second image for stitching the first image and the second image; determining a warp mapping based on the parallax correction mapping and the electronic rolling shutter correction mapping, wherein the warp mapping applies the electronic rolling shutter correction mapping after the parallax correction mapping; applying the warp mapping to image data based on the first image and the second image to obtain a composite image; and storing, displaying, or transmitting an output image that is based on the composite image.
-
公开(公告)号:US10999512B2
公开(公告)日:2021-05-04
申请号:US16784627
申请日:2020-02-07
Applicant: GoPro, Inc.
Inventor: Antoine Meler
IPC: H04N5/00 , H04N5/232 , G06T3/00 , G02B13/06 , H04N5/374 , H04N7/18 , H04N5/353 , G06T3/40 , H04N5/341 , H04N5/247
Abstract: Images may be obtained using a moving camera comprised of two or more rigidly mounted image sensors. Camera motion may change camera orientation when different portions of an image are captured. Pixel acquisition time may be determined based on image exposure duration and position of the pixel in the image array (pixel row index). Orientation of the sensor may at the pixel acquisition time instance may be determined. Image transformation may be performed wherein a given portion of the image may be associated with a respective transformation characterized by the corrected sensor orientation. In some implementations of panoramic image acquisition, multiple source images may be transformed to, e.g., equirectangular plane, using sensor orientation that is corrected for the time of pixel acquisition. Use of orientation correction may improve quality of stitching by, e.g., reducing contrast of border areas between portions of the transformed image obtained by different image sensors.
-
公开(公告)号:US20180262683A1
公开(公告)日:2018-09-13
申请号:US15455446
申请日:2017-03-10
Applicant: GoPro, Inc.
Inventor: Antoine Meler , Bruno Cesar Douady-Pleven
CPC classification number: H04N5/23238 , G06T3/4038 , G06T7/13 , G06T7/70 , G06T2207/20081 , H04N5/247 , H04N5/265
Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving a first image from a first image sensor; receiving a second image from a second image sensor; stitching the first image and the second image to obtain a stitched image; identifying an image portion of the stitched image that is positioned on a stitching boundary of the stitched image; and inputting the image portion to a machine learning module to obtain a score, wherein the machine learning module has been trained using training data that included image portions labeled to reflect an absence of stitching and image portions labeled to reflect a presence of stitching, wherein the image portions labeled to reflect a presence of stitching included stitching.
-
公开(公告)号:US09973696B1
公开(公告)日:2018-05-15
申请号:US15263332
申请日:2016-09-12
Applicant: GOPRO, INC.
Inventor: Antoine Meler , Thomas Derbanne
CPC classification number: H04N5/23238 , G06T3/0018 , G06T3/0068 , G06T7/55 , G06T11/60 , H04N5/23229 , H04N5/2353
Abstract: Multiple images may be combined to obtain a composite image. Individual images may be obtained with different camera sensors and/or at different time instances. In order to obtain the composite image source images may be aligned in order to produce a seamless stitch. Source images may be characterized by a region of overlap. A disparity measure may be determined for pixels along a border region between the source images. A warp transformation may be determined using a refinement process configured to determine displacement of pixels of the border region based on the disparity. Pixel displacement at a given location may be constrained to direction configured tangential to an epipolar line corresponding to the location. The warp transformation may be propagated to pixels of the image. Spatial and/or temporal smoothing may be applied. In order to obtain refined solution, the warp transformation may be determined at multiple spatial scales.
-
公开(公告)号:US09747667B1
公开(公告)日:2017-08-29
申请号:US15280910
申请日:2016-09-29
Applicant: GOPRO, INC.
Inventor: Antoine Meler , Benoit Fouet , Yann Gilquin
CPC classification number: G06T3/4084 , G06T3/0056 , G06T2207/20048 , G06T2207/20172
Abstract: First visual information defining the visual content in a first projection may be accessed. Second visual information defining lower versions of the visual content in the first projection may be accessed. A transformation of the visual content from the first projection to a second projection may be determined. The transformation may include a visual compression of a portion of the visual content in the first projection. The portion may be identified. An amount of the visual compression of the portion may be determined. One or more lower resolution versions of the visual content may be selected. The visual content may be transformed using the one or more lower resolution versions of the visual content.
-
-
-
-
-
-
-
-
-