公开(公告)号：US10885615B2

公开(公告)日：2021-01-05

申请号：US16412829

申请日：2019-05-15

Applicant: GoPro, Inc.

Inventor： Bruno César Douady ,  Guillaume Matthieu Guérin

IPC: G06T5/00 ,  G06T3/40 ,  G06T7/13

Abstract: Multiple lookup tables (LUTs) storing different numbers of control point values are used to process pixels within different blocks of an image, such as after image processing using tone mapping and/or tone control, and/or to collect histogram information or implement 3D LUTs. First control point values stored within a first LUT are applied against pixels of a given block of an image to produce a distorted image block. Second control point values stored within a second lookup table are applied against a pixel of the distorted image block to produce a processed pixel. The second LUT is one of a plurality of second LUTs and stores fewer values than the first LUT. A processed image is produced using the processed pixel. The processed image is then output for further processing or display.

公开(公告)号：US10692196B2

公开(公告)日：2020-06-23

申请号：US15955855

申请日：2018-04-18

Applicant: GoPro, Inc.

Inventor： Guillaume Matthieu Guérin ,  Giuseppe Moschetti

IPC: G06T5/00 ,  H04N9/64 ,  H04N9/67 ,  H04N9/68

Abstract: Color correction is integrated within global tone mapping operations to modify an image captured using an image capture device. New luminance values are determined for the pixels of the image by performing global tone mapping against those pixels using one or more sets of color correction values, which are applied against respective luminance values and color components of those pixels. The sets of color correction values are identified within 3×3 color correction matrices. A gain curve for modifying contrast values of the image is determined based on at least one of the new luminance values. A modified image is then generated by modifying the contrast values according to the gain curve, for example, by applying a gamma curve against the contrast values using data stored in a three-dimensional lookup table.

公开(公告)号：US20180211413A1

公开(公告)日：2018-07-26

申请号：US15439281

申请日：2017-02-22

Applicant: GoPro, Inc.

Inventor： Thomas Nicolas Emmanuel Veit ,  Bruno Cesar Douady-Pleven ,  Guillaume Matthieu Guérin

IPC: G06T7/90 ,  H04N9/04 ,  H04N9/73 ,  H04N1/60

CPC classification number: H04N1/6008 ,  G06T11/001 ,  H04N1/60 ,  H04N5/145 ,  H04N5/2251 ,  H04N5/23238 ,  H04N5/247 ,  H04N9/735 ,  H04N13/133 ,  H04N2101/00

Abstract: Obtaining color adjusted image portions using sub-three-dimensional look-up tables may include obtaining the color adjusted image portion by obtaining a value for an input image portion wherein the value includes a first parameter, a second parameter, and a third parameter, obtaining a color adjusted first parameter from at least a first one-dimensional look-up table based on the first parameter, the second parameter, and the third parameter, obtaining a color adjusted second parameter from at least a second one-dimensional look-up table based on the first parameter, the second parameter, and the third parameter, obtaining a color adjusted third parameter from at least a third one-dimensional look-up table based on the first parameter, the second parameter, and the third parameter, and outputting the color adjusted image portion based on a combination of the color adjusted first parameter, the color adjusted second parameter, and the color adjusted third parameter.

公开(公告)号：US12238427B2

公开(公告)日：2025-02-25

申请号：US18539952

申请日：2023-12-14

Applicant: GoPro, Inc.

Inventor： Bruno César Douady ,  Michael Serge Andre Kraak ,  Thomas Nicolas Emmanuel Veit ,  Guillaume Matthieu Guérin

IPC: H04N23/80 ,  G06T3/4015 ,  G06T5/40 ,  G06T5/50 ,  G06T5/75 ,  G06T5/92 ,  H04N1/407 ,  H04N1/60 ,  H04N9/64 ,  H04N9/68 ,  H04N9/77 ,  H04N23/10 ,  H04N23/60 ,  H04N23/741 ,  H04N23/88 ,  H04N25/60 ,  H04N25/61

Abstract: A non-transitory computer-readable storage medium stores executable instructions that, when executed by a processor, cause performance of operations comprising operations to access an image captured by an image sensor, obtain a transfer function for mapping pixel values, determine a faces indication that reflects a proportion of a scene depicted in the image that includes one or more human faces, and modify the transfer function based on the faces indication. Modifying the transfer function based on the faces indication comprises adjusting a gain of the transfer function to move the gain closer to unity. The operations include to apply the transfer function to pixel values of the image to produce a tone mapped image and output the tone mapped image.

公开(公告)号：US12219268B2

公开(公告)日：2025-02-04

申请号：US18195065

申请日：2023-05-09

Applicant: GoPro, Inc.

Inventor： Guillaume Matthieu Guérin

IPC: H04N23/80 ,  H04N9/64 ,  H04N9/68 ,  H04N23/88 ,  H04N25/42

Abstract: An image capture device may process first frames from a first image sensor obtained at a first frame rate and store the processed first frames in a memory. The image capture device may obtain first camera control statistics based at least on partially processed second frames from a second image sensor obtained at a second frame rate. The image capture device may switch a capture mode to obtain third frames at the second frame rate from the first image sensor and to obtain fourth frames at the first frame rate from the second image sensor.

公开(公告)号：US12198466B2

公开(公告)日：2025-01-14

申请号：US17215408

申请日：2021-03-29

Applicant: GoPro, Inc.

Inventor： Guillaume Matthieu Guérin

IPC: G06V40/16 ,  G06T7/00

Abstract: Face detection in a spherical image is performed using overcapture. Multiple views of a spherical image are separately processed using face detection, and results of the face detection for those views are projected to a format for further processing of the spherical image.

公开(公告)号：US20240406592A1

公开(公告)日：2024-12-05

申请号：US18798380

申请日：2024-08-08

Applicant: GoPro, Inc.

Inventor： Guillaume Matthieu Guérin ,  Julien Caron

IPC: H04N25/611 ,  G06T5/77 ,  G06T5/80

Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving an image from an image sensor, detecting, in a linear domain, color fringing areas in the image, correcting detected color fringing areas to obtain a corrected image, performing tone mapping to the corrected image to obtain a tone mapped image and storing, displaying, or transmitting an output image based on at least the tone mapped image.

公开(公告)号：US11849224B2

公开(公告)日：2023-12-19

申请号：US17567453

申请日：2022-01-03

Applicant: GoPro, Inc.

Inventor： Bruno César Douady ,  Michael Serge Andre Kraak ,  Thomas Nicolas Emmanuel Veit ,  Guillaume Matthieu Guérin

IPC: H04N23/80 ,  H04N1/407 ,  G06T5/00 ,  H04N9/64 ,  H04N9/77 ,  H04N9/68 ,  G06T5/40 ,  H04N23/10 ,  H04N23/60 ,  H04N23/88 ,  H04N23/741 ,  H04N25/60 ,  H04N25/61 ,  G06T5/50 ,  G06T3/40 ,  H04N1/60

CPC classification number: H04N23/80 ,  G06T3/4015 ,  G06T5/004 ,  G06T5/009 ,  G06T5/40 ,  G06T5/50 ,  H04N1/4074 ,  H04N1/603 ,  H04N1/6008 ,  H04N9/643 ,  H04N9/646 ,  H04N9/68 ,  H04N9/77 ,  H04N23/10 ,  H04N23/60 ,  H04N23/741 ,  H04N23/88 ,  H04N25/60 ,  H04N25/61 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/20012 ,  G06T2207/20182 ,  H04N2209/046

Abstract: A system accesses an image with each pixel of the image having luminance values each representative of a color component of the pixel. The system generates a first histogram for aggregate luminance values of the image, and accesses a target histogram for the image representative of a desired global image contrast. The system computes a transfer function based on the first histogram and the target histogram such that when the transfer function is applied, a histogram of the modified aggregate luminance values is within a threshold similarity of the target histogram. The system modifies the image by applying the transfer function to the luminance values of the image to produce a tone mapped image, and outputs the modified image.

公开(公告)号：US20230388656A1

公开(公告)日：2023-11-30

申请号：US18232584

申请日：2023-08-10

Applicant: GoPro, Inc.

Inventor： Guillaume Matthieu Guérin ,  Julien Caron

IPC: H04N23/741 ,  G06T5/20 ,  G06T5/00 ,  G06T3/40

CPC classification number: H04N23/741 ,  G06T5/20 ,  G06T5/009 ,  G06T3/4038

Abstract: Field variable tone mapping is performed for 360 content. An image capture device includes an image sensor and a processor. The image sensor obtains a hyper-hemispherical image and the processor performs local tone mapping (LTM) on a first area of the hyper-hemispherical image and performs global tone mapping (GTM) on a second area of the hyper-hemispherical image to obtain a processed image. The processor may be configured to display, store, output, or transmit the processed image.

公开(公告)号：US11736806B2

公开(公告)日：2023-08-22

申请号：US17521120

申请日：2021-11-08

Applicant: GoPro, Inc.

Inventor： Guillaume Matthieu Guérin ,  Giuseppe Moschetti ,  Sylvain Leroy ,  Yoël Taïeb

IPC: H04N23/73 ,  H04N23/71 ,  H04N23/698

CPC classification number: H04N23/73 ,  H04N23/698 ,  H04N23/71

Abstract: Auto exposure metering is adapted for spherical panoramic content. Using input image data, a first metering map is generated for a selected image sensor and a second metering map is generated for an unselected image sensor. Auto exposure level values for the selected image sensor and for the unselected image sensor are respectively metered using the first metering map and the second metering map, such as by adjusting luminance weights in certain locations of the respective image sensor panoramic image capture band. Hemispherical images are processed using the auto exposure metered level values and stitched together in a panoramic format to produce a spherical panoramic image. The metering maps are generated to account for areas of greatest image data importance relative to a primary orientation direction of the spherical panoramic image. This allows for effective auto exposure metering of such areas within the resulting spherical panoramic image.