Multiple tone control
    31.
    发明授权

    公开(公告)号:US11563925B2

    公开(公告)日:2023-01-24

    申请号:US17559076

    申请日:2021-12-22

    Applicant: GoPro, Inc.

    Abstract: Image analysis and processing may include a multiple-tone-control (MTC) unit configured to obtain a tone-control gain lookup table, a plurality of MTC gain lookup tables, wherein the input image is divided into a plurality of blocks and wherein the plurality of MTC gain lookup tables includes a respective MTC gain lookup table corresponding to each respective block from the plurality of blocks, MTC grid parameters, MTC weighting parameters, a tone-control gain based on the tone-control gain lookup table, a MTC gain based on at least one MTC gain lookup table from the plurality of MTC gain lookup tables, the MTC grid parameters, and the MTC weighting parameters, and an output value based on the tone-control gain and the MTC gain.

    Generation of enhanced panoramic visual content

    公开(公告)号:US11558557B2

    公开(公告)日:2023-01-17

    申请号:US17239589

    申请日:2021-04-24

    Applicant: GoPro, Inc.

    Abstract: An image capture device may capture two hemispherical views of a scene. The two hemispherical view of the scene may be stitched along a stitch line. The image capture device may be rotated to align the stitch line with a mid-line of a panoramic field of view of the scene. Separate exposure settings may be used to capture the two hemispherical views of the scene, with the exposure settings increasing the dynamic range of the scene depicted within the panoramic field of view of the scene. The panoramic field of view of the scene may be punched out as panoramic visual content.

    ENTROPY MAXIMIZATION BASED AUTO-EXPOSURE

    公开(公告)号:US20220377224A1

    公开(公告)日:2022-11-24

    申请号:US17881371

    申请日:2022-08-04

    Applicant: GoPro, Inc.

    Abstract: An image capture apparatus may include an image sensor, a motion sensor, and an auto-exposure unit. The auto-exposure unit may obtain an input image captured during an exposure interval and corresponding motion data indicating motion of the image capture apparatus during the exposure interval. The auto-exposure unit may obtain image information-amount data for the input image. The auto-exposure unit may obtain derivative information-amount data based on the information-amount data and a candidate exposure adjustment. The auto-exposure unit may obtain an information-amount maximizing exposure interval based on the information-amount data and the derivative information-amount data. The image capture apparats may control the image sensor to obtain a subsequent input image signal representing a subsequent input image captured during the information-amount maximizing exposure interval, and output or store information representing the subsequent input image.

    Object aware local tone mapping
    34.
    发明授权

    公开(公告)号:US11508046B2

    公开(公告)日:2022-11-22

    申请号:US17132357

    申请日:2020-12-23

    Applicant: GoPro, Inc.

    Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include accessing an image from an image sensor; detecting an object area on the image; classifying the object area on the image; applying a filter to an object area of the image to obtain a low-frequency component image and a high-frequency component image; determining a first enhanced image based on a weighted sum of the low-frequency component image and the high-frequency component image, where the high-frequency component image is weighted more than the low-frequency component image; determining a second enhanced image based on the first enhanced image and a tone mapping; and storing, displaying, or transmitting an output image based on the second enhanced image.

    Multi-level lookup tables for control point processing and histogram collection

    公开(公告)号:US11501418B2

    公开(公告)日:2022-11-15

    申请号:US17140287

    申请日:2021-01-04

    Applicant: GoPro, Inc.

    Abstract: Multiple lookup tables (LUTs) storing different numbers of control point values are used to process pixels within different blocks of an image, such as after image processing using tone mapping and/or tone control, and/or to collect histogram information or implement 3D LUTs. First control point values stored within a first LUT are applied against pixels of a given block of an image to produce a distorted image block. Second control point values stored within a second lookup table are applied against a pixel of the distorted image block to produce a processed pixel. The second LUT is one of a plurality of second LUTs and stores fewer values than the first LUT. A processed image is produced using the processed pixel. The processed image is then output for further processing or display.

    Field variable tone mapping for 360 content

    公开(公告)号:US11350042B2

    公开(公告)日:2022-05-31

    申请号:US16843301

    申请日:2020-04-08

    Applicant: GoPro, Inc.

    Abstract: Image capture devices and methods may use field variable tone mapping for 360 content. An image capture device may comprise an image sensor and a processor. The image sensor may capture a hyper-hemispherical image that includes an image circle portion and a dark corner portion. The processor may perform local tone mapping (LTM) on a first area of the image circle portion and perform global tone mapping (GTM) on a second area of pixels of the image circle portion. The GTM may be performed on a condition that a portion of a predefined area of pixels overlaps with a stitch line. The processor may be configured to stitch the hyper-hemispherical image and a second hyper-hemispherical image at the stitch line to obtain a processed image. The processor may be configured to display, store, output, or transmit the processed image.

    Auto exposure for spherical images
    37.
    发明授权

    公开(公告)号:US11323603B2

    公开(公告)日:2022-05-03

    申请号:US16994264

    申请日:2020-08-14

    Applicant: GoPro, Inc.

    Abstract: Auto exposure processing for spherical images improves image quality by reducing visible exposure level variation along a stitch line within a spherical image. An average global luminance value is determined based on auto exposure configurations of first and second image sensors. Delta luminance values are determined for each of the image sensors based on the average global luminance value and a luminance variance between the image sensors. The auto exposure configurations of the image sensors are then updated using the delta luminance values, and the updated auto exposure configurations are used to capture images which are then combined to produce the spherical image. In some cases wherein updating the auto exposure configurations using the delta luminance values would breach a threshold representing a target luminosity for the scene, the use of the delta luminance values may be limited or those values may instead be discarded.

    METHOD AND APPARATUS FOR PARTIAL CORRECTION OF IMAGES

    公开(公告)号:US20220078312A1

    公开(公告)日:2022-03-10

    申请号:US17531311

    申请日:2021-11-19

    Applicant: GoPro, Inc.

    Abstract: An image capture device may include an image sensor, a processor, and memory. The image sensor may be configured to obtain an image. The processor may be configured to: generate a grid on the image forming tiles; determine a fringing level of each vertex of the vertices; sort all of the tiles based on the fringing level of each tile so that the tiles are sorted in a descending order from the tile with a highest of the fringing levels to the tile with a lowest of the fringing levels; and apply a fringing compensation to a subset of the sorted tiles to obtain a processed image. The memory may be configured to store the processed image.

    HIGH DYNAMIC RANGE ANTI-GHOSTING AND FUSION

    公开(公告)号:US20220030152A1

    公开(公告)日:2022-01-27

    申请号:US17299470

    申请日:2019-10-17

    Applicant: GoPro, Inc.

    Abstract: Systems and methods are disclosed for high dynamic range anti-ghosting and fusion. For example, methods may include receiving images from image sensors in a linear domain, each image having different exposures or gains, blending luminance values at each pixel from each of the images to generate a blended image, selecting an useful image based on degree of useful information for a pixel, calculating a distance value from the images for the pixel, locating from a look-up table (LUT) an anti-ghosting weight using the useful image and the distance value for the pixel, proportionally applying the located anti-ghosting weight to the pixel for each of the input images to generate an output image, all being performed in the linear domain, and storing, displaying, or transmitting the output image based on at least the anti-ghosting weight.

    Method and apparatus for partial correction of images

    公开(公告)号:US11212425B2

    公开(公告)日:2021-12-28

    申请号:US17000822

    申请日:2020-08-24

    Applicant: GoPro, Inc.

    Abstract: An image capture device may include an image sensor, a processor, and a memory. The image sensor may be configured to obtain an image. The processor may be configured to generate a grid on the image. The grid may include one or more vertices. The one or more vertices may be used to form tiles. The processor may be configured to determine a flare level of each vertex. The processor may be configured to assign a maximum flare level for each tile of the image. The processor may be configured to sort the tiles. The tiles may be sorted based on the maximum flare level of each tile. The processor may be configured to apply a flare compensation to a subset of the tiles to obtain a processed image. The processed image may have reduced flare artifacts or no flare artifacts. The processed image may be stored in the memory.

Patent Agency Ranking