公开(公告)号：US20140212062A1

公开(公告)日：2014-07-31

申请号：US13754546

申请日：2013-01-30

Applicant: APPLE INC.

Inventor： Graham D. Finlayson

IPC: G06T5/00

CPC classification number: G06T5/009 ,  G06T5/003 ,  G06T2207/20192

Abstract: Systems, methods, and computer readable media to approximate edge-preserving transformations with global transfer functions are described. In general, a first transfer function that approximates an edge-preserving operation can be found which, together with an enhancement filter (e.g., dynamic range compression) may be used to generate a global transfer function. Alternatively, a second transfer function may be found that approximates the behavior of the combined first transfer function and enhancement filter. Together the first and second transfer functions may generate a global transfer function. It has been determined that a down-sampled version of an input image may be used to develop the global transfer function. Application of global transfer functions in accordance with this disclosure can generate an output image that exhibits the same overall tonality of the input image without introducing the loss of detail and other artifacts attributable to local processing (e.g., the application of edge-preserving filters).

Abstract translation: 描述了利用全局传递函数近似边缘保留变换的系统，方法和计算机可读介质。 通常，可以找到近似边缘保留操作的第一传递函数，其可以与增强滤波器（例如，动态范围压缩）一起用于生成全局传递函数。 或者，可以发现近似组合的第一传递函数和增强滤波器的行为的第二传递函数。 第一和第二传递函数一起可以产生全局传递函数。 已经确定可以使用输入图像的下采样版本来开发全局传递函数。 根据本公开的全局传递函数的应用可以生成显示输入图像相同总体色调的输出图像，而不引入可归因于本地处理（例如，边缘保留滤波器的应用）的细节丢失和其他伪像。

公开(公告)号：US20130129204A1

公开(公告)日：2013-05-23

申请号：US13743893

申请日：2013-01-17

Applicant: APPLE INC.

Inventor： Graham D. Finlayson ,  Clement Fredembach

IPC: G06T5/50

CPC classification number: G06T5/50 ,  G06T7/90 ,  G06T7/97

Abstract: In a method of chromagenic illuminant estimation pixels from mutually-corresponding images with different filtering are compared, a fraction of the brightest pixels being selected for a subsequent chromagenic estimation. The pixels may be at corresponding locations or they may correspond in that their mean brightness is in the same rank order. In one method, in which, in a first preprocessing stage, for a database of m lights Ei(λ) and n surfaces Sj(λ) there is calculated Ti˜QFQ+ where Q1F and QF represent the matrices of unfiltered and filtered sensor responses to the n surfaces under the i th light and + denotes an inverse, and in a second operation stage, given P surfaces in an image and 3×P matrices Q and QF, from these matrices there are chosen the r % brightest pixels giving the matrices Q′ and Q′F, and the scene illuminant Pest is estimated where formula (I) and (II).

Abstract translation: 在色度光源估计的方法中，比较来自具有不同滤波的相互对应的图像的像素，选择最亮像素的一部分用于随后的色素估计。 像素可以在相应的位置，或者它们可以对应，因为它们的平均亮度处于相同的等级顺序。 在一种方法中，在第一预处理阶段中，对于m个光源（λ）和n个表面Sj（λ）的数据库，计算Ti_QFQ +，其中Q1F和QF表示未滤波和滤波的传感器响应的矩阵 在第i个光下的n个表面和+表示反向，并且在第二个操作阶段中，给定图像中的P个表面和3×P个矩阵Q和QF，从这些矩阵中选出给出矩阵的r％最亮像素 Q'和Q'F，并且在公式（I）和（II）中估计场景光源Pest。

公开(公告)号：US09626744B2

公开(公告)日：2017-04-18

申请号：US14840843

申请日：2015-08-31

Applicant: Apple Inc.

Inventor： Graham D. Finlayson ,  Jakkarin Singnoo

IPC: G06K9/00 ,  G06T5/00 ,  G06T5/40

CPC classification number: G06T5/002 ,  G06T5/009 ,  G06T5/40 ,  G06T2207/10024 ,  G06T2207/20192 ,  G06T2207/20208

Abstract: Techniques to generate global tone-mapping operators (G-TMOs) that, when applied to high dynamic range images, visually approximate the use of spatially varying tone-mapping operators (SV-TMOs) are described. The disclosed G-TMOs provide substantially the same visual benefits as SV-TMOs but do not suffer from spatial artifacts such as halos and are, in addition, computationally efficient compared to SV-TMOs. In general, G-TMOs may be identified based on application of a SV-TMO to a down-sampled version of a full-resolution input image (e.g., a thumbnail). An optimized mapping between the SV-TMO's input and output constitutes the G-TMO. It has been unexpectedly discovered that when optimized (e.g., to minimize the error between the SV-TMO's input and output), G-TMOs so generated provide an excellent visual approximation to the SV-TMO (as applied to the full-resolution image).

公开(公告)号：US20170178302A1

公开(公告)日：2017-06-22

申请号：US15449523

申请日：2017-03-03

Applicant: Apple Inc.

Inventor： Graham D. Finlayson ,  Jakkarin Singnoo

IPC: G06T5/00

CPC classification number: G06T5/002 ,  G06T5/009 ,  G06T5/40 ,  G06T2207/10024 ,  G06T2207/20192 ,  G06T2207/20208

Abstract: Techniques to generate global tone-mapping operators (G-TMOs) that, when applied to high dynamic range images, visually approximate the use of spatially varying tone-mapping operators (SV-TMOs) are described. The disclosed G-TMOs provide substantially the same visual benefits as SV-TMOs but do not suffer from spatial artifacts such as halos and are, in addition, computationally efficient compared to SV-TMOs. In general, G-TMOs may be identified based on application of a SV-TMO to a down-sampled version of a full-resolution input image (e.g., a thumbnail). An optimized mapping between the SV-TMO's input and output constitutes the G-TMO. It has been unexpectedly discovered that when optimized (e.g., to minimize the error between the SV-TMO's input and output), G-TMOs so generated provide an excellent visual approximation to the SV-TMO (as applied to the full-resolution image).

公开(公告)号：US20150170347A1

公开(公告)日：2015-06-18

申请号：US14566895

申请日：2014-12-11

Applicant: Apple Inc.

Inventor： Graham D. Finlayson

IPC: G06T5/00

CPC classification number: G06T5/009 ,  G06T5/00 ,  G06T5/002 ,  G06T2207/20016 ,  G06T2207/20024

Abstract: A method of generating output image data comprises obtaining derivative data relating to a reference image; obtaining a constraint for output image data; and generating the output image data from the derivative data relating to the reference image in dependence on the constraint. This method can be used to recover a robust output image from the derivative of an input image.

Abstract translation: 一种产生输出图像数据的方法包括获得与参考图像有关的导数数据; 获得输出图像数据的约束; 以及根据约束从与参考图像相关的导数数据生成输出图像数据。 该方法可用于从输入图像的导数恢复鲁棒输出图像。

公开(公告)号：US20140140615A1

公开(公告)日：2014-05-22

申请号：US13683020

申请日：2012-11-21

Applicant: APPLE INC.

Inventor： Graham D. Finlayson ,  Jakkarin Singnoo

IPC: G06K9/36

CPC classification number: G06T5/002 ,  G06T5/009 ,  G06T5/40 ,  G06T2207/10024 ,  G06T2207/20192 ,  G06T2207/20208

Abstract: Techniques to generate global tone-mapping operators (G-TMOs) that, when applied to high dynamic range images, visually approximate the use of spatially varying tone-mapping operators (SV-TMOs) are described. The disclosed G-TMOs provide substantially the same visual benefits as SV-TMOs but do not suffer from spatial artifacts such as halos and are, in addition, computationally efficient compared to SV-TMOs. In general, G-TMOs may be identified based on application of a SV-TMO to a down-sampled version of a full-resolution input image (e.g., a thumbnail). An optimized mapping between the SV-TMO's input and output constitutes the G-TMO. It has been unexpectedly discovered that when optimized (e.g., to minimize the error between the SV-TMO's input and output), G-TMOs so generated provide an excellent visual approximation to the SV-TMO (as applied to the full-resolution image).

Abstract translation: 描述了当应用于高动态范围图像时视觉上近似使用空间变化色调映射算子（SV-TMO）的生成全局色调映射算子（G-TMO）的技术。 所公开的G-TMO提供与SV-TMO基本上相同的视觉效果，但是不会像诸如光晕那样的空间伪影，而且与SV-TMO相比，计算效率更高。 通常，可以基于将SV-TMO应用于全分辨率输入图像（例如，缩略图）的下采样版本来识别G-TMO。 SV-TMO的输入和输出之间的优化映射构成了G-TMO。 已经意外地发现，当优化时（例如，为了最小化SV-TMO的输入和输出之间的误差），所生成的G-TMO提供了对SV-TMO的极好的视觉近似（应用于全分辨率图像） 。

公开(公告)号：US08611660B2

公开(公告)日：2013-12-17

申请号：US13764833

申请日：2013-02-12

Applicant: Apple Inc.

Inventor： Graham D. Finlayson ,  Mark Samuel Drew ,  Clement Fredembach

IPC: G06K9/34 ,  G06K9/46

CPC classification number: G06K9/34 ,  G06K9/4661 ,  G06T7/11 ,  G06T7/174 ,  G06T2207/10024 ,  G06T2207/10152

Abstract: An image having m light sources, with m preferably equaling 2 or 3, is segmented into different regions, each of which is lit by only one of the m light sources, by obtaining paired imaged with different filtering, for example a filtered and an unfiltered image, applying to the image pairs sets of m pre-computed mappings at the pixel or region level, and selecting the most appropriate. The rendering of the information in the image maybe adjusted accordingly.

Abstract translation: 具有m个光源的图像，其优选地等于2或3，被分割成不同的区域，每个区域仅通过m个光源中的一个被点亮，通过获得具有不同滤波的成对成像，例如滤波和未滤波 图像，应用于在像素或区域级别的m个预先计算的映射的图像对集合，并且选择最合适的。 图像中的信息的渲染可以相应地进行调整。

公开(公告)号：US20240107177A1

公开(公告)日：2024-03-28

申请号：US17950859

申请日：2022-09-22

Applicant: Apple Inc.

Inventor： Bosheng Zhang ,  Tobias Baldauf ,  llya Romanenko ,  Nicolas P. Bonnier ,  Noah D. Bedard ,  Alexandra S. Ludlow ,  Graham D. Finlayson ,  Jason P. de Villiers ,  Claus Moelgaard ,  Hau Ling Hung ,  Paul M. Hubel

IPC: H04N5/243 ,  G06T5/50 ,  G06T7/50 ,  H04N9/73

CPC classification number: H04N5/243 ,  G06T5/50 ,  G06T7/50 ,  H04N9/73 ,  G06T2207/20221

Abstract: Embodiments disclosed herein are directed to devices and methods for performing spatially-varying brightness correction of a flash image. The spatially-varying brightness correction utilizes a set of images that includes one or more images captured under flash illumination and one or more images captured without flash illumination, which are used to decompose one of the flash images or an image generated therefrom into a flash contribution image and an ambient contribution image. The flash contribution image and the ambient contribution image are recombined to generate a corrected flash image, and information about the flash module and/or scene is used to adjust the relative contributions of these images during recombination.

公开(公告)号：US09129388B2

公开(公告)日：2015-09-08

申请号：US13683020

申请日：2012-11-21

Applicant: Apple Inc.

Inventor： Graham D. Finlayson ,  Jakkarin Singnoo

IPC: G06K9/00 ,  G06T5/00

CPC classification number: G06T5/002 ,  G06T5/009 ,  G06T5/40 ,  G06T2207/10024 ,  G06T2207/20192 ,  G06T2207/20208

Abstract: Techniques to generate global tone-mapping operators (G-TMOs) that, when applied to high dynamic range images, visually approximate the use of spatially varying tone-mapping operators (SV-TMOs) are described. The disclosed G-TMOs provide substantially the same visual benefits as SV-TMOs but do not suffer from spatial artifacts such as halos and are, in addition, computationally efficient compared to SV-TMOs. In general, G-TMOs may be identified based on application of a SV-TMO to a down-sampled version of a full-resolution input image (e.g., a thumbnail). An optimized mapping between the SV-TMO's input and output constitutes the G-TMO. It has been unexpectedly discovered that when optimized (e.g., to minimize the error between the SV-TMO's input and output), G-TMOs so generated provide an excellent visual approximation to the SV-TMO (as applied to the full-resolution image).

Abstract translation: 描述了当应用于高动态范围图像时视觉上近似使用空间变化色调映射算子（SV-TMO）的生成全局色调映射算子（G-TMO）的技术。 所公开的G-TMO提供与SV-TMO基本上相同的视觉效果，但是不会像诸如光晕那样的空间伪影，而且与SV-TMO相比，计算效率更高。 通常，可以基于将SV-TMO应用于全分辨率输入图像（例如，缩略图）的下采样版本来识别G-TMO。 SV-TMO的输入和输出之间的优化映射构成了G-TMO。 已经意外地发现，当优化时（例如，为了最小化SV-TMO的输入和输出之间的误差），所生成的G-TMO提供了对SV-TMO的极好的视觉近似（应用于全分辨率图像） 。

公开(公告)号：US08811729B2

公开(公告)日：2014-08-19

申请号：US13743893

申请日：2013-01-17

Applicant: Apple Inc.

Inventor： Graham D. Finlayson ,  Clement Fredembach

IPC: G06K9/00

CPC classification number: G06T5/50 ,  G06T7/90 ,  G06T7/97

Abstract: In a method of chromagenic illuminant estimation pixels from mutually-corresponding images with different filtering are compared, a fraction of the brightest pixels being selected for a subsequent chromagenic estimation. The pixels may be at corresponding locations or they may correspond in that their mean brightness is in the same rank order. In one method, in which, in a first preprocessing stage, for a database of m lights Ei(λ) and n surfaces Sj(λ) there is calculated Ti˜QFQ+ where Q1F and QF represent the matrices of unfiltered and filtered sensor responses to the n surfaces under the i th light and + denotes an inverse, and in a second operation stage, given P surfaces in an image and 3×P matrices Q and QF, from these matrices there are chosen the r % brightest pixels giving the matrices Q′ and Q′F, and the scene illuminant Pest is estimated where formula (I) and (II).

Abstract translation: 在色度光源估计的方法中，比较来自具有不同滤波的相互对应的图像的像素，选择最亮像素的一部分用于随后的色素估计。 像素可以在相应的位置，或者它们可以对应，因为它们的平均亮度处于相同的等级顺序。 在一种方法中，在第一预处理阶段中，对于m个光源Ei（λ）和n个表面Sj（λ）的数据库，计算Ti_QFQ +，其中Q1F和QF表示未滤波和滤波的传感器响应的矩阵 在第i个光下的n个表面和+表示反向，并且在第二个操作阶段中，给定图像中的P个表面和3×P个矩阵Q和QF，从这些矩阵中选出给出矩阵的r％最亮像素 Q'和Q'F，并且在公式（I）和（II）中估计场景光源Pest。