公开(公告)号：US09984449B2

公开(公告)日：2018-05-29

申请号：US15632681

申请日：2017-06-26

Applicant: FUJIFILM Corporation

Inventor： Yousuke Naruse ,  Kenkichi Hayashi ,  Masahiko Sugimoto

IPC: G06T5/00 ,  G06T5/20 ,  H04N5/357 ,  H04N9/64

CPC classification number: G06T5/20 ,  G06T5/003 ,  G06T2207/10024 ,  G06T2207/20024 ,  H04N1/58 ,  H04N5/217 ,  H04N5/357 ,  H04N9/045 ,  H04N9/646

Abstract: A restoration filter generation device which generates a restoration filter for performing a restoration process on luminance system image data, the restoration process being based on a point-image distribution in an optical system, the luminance system image data being image data relevant to luminance and being generated based on image data for each color of multiple colors, the restoration filter generation device including an MTF acquisition device which acquires a modulation transfer function MTF for the optical system; and a restoration filter generation device which generates the restoration filter based on the modulation transfer function MTF, the restoration filter suppressing an MTF value of image data for each color of the multiple colors to 1.0 or less at least in a region of a particular spatial frequency or less, the image data for each color of the multiple colors corresponding to the luminance system image data after the restoration process.

公开(公告)号：US09898807B2

公开(公告)日：2018-02-20

申请号：US15255560

申请日：2016-09-02

Applicant: FUJIFILM Corporation

Inventor： Kenkichi Hayashi ,  Masahiko Sugimoto ,  Yousuke Naruse ,  Kosuke Irie

IPC: G06K9/00 ,  G06T5/00 ,  H04N1/409 ,  H04N5/357 ,  H04N9/04 ,  H04N5/208 ,  H04N9/69 ,  G06T5/40

CPC classification number: G06T5/003 ,  G06T5/009 ,  G06T5/40 ,  G06T2207/10004 ,  G06T2207/20192 ,  H04N1/4092 ,  H04N5/208 ,  H04N5/3572 ,  H04N9/045 ,  H04N9/69

Abstract: The image processing device includes a gradation correction unit (gamma correction processing unit 33) which performs gradation correction, a restoration processing unit, a sharpening processing unit, a sharpening and recovery control unit 37 which is able to adjust a restoration rate of restoration processing and a sharpening rate of sharpening processing by controlling the restoration processing unit and the sharpening processing unit, a sharpening and recovery control unit 37 which acquires a total sharpening and restoration rate based on the restoration rate and the sharpening rate and one rate of the restoration rate and the sharpening rate and calculates the other rate of the restoration rate and the sharpening rate based on the total sharpening and restoration rate, and a brightness information acquisition unit. The sharpening and recovery control unit adjusts the restoration rate and the sharpening rate according to acquired brightness information.

公开(公告)号：US09881362B2

公开(公告)日：2018-01-30

申请号：US14933759

申请日：2015-11-05

Applicant: FUJIFILM Corporation

Inventor： Kenkichi Hayashi ,  Masahiko Sugimoto ,  Yousuke Naruse

IPC: G06K9/40 ,  G06T5/00 ,  H04N5/232 ,  H04N5/357 ,  H04N9/04

CPC classification number: G06T5/003 ,  G06T2207/20024 ,  G06T2207/20201 ,  H04N5/23212 ,  H04N5/3572 ,  H04N9/045

Abstract: An image processing device includes a point-image restoration processing unit 40 which receives a photographic image as input, and subjects the photographic image to a point-image restoration process based on point-image restoration information to generate a restored image, an area information output unit 45 which outputs area information relating to a specific area in the restored image where restoration strength of the point-image restoration process based on the point-image restoration information is equal to or greater than a threshold value, a display control unit 50 which receives the restored image and the area information as input and performs display control to highlight the specific area in the restored image based on the area information, and a display unit 55 which highlights at least the specific area based on the display control by the display control unit 50.

公开(公告)号：US09805452B2

公开(公告)日：2017-10-31

申请号：US15462454

申请日：2017-03-17

Applicant: FUJIFILM Corporation

Inventor： Yousuke Naruse ,  Kenkichi Hayashi

IPC: G06K9/40 ,  G06T5/20 ,  G06T5/00

CPC classification number: G06T5/20 ,  G06T5/001 ,  G06T2207/20024 ,  H04N5/232 ,  H04N5/361 ,  H04N9/045 ,  H04N9/646

Abstract: There are provided an image processing apparatus, an image processing method, a program, and a recording medium capable of compatibly achieving a high-accuracy filtering process and reduction in a necessary storage capacity. An image processing apparatus 35 includes a filtering process unit 41 that performs an image filtering process including a plurality of filtering processes. The filtering process unit 41 applies a filter to processing target data to acquire filter application process data, and applies a gain to the filter application process data to acquire gain application process data, in each filtering process. In each filtering process, the gain applied to the filter application process data is acquired based on a target frequency characteristic of the image filtering process determined according to a pixel position in original image data.

公开(公告)号：US09794500B2

公开(公告)日：2017-10-17

申请号：US14987435

申请日：2016-01-04

Applicant: FUJIFILM Corporation

Inventor： Kenkichi Hayashi ,  Masahiko Sugimoto ,  Yousuke Naruse ,  Kosuke Irie

IPC: H04N5/357 ,  H04N5/232 ,  G06T5/00 ,  G06T5/10 ,  G06T5/20

CPC classification number: H04N5/357 ,  G06T5/001 ,  G06T5/003 ,  G06T5/10 ,  G06T5/20 ,  G06T2207/10016 ,  G06T2207/20201 ,  H04N5/23212 ,  H04N5/23229

Abstract: An imaging device 10 according to one aspect of the present invention includes: a subject distance acquisition section 115; a movement amount acquisition section 120 that acquires an amount of movement of the subject on the basis of the subject distance; a restoration processing determination section 125 that determines, on the basis of the amount of movement acquired by the movement amount acquisition section 120, whether the restoration processing should be performed on the images through a restoration filter, a restoration strength of the restoration processing should be adjusted and the restoration processing should be performed on the images, or the restoration processing should not be performed on the images; and a restoration processing execution section 105 that performs the restoration processing on the images through the restoration filter or with the adjusted restoration strength, on the basis of the determination of the restoration processing determination section 125.

公开(公告)号：US09699427B2

公开(公告)日：2017-07-04

申请号：US14989611

申请日：2016-01-06

Applicant: FUJIFILM Corporation

Inventor： Kenkichi Hayashi ,  Masahiko Sugimoto ,  Yousuke Naruse ,  Kosuke Irie

IPC: H04N9/64 ,  G06K9/44 ,  G06T5/00 ,  G06T5/30 ,  G06T7/20 ,  H04N5/208 ,  H04N5/217 ,  H04N5/225 ,  H04N5/232 ,  H04N5/238 ,  H04N5/357

CPC classification number: H04N9/646 ,  G06K9/44 ,  G06T5/003 ,  G06T5/30 ,  G06T7/20 ,  G06T2207/20024 ,  G06T2207/20182 ,  G06T2207/20201 ,  H04N5/208 ,  H04N5/217 ,  H04N5/2254 ,  H04N5/23209 ,  H04N5/23229 ,  H04N5/238 ,  H04N5/3572

Abstract: An imaging device 10 according to an aspect of the present invention includes: an image generation section 100 that generates a moving image; a filter acquisition section 105 that acquires a restoration filter corresponding to a transfer function for the point distribution of an optical system; an aperture value detection section 110 that detects an aperture value of the optical system; a restoration processing determination section 115 that determines whether or not the aperture value detected by the aperture value detection section 110 is equal to or greater than a small-aperture-blurring reference aperture value; and a restoration processing execution section 120 that executes the restoration processing on the moving image through the restoration filter, in case where the restoration processing determination section 115 determines that the aperture value detected by the aperture value detection section 110 is equal to or greater than the small-aperture-blurring reference aperture value.

公开(公告)号：US09584801B2

公开(公告)日：2017-02-28

申请号：US14884246

申请日：2015-10-15

Applicant: FUJIFILM Corporation

Inventor： Masahiko Sugimoto ,  Kenkichi Hayashi ,  Yousuke Naruse

IPC: H04N5/232 ,  H04N5/357 ,  G06T5/00 ,  H04N17/00 ,  H04N5/225 ,  H04N5/235

CPC classification number: H04N17/002 ,  G06T5/003 ,  G06T7/80 ,  G06T2207/30208 ,  H04N5/2254 ,  H04N5/23229 ,  H04N5/2356 ,  H04N5/3572

Abstract: An image capturing device 100 includes: an image pickup unit 248; a chart storage unit 240; a chart transmission control unit 242; a calibration necessity determination unit 244 that determines whether or not calibration of the parameters of the point image restoration processing is required based on a calibration image that is obtained by imaging a calibration chart displayed on an external display device using the image pickup unit 248; a calibration control unit 246 that controls the execution of the calibration according to the determination regarding whether or not the calibration is required that has been performed by the calibration necessity determination unit 244; and a calibration execution unit 247.

Abstract translation: 图像拍摄装置100包括：图像拾取单元248; 图表存储单元240; 图表发送控制单元242; 基于通过使用图像拾取单元248对显示在外部显示装置上显示的校准图进行成像而获得的校准图像来确定是否需要对点图像恢复处理的参数进行校准的校准必要性确定单元244; 校准控制单元246，其根据关于由校准必要性确定单元244执行的校准是否需要的确定来控制校准的执行; 和校准执行单元247。

公开(公告)号：US09489719B2

公开(公告)日：2016-11-08

申请号：US14668256

申请日：2015-03-25

Applicant: FUJIFILM CORPORATION

Inventor： Yousuke Naruse ,  Kenkichi Hayashi ,  Hiroshi Endo ,  Kousuke Irie

IPC: G06K9/40 ,  G06T5/00 ,  H04N5/217 ,  G06T5/10 ,  H04N5/232

CPC classification number: G06T5/001 ,  G06T5/003 ,  G06T5/10 ,  H04N5/217 ,  H04N5/23209

Abstract: An image processing device includes a statistical information acquiring unit, an optical information acquiring unit, a filter information calculating unit and a filter coefficient calculating unit. The filter information calculating unit obtains filter information of a restoration filter for point image restoration processing according to at least one of statistical information and optical information. The filter information includes information related to number of taps of the restoration filter and information indicating a kind of symmetry of the restoration filter. The filter coefficient calculating unit calculates a filter coefficient of the restoration filter according to the statistical information and the optical information with at least the information related to the number of taps of the restoration filter and the information indicating the kind of the symmetry of the restoration filter of the filter information as a constraint condition.

Abstract translation: 一种图像处理装置包括统计信息获取单元，光学信息获取单元，滤波器信息计算单元和滤波器系数计算单元。 滤波器信息计算单元根据统计信息和光信息中的至少一个获得用于点图像恢复处理的恢复滤波器的滤波器信息。 滤波器信息包括与恢复滤波器的抽头数相关的信息和指示恢复滤波器的对称类型的信息。 滤波器系数计算单元根据统计信息和至少与恢复滤波器的抽头数相关的信息的光信息和表示恢复滤波器的对称类型的信息来计算恢复滤波器的滤波器系数 的过滤器信息作为约束条件。

公开(公告)号：US09402024B2

公开(公告)日：2016-07-26

申请号：US14661670

申请日：2015-03-18

Applicant: FUJIFILM Corporation

Inventor： Hiroshi Endo ,  Kenkichi Hayashi ,  Kousuke Irie ,  Yousuke Naruse

IPC: H04N5/232 ,  G02B13/00 ,  G06T5/00 ,  G06T7/00 ,  G02B7/14 ,  G02B7/36 ,  H04N101/00

CPC classification number: H04N5/23212 ,  G02B7/14 ,  G02B7/36 ,  G02B13/0015 ,  G06T5/001 ,  G06T5/003 ,  G06T7/529 ,  H04N5/23229 ,  H04N5/23245 ,  H04N2101/00

Abstract: According to the present invention, even if variation (estimation variation) is caused in a subject distance estimated at the time of imaging when restoration processing of a taken image is performed using a restoration filter corresponding to the subject distance, since an optimal restoration filter that conforms to a subject distance taking into account the maximum infinity-side estimation variation and does not cause overcorrection is selected, it is possible to prevent resolution degradation due to overcorrection and achieve the improvement of resolution by the restoration filter.

Abstract translation: 根据本发明，即使在使用与被摄体距离对应的恢复滤波器进行拍摄图像的恢复处理时，在成像时估计的被摄体距离中产生变化（估计变化），因此，最佳恢复滤波器 考虑到最大无穷大侧估计变化并且不引起过度校正被选择，可以防止由于过度校正引起的分辨率劣化，并且通过恢复滤波器实现分辨率的提高。

公开(公告)号：US20160117806A1

公开(公告)日：2016-04-28

申请号：US14989336

申请日：2016-01-06

Applicant: FUJIFILM Corporation

Inventor： Kenkichi Hayashi ,  Masahiko Sugimoto ,  Yousuke Naruse ,  Kosuke Irie

IPC: G06T5/00 ,  G06K9/62 ,  G06K9/46

CPC classification number: G06T5/003 ,  G06K9/4661 ,  G06K9/6215 ,  G06T2207/20024 ,  G06T2207/20192 ,  G06T2207/20201 ,  H04N5/2353

Abstract: Source image data is subjected to a logarithmic process (gamma correction process) (S11), and the luminance distribution of source image data is acquired (S12). Then, it is determined whether or not the luminance distribution of source image data corresponds to “a high luminance scene (highlight scene) biased toward a high luminance side” based on a characteristic of a luminance value equal to or greater than a first threshold value in the luminance distribution of source image data (S13). According to the determination result (Y/N of S13), a restoration process based on a point spread function of an optical system is controlled (S14, S15). A restoration filter which is used in the restoration process has a filter coefficient corresponding to image data before the logarithmic process.

Abstract translation: 源图像数据进行对数处理（伽马校正处理）（S11），获取源图像数据的亮度分布（S12）。 然后，基于等于或大于第一阈值的亮度值的特性，确定源图像数据的亮度分布是否对应于偏向高亮度侧的高亮度场景（高亮场景） 在源图像数据的亮度分布中（S13）。 根据确定结果（S13的Y / N），控制基于光学系统的点扩散功能的恢复处理（S14，S15）。 在恢复处理中使用的恢复滤波器具有对应于对数处理之前的图像数据的滤波器系数。