-
公开(公告)号:US10326947B2
公开(公告)日:2019-06-18
申请号:US15789146
申请日:2017-10-20
Applicant: FUJIFILM Corporation
Inventor: Kenkichi Hayashi , Junichi Tanaka , Yousuke Naruse , Masahiko Sugimoto
IPC: H04N5/243 , G06T5/00 , H04N1/409 , H04N5/232 , G06T5/20 , H04N5/235 , H04N5/33 , H04N9/73 , H04N9/68 , H04N9/04 , H04N9/077
Abstract: The present invention provides an image processing device, an imaging device, an image processing method, and a program which are capable of accurately correcting blurring caused in first image data of an image using a near-infrared ray as a light source and, accurately performing a point image restoration process on second image data of an image using visible light and a near-infrared ray as a light source. An image processing device according to an aspect of the present invention includes an image input unit, a determination unit that determines whether image data is first image data or second image data, a first restoration processing unit that performs a first restoration process using first restoration filters for performing phase correction and amplitude restoration on the determined first image data, and a second restoration processing unit that performs a second restoration process using second restoration filters for performing amplitude restoration without phase correction on the determined second image data.
-
公开(公告)号:US09984448B2
公开(公告)日:2018-05-29
申请号:US15632641
申请日:2017-06-26
Applicant: FUJIFILM Corporation
Inventor: Yousuke Naruse , Kenkichi Hayashi , Masahiko Sugimoto
CPC classification number: G06T5/20 , G06T5/003 , G06T2207/10024 , G06T2207/20024 , H04N1/58 , H04N5/217 , H04N5/357 , H04N9/045 , H04N9/646
Abstract: A restoration filter generation device which generates a restoration filter for performing a restoration process on luminance system image data, the restoration process being based on a point-image distribution in an optical system, the luminance system image data being image data relevant to luminance and being generated based on image data for each color of multiple colors, the restoration filter generation device including an MTF acquisition device which acquires a modulation transfer function MTF for the optical system; and a restoration filter generation device which generates the restoration filter based on the modulation transfer function MTF, the restoration filter suppressing an MTF value of image data for each color of the multiple colors to 1.0 or less at least in a region of a particular spatial frequency or less, the image data for each color of the multiple colors corresponding to the luminance system image data after the restoration process.
-
公开(公告)号:US09906732B2
公开(公告)日:2018-02-27
申请号:US15012239
申请日:2016-02-01
Applicant: FUJIFILM Corporation
Inventor: Kosuke Irie , Masahiko Sugimoto , Yousuke Naruse , Kenkichi Hayashi
CPC classification number: H04N5/243 , G06T5/003 , G06T2207/20192 , H04N5/23238 , H04N5/23296 , H04N5/238 , H04N9/045
Abstract: A restoration filter based on a point spread function of an optical system is applied to source image data acquired through photographing using the optical system to acquire restored image data (S13: filter application step). Adjustment of an amplification factor of the difference between source image data and restored image data is performed, and recovered image data is acquired from the difference after adjustment and source image data (S15: gain adjustment step). In the filter application step, a common filter determined regardless of a value of a magnification of an optical zoom of the optical system is used as the restoration filter, and in the gain adjustment step, the amplification factor is determined based on the magnification of the optical zoom of the optical system.
-
公开(公告)号:US09727955B2
公开(公告)日:2017-08-08
申请号:US14837779
申请日:2015-08-27
Applicant: FUJIFILM Corporation
Inventor: Yousuke Naruse , Kenkichi Hayashi , Masahiko Sugimoto
CPC classification number: G06T5/20 , G06T5/003 , G06T2207/10024 , G06T2207/20024 , H04N1/58 , H04N5/217 , H04N5/357 , H04N9/045 , H04N9/646
Abstract: A restoration filter generation device which generates a restoration filter for performing a restoration process on luminance system image data, the restoration process being based on a point-image distribution in an optical system, the luminance system image data being image data relevant to luminance and being generated based on image data for each color of multiple colors, the restoration filter generation device including an MTF acquisition device which acquires a modulation transfer function MTF for the optical system; and a restoration filter generation device which generates the restoration filter based on the modulation transfer function MTF, the restoration filter suppressing an MTF value of image data for each color of the multiple colors to 1.0 or less at least in a region of a particular spatial frequency or less, the image data for each color of the multiple colors corresponding to the luminance system image data after the restoration process.
-
公开(公告)号:US09363430B2
公开(公告)日:2016-06-07
申请号:US14661361
申请日:2015-03-18
Applicant: FUJIFILM Corporation
Inventor: Hiroshi Endo , Kenkichi Hayashi , Kousuke Irie , Yousuke Naruse
CPC classification number: H04N5/23212 , G02B7/38 , G02B13/0015 , G06T5/001 , G06T5/003 , H04N5/217 , H04N5/23209
Abstract: According to the present invention, when restoration processing of a taken image by the use of a restoration filter corresponding to a subject distance is performed, by storing only a corresponding restoration filter in a subject distance range between the estimation variation close range and the infinity such that a restoration filter in a range on the nearer side than the estimation variation close range is not provided from the beginning, it is thereby possible to reduce the number of restoration filters held beforehand.
Abstract translation: 根据本发明,当通过使用与被摄体距离相对应的恢复滤波器进行拍摄图像的恢复处理时,仅通过在估计变化近似范围和无限远之间的对象距离范围内仅存储相应的恢复滤波器, 从一开始就没有提供比估计变化近程范围更靠近的范围的恢复滤波器,从而可以减少预先保持的恢复滤波器的数量。
-
公开(公告)号:US10699387B2
公开(公告)日:2020-06-30
申请号:US16110238
申请日:2018-08-23
Applicant: FUJIFILM Corporation
Inventor: Kenkichi Hayashi , Yousuke Naruse , Yasunobu Kishine
Abstract: Provided are an image processing device, an imaging device, and an image processing method which are capable of obtaining a captured image with desired image quality. An image processing unit functioning as an image processing device includes a point image restoration processing unit that performs point image restoration processing using a restoration filter based on a point spread function of a lens unit on image data obtained from an imaging element through imaging of a subject using an imaging unit having the lens unit including a lens and the imaging element, and a determination unit that determines to perform the point image restoration processing using the point image restoration processing unit in a case where a modulation transfer function in a predetermined spatial frequency in which the point image restoration processing contributes is smaller than a threshold value. Here, the modulation transfer function is changed by an imaging condition. The point image restoration processing unit performs the point image restoration processing only in a case where the determination unit determines to perform the point image restoration processing.
-
公开(公告)号:US10027909B2
公开(公告)日:2018-07-17
申请号:US15704941
申请日:2017-09-14
Applicant: FUJIFILM Corporation
Inventor: Kenkichi Hayashi , Masahiko Sugimoto , Yousuke Naruse , Kosuke Irie
Abstract: An imaging device 10 according to one aspect of the present invention includes: a subject distance acquisition section 115; a movement amount acquisition section 120 that acquires an amount of movement of the subject on the basis of the subject distance; a restoration processing determination section 125 that determines, on the basis of the amount of movement acquired by the movement amount acquisition section 120, whether the restoration processing should be performed on the images through a restoration filter, a restoration strength of the restoration processing should be adjusted and the restoration processing should be performed on the images, or the restoration processing should not be performed on the images; and a restoration processing execution section 105 that performs the restoration processing on the images through the restoration filter or with the adjusted restoration strength, on the basis of the determination of the restoration processing determination section 125.
-
公开(公告)号:US09854187B2
公开(公告)日:2017-12-26
申请号:US15435950
申请日:2017-02-17
Applicant: FUJIFILM Corporation
Inventor: Yousuke Naruse , Kenkichi Hayashi
CPC classification number: H04N5/3572 , G06T5/001 , G06T5/20 , H04N5/217 , H04N5/23209 , H04N5/23229 , H04N5/23293 , H04N17/002
Abstract: There are provided an image processing apparatus, an image processing method, and a program capable of realizing a desired image filtering process specified based on an optical characteristic of an individual optical system with high accuracy using a simple computation process. Further, there are provided a filter acquisition apparatus, a filter acquisition method, program, and a recording medium capable of acquiring a filter which is suitably usable in an image filtering process. A filtering process unit 41 (image processing apparatus 35) applies a filter to processing target data to acquire filter application process data, applies a gain to the filter application process data to acquire gain application process data, in each filtering process. In each filtering process, the gain applied to the filter application process data is acquired based on a target frequency characteristic of the image filtering process.
-
公开(公告)号:US09826150B2
公开(公告)日:2017-11-21
申请号:US15135948
申请日:2016-04-22
Applicant: FUJIFILM Corporation
Inventor: Yousuke Naruse , Kenkichi Hayashi
CPC classification number: H04N5/23229 , G06T5/007
Abstract: There are provided a signal processing device, an imaging apparatus, a parameter generating method, a signal processing method, and a program that enable desired frequency component adjustment without complicating the processing. An image processing unit 35 includes a signal processing section that adjusts a signal according to a frequency and a filter processing control section 37 (automatic strength adjustment section 52) that controls the signal processing section. The signal processing section includes a first filter processing section 38 that performs first filter processing and a second filter processing section 39 that performs second filter processing. The automatic strength adjustment section 52 acquires the adjustment magnification (first gain adjustment magnification U and second gain adjustment magnification V) in one of the first filter processing and the second filter processing, and calculates the adjustment magnification in the other processing based on a total gain adjustment rate D.
-
公开(公告)号:US09619871B2
公开(公告)日:2017-04-11
申请号:US15288485
申请日:2016-10-07
Applicant: FUJIFILM Corporation
Inventor: Masahiko Sugimoto , Kenkichi Hayashi , Yousuke Naruse , Kosuke Irie
CPC classification number: G06T5/003 , G06K9/522 , G06T5/50 , G06T2207/20024 , G06T2207/20048 , H04N5/23229 , H04N5/23293
Abstract: An image processing unit 36 includes a frequency analysis unit 40, an optical characteristic acquisition unit 42, and a filter acquisition unit 44. The frequency analysis unit 40 acquires data in the frequency domain of each of first image data and second image data which are acquired by capturing an object image using a first optical system and a second optical system, respectively. The optical characteristic acquisition unit 42 compares the data in the frequency domain of the first image data with the data in the frequency domain of the second image data to acquire frequency characteristic data related to optical characteristics of the second optical system. The filter acquisition unit 44 acquires a sharpening filter associated with the second optical system from a plurality of sharpening filters associated with the first optical system.
-
-
-
-
-
-
-
-
-