公开(公告)号：US20190340788A1

公开(公告)日：2019-11-07

申请号：US16518095

申请日：2019-07-22

Applicant: FUJIFILM Corporation

Inventor： Yosuke NARUSE ,  Yasunobu KISHINE ,  Kenkichi HAYASHI ,  Yoshiaki ISHII

IPC: G06T7/80 ,  H04N5/247 ,  G06T7/00 ,  H04N5/232 ,  G06T5/00

Abstract: An image processing device includes a transfer function input unit to which each of transfer functions of a plurality of imaging-systems is input, a calculation unit that calculates a target resolution value which is a target value of recovery processing that recovers a plurality of captured images to be output from each of the plurality of the imaging-systems based on each of the input transfer functions and a predetermined criterion, a recovery filter generation unit that generates a recovery filter used for the recovery processing with respect to each of the plurality of imaging-systems based on each of the transfer functions of the plurality of imaging-systems and a target resolution value, and a recovered image generation unit that performs the recovery processing with respect to the captured images acquired from the plurality of imaging-systems by using the recovery filter generated for each of the plurality of imaging-systems to generate recovered images.

公开(公告)号：US20170294005A1

公开(公告)日：2017-10-12

申请号：US15632689

申请日：2017-06-26

Applicant: FUJIFILM Corporation

Inventor： Yousuke NARUSE ,  Kenkichi HAYASHI ,  Masahiko SUGIMOTO

IPC: G06T5/20 ,  H04N5/357 ,  H04N9/64 ,  G06T5/00

CPC classification number: G06T5/20 ,  G06T5/003 ,  G06T2207/10024 ,  G06T2207/20024 ,  H04N1/58 ,  H04N5/217 ,  H04N5/357 ,  H04N9/045 ,  H04N9/646

Abstract: A restoration filter generation device which generates a restoration filter for performing a restoration process on luminance system image data, the restoration process being based on a point-image distribution in an optical system, the luminance system image data being image data relevant to luminance and being generated based on image data for each color of multiple colors, the restoration filter generation device including an MTF acquisition device which acquires a modulation transfer function MTF for the optical system; and a restoration filter generation device which generates the restoration filter based on the modulation transfer function MTF, the restoration filter suppressing an MTF value of image data for each color of the multiple colors to 1.0 or less at least in a region of a particular spatial frequency or less, the image data for each color of the multiple colors corresponding to the luminance system image data after the restoration process.

公开(公告)号：US20170294003A1

公开(公告)日：2017-10-12

申请号：US15632641

申请日：2017-06-26

Applicant: FUJIFILM Corporation

Inventor： Yousuke NARUSE ,  Kenkichi HAYASHI ,  Masahiko SUGIMOTO

IPC: G06T5/20 ,  H04N5/357 ,  H04N9/64 ,  G06T5/00

CPC classification number: G06T5/20 ,  G06T5/003 ,  G06T2207/10024 ,  G06T2207/20024 ,  H04N1/58 ,  H04N5/217 ,  H04N5/357 ,  H04N9/045 ,  H04N9/646

Abstract: A restoration filter generation device which generates a restoration filter for performing a restoration process on luminance system image data, the restoration process being based on a point-image distribution in an optical system, the luminance system image data being image data relevant to luminance and being generated based on image data for each color of multiple colors, the restoration filter generation device including an MTF acquisition device which acquires a modulation transfer function MTF for the optical system; and a restoration filter generation device which generates the restoration filter based on the modulation transfer function MTF, the restoration filter suppressing an MTF value of image data for each color of the multiple colors to 1.0 or less at least in a region of a particular spatial frequency or less, the image data for each color of the multiple colors corresponding to the luminance system image data after the restoration process.

公开(公告)号：US20170163915A1

公开(公告)日：2017-06-08

申请号：US15435950

申请日：2017-02-17

Applicant: FUJIFILM Corporation

Inventor： Yousuke NARUSE ,  Kenkichi HAYASHI

IPC: H04N5/357 ,  H04N5/232

CPC classification number: H04N5/3572 ,  G06T5/001 ,  G06T5/20 ,  H04N5/217 ,  H04N5/23209 ,  H04N5/23229 ,  H04N5/23293 ,  H04N17/002

Abstract: There are provided an image processing apparatus, an image processing method, and a program capable of realizing a desired image filtering process specified based on an optical characteristic of an individual optical system with high accuracy using a simple computation process. Further, there are provided a filter acquisition apparatus, a filter acquisition method, program, and a recording medium capable of acquiring a filter which is suitably usable in an image filtering process. A filtering process unit 41 (image processing apparatus 35) applies a filter to processing target data to acquire filter application process data, applies a gain to the filter application process data to acquire gain application process data, in each filtering process. In each filtering process, the gain applied to the filter application process data is acquired based on a target frequency characteristic of the image filtering process.

公开(公告)号：US20170004606A1

公开(公告)日：2017-01-05

申请号：US15265301

申请日：2016-09-14

Applicant: FUJIFILM Corporation

Inventor： Yousuke NARUSE ,  Masahiko SUGIMOTO ,  Kenkichi HAYASHI

IPC: G06T5/00 ,  H04N9/64 ,  H04N5/357 ,  G06T5/10

CPC classification number: G06T5/008 ,  G06T5/10 ,  G06T2207/10024 ,  G06T2207/20024 ,  H04N1/4092 ,  H04N5/3572 ,  H04N9/045 ,  H04N9/646

Abstract: Disclosed are an image processing device, an imaging device, an image processing method, and an image processing program capable of, when recovering a deteriorated image due to a point spread function of an optical system, effectively performing phase recovery and suppressing the occurrence of artifact due to frequency recovery processing. The image processing device includes a phase recovery processing unit which subjects image data acquired from an imaging element by capturing an object image using an optical system to phase recovery processing using a phase recovery filter based on a point spread function of the optical system, a gradation correction processing unit which subjects image data subjected to the phase recovery processing to nonlinear gradation correction, and a frequency recovery processing unit which subjects image data subjected to the gradation correction to frequency recovery processing using a frequency recovery filter based on the point spread function of the optical system.

Abstract translation: 公开了一种图像处理装置，成像装置，图像处理方法和图像处理程序，其能够在由于光学系统的点扩散功能恢复劣化图像时有效地执行相位恢复并抑制伪像的发生 由于频率恢复处理。 图像处理装置包括：相位恢复处理单元，其通过使用光学系统捕获对象图像来拍摄从成像元件获取的图像数据，使用基于光学系统的点扩散功能的相位恢复滤波器进行相位恢复处理;灰度 对经过相位恢复处理的图像数据进行非线性灰度校正的校正处理单元，以及频率恢复处理单元，其使用基于点扩散函数的频率恢复滤波器对进行了灰度校正的图像数据进行频率恢复处理 光学系统。

公开(公告)号：US20160027157A1

公开(公告)日：2016-01-28

申请号：US14850479

申请日：2015-09-10

Applicant: FUJIFILM Corporation

Inventor： Yousuke NARUSE ,  Kenkichi HAYASHI ,  Masahiko SUGIMOTO

IPC: G06T5/00 ,  G06T5/20

CPC classification number: G06T5/003 ,  G06T5/20 ,  G06T2207/10024 ,  G06T2207/20012 ,  G06T2207/20024 ,  G06T2207/20056 ,  G06T2207/20076 ,  H04N5/2254 ,  H04N9/045

Abstract: A restoration filter generation device according to one embodiment of the present invention includes: an information acquisition unit that acquires information showing a difference that depends on a color of an optical transfer function of an optical system; and a restoration filter generation unit that generates a restoration filter, which weakens restoration strength according to the difference that depends on the color of the optical transfer function on the basis of the information acquired by the information acquisition unit, and makes the restoration strength of the restoration filter weaker than the restoration strength of an ideal filter decided assuming that the difference that depends on the color of the optical transfer function does not exist. As a result, the overcorrection is reduced.

Abstract translation: 根据本发明的一个实施例的恢复滤波器生成装置包括：信息获取单元，其获取表示取决于光学系统的光学传递函数的颜色的差异的信息; 以及恢复滤波器生成单元，其生成恢复滤波器，所述恢复滤波器根据由所述信息获取单元获取的信息根据所述光学传递函数的颜色的差而削弱恢复强度，并且使得所述恢复滤波器的恢复强度 假设不存在取决于光学传递函数的颜色的差异，则恢复滤波器比理想滤波器的恢复强度弱。 结果，过度矫正减少了。

公开(公告)号：US20150317776A1

公开(公告)日：2015-11-05

申请号：US14800873

申请日：2015-07-16

Applicant: FUJIFILM Corporation

Inventor： Masahiko SUGIMOTO ,  Kenkichi HAYASHI ,  Yousuke NARUSE

IPC: G06T5/00 ,  H04N5/232

CPC classification number: G06T5/003 ,  G06T5/20 ,  G06T2207/10004 ,  H04N5/23229 ,  H04N5/357 ,  H04N9/045

Abstract: An image processing device according to an embodiment of the present invention obtains recovery image data by performing restoration processing using a restoration filter based on a point spread function of an optical system, on original image data obtained from an imaging element by imaging using the optical system. The restoration filter used in this restoration processing (a combination filter and realization filter Fr) is generated by combining multiple base filters Fb. Base filter Fb may be arbitrarily selected from filters that are confirmed beforehand to be effective to prevent image quality degradation.

Abstract translation: 根据本发明的实施例的图像处理装置通过使用基于光学系统的点扩散功能的恢复滤波器对通过使用光学系统进行成像的从成像元件获得的原始图像数据进行恢复处理来获得恢复图像数据 。 在该恢复处理中使用的恢复滤波器（组合滤波器和实现滤波器Fr）通过组合多个基本滤波器Fb而产生。 基本滤波器Fb可以从预先确认的有效防止图像质量劣化的滤波器中任意选择。

公开(公告)号：US20150124129A1

公开(公告)日：2015-05-07

申请号：US14589514

申请日：2015-01-05

Applicant: FUJIFILM CORPORATION

Inventor： Takashi AOKI ,  Hiroshi ENDO ,  Yoichi IWASAKI ,  Kenkichi HAYASHI

IPC: H04N9/077 ,  H04N9/64 ,  H04N9/80 ,  H04N5/232 ,  H04N9/04 ,  H04N5/374

CPC classification number: H04N9/077 ,  G02B7/346 ,  G03B13/36 ,  H04N5/23212 ,  H04N5/3696 ,  H04N5/3742 ,  H04N5/772 ,  H04N5/907 ,  H04N9/045 ,  H04N9/64 ,  H04N9/80 ,  H04N9/8045 ,  H04N2209/046

Abstract: According to the present invention, since a color image for a moving image including that for live view display includes image data on pixel lines including first and second phase difference pixels, phase difference AF can be accurately performed during the moving image taking. A color image for the moving image includes not only the image data on the pixel lines including the first and second phase difference pixels, but also image data on pixel lines that do not include the first and second phase difference pixels and only include normal pixels. Accordingly, the image quality of the color image for the moving image is improved, an image interpolation process can be accurately performed, and reduction in image quality of a taken image (still image and moving image) through the phase difference pixels can be prevented or alleviated.

Abstract translation: 根据本发明，由于包括用于实时取景显示的运动图像的彩色图像包括包括第一和第二相位差像素的像素线上的图像数据，所以可以在运动图像拍摄期间精确地执行相位差AF。 用于运动图像的彩色图像不仅包括包括第一和第二相位差像素的像素线上的图像数据，还包括不包括第一和第二相位差像素的像素线上的图像数据，并且仅包括正常像素。 因此，运动图像的彩色图像的图像质量得到改善，可以准确地执行图像内插处理，并且可以防止通过相位差像素降低拍摄图像（静止图像和运动图像）的图像质量，或者 缓解

公开(公告)号：US20150109491A1

公开(公告)日：2015-04-23

申请号：US14589398

申请日：2015-01-05

Applicant: FUJIFILM Corporation

Inventor： Kenkichi HAYASHI ,  Seiji TANAKA

IPC: H04N9/04

CPC classification number: H04N9/045

Abstract: In the color imaging element, a basic array pattern is repeatedly placed in a first direction and in a second direction, the basic array pattern includes two sets of patterns each including a first pattern corresponding to 2×2 pixels composed of first filters, a second pattern corresponding to 1×2 pixels composed of the first filters, third patterns each corresponding to 2×2 pixels each composed of second filters, and fourth patterns each corresponding to 1×2 pixels each composed of the second filters, in a color filter array, first patterns and the third patterns are alternately disposed in the first direction, and the first patterns and the fourth patterns are alternately disposed in the second direction.

Abstract translation: 在彩色成像元件中，基本阵列图案被重复放置在第一方向和第二方向上，基本阵列图案包括两组图案，每组图案包括对应于由第一滤镜组成的2×2像素的第一图案，第二组 对应于由第一滤光器组成的1×2像素的图案，分别对应于由第二滤光器构成的2×2像素的第三图案和分别对应于由第二滤光器构成的1×2像素的第四图案，滤色器阵列 第一图案和第三图案沿第一方向交替布置，并且第一图案和第四图案沿第二方向交替布置。

公开(公告)号：US20140307138A1

公开(公告)日：2014-10-16

申请号：US14316020

申请日：2014-06-26

Applicant: FUJIFILM Corporation

Inventor： Kenkichi HAYASHI ,  Seiji TANAKA ,  Tomoyuki KAWAI ,  Hidekazu KURAHASHI ,  Noriko KAWAMURA ,  Hirofumi HORII

IPC: H04N9/30

CPC classification number: H04N9/30 ,  G06T3/4015 ,  H01L27/14621 ,  H04N5/3456 ,  H04N5/3458 ,  H04N9/045 ,  H04N9/04511 ,  H04N2209/045

Abstract: In the present invention, effective thinned reading is performed when using an imaging device provided with a color filter other than a Bayer array. This imaging device (10) is provided with: an imaging element (14) containing a plurality of photoelectric conversion elements arrayed in a first and second direction; a color filter, wherein a basic array pattern resulting from a first and second filter being disposed in a predetermined pattern of N×M pixels and the first and second filter being disposed in a first and second direction is disposed repeatedly, and the first filter is disposed in a first-third direction in the color filter; a line image data generation means that, from the imaging element (14), reads the pixel signals of a plurality of pixels at a set cycle, and from the read pixel signals, generates line image data comprising pixel signals of pixels arrayed along the second direction and arrayed in an (N+k) line cycle in the first direction among the plurality of pixels; and an image data generation means that generates image data on the basis of the line image data.

Abstract translation: 在本发明中，当使用设置有除拜耳阵列之外的滤色器的成像装置时，执行有效的薄化读取。 该成像装置（10）设置有：成像元件（14），其包含沿第一和第二方向排列的多个光电转换元件; 滤色器，其中由第一和第二滤色器产生的基本阵列图案以N×M个像素的预定图案布置，并且第一和第二滤色器被设置在第一和第二方向上，并且第一滤色器 设置在滤色器中的第一至第三方向上; 行图像数据生成装置，其从成像元件（14）以设定的周期读取多个像素的像素信号，并且从读取的像素信号生成包括沿着第二个像素排列的像素的像素信号的行图像数据 方向并排列在多个像素中的第一方向的（N + k）行周期中; 以及基于行图像数据生成图像数据的图像数据生成装置。