公开(公告)号：US20190014244A1

公开(公告)日：2019-01-10

申请号：US16129913

申请日：2018-09-13

Applicant: FUJIFILM Corporation

Inventor： Yousuke NARUSE ,  Takashi KUNUGISE ,  Kenkichi HAYASHI

IPC: H04N5/225 ,  G03B17/14 ,  G06T5/00

Abstract: An image processing device, an image processing system, and an image processing method capable of easily correcting image deterioration caused by nonuniform optical characteristics around an optical axis of a lens according to a position in a rotational direction of a lens barrel are provided. An image processing device includes a communication unit (42) that inputs a first image indicating a correction reference position in a rotation direction of a lens barrel (24) and a second image that is a correction target, the first image and the second image being obtained by imaging of the imaging device (10), a rotation position recognition unit (62) that recognizes the correction reference position in the rotational direction on the basis of the first image, a correction information acquisition unit (66) that acquires correction information on the basis of the correction reference position in the rotation direction, and an image correction unit (68) that corrects the second image on the basis of the correction information.

公开(公告)号：US20180365812A1

公开(公告)日：2018-12-20

申请号：US16110238

申请日：2018-08-23

Applicant: FUJIFILM Corporation

Inventor： Kenkichi HAYASHI ,  Yousuke NARUSE ,  Yasunobu KISHINE

IPC: G06T5/00 ,  G06T5/20

CPC classification number: G06T5/003 ,  G06T5/20 ,  G06T2207/20004 ,  G06T2207/20008 ,  H04N1/409 ,  H04N5/217 ,  H04N5/35721

Abstract: Provided are an image processing device, an imaging device, and an image processing method which are capable of obtaining a captured image with desired image quality. An image processing unit functioning as an image processing device includes a point image restoration processing unit that performs point image restoration processing using a restoration filter based on a point spread function of a lens unit on image data obtained from an imaging element through imaging of a subject using an imaging unit having the lens unit including a lens and the imaging element, and a determination unit that determines to perform the point image restoration processing using the point image restoration processing unit in a case where a modulation transfer function in a predetermined spatial frequency in which the point image restoration processing contributes is smaller than a threshold value. Here, the modulation transfer function is changed by an imaging condition. The point image restoration processing unit performs the point image restoration processing only in a case where the determination unit determines to perform the point image restoration processing.

公开(公告)号：US20180040108A1

公开(公告)日：2018-02-08

申请号：US15789015

申请日：2017-10-20

Applicant: FUJIFILM Corporation

Inventor： Junichi TANAKA ,  Kenkichi HAYASHI ,  Yousuke NARUSE

IPC: G06T5/00 ,  H04N5/33 ,  G06T5/20 ,  G02B5/20

CPC classification number: G06T5/003 ,  G02B5/208 ,  G03B11/00 ,  G03B15/00 ,  G06T5/20 ,  G06T2207/10048 ,  H04N5/2254 ,  H04N5/23212 ,  H04N5/23229 ,  H04N5/23245 ,  H04N5/332

Abstract: In a case where IR data of a near-infrared light image is data in which a visible light component and a near-infrared light component coexist, a point image restoration process is performed on the IR data using a first point image restoration filter based on a first point spread function for visible light of the optical system and a second point image restoration filter based on a second point spread function for near-infrared light of the optical system. An appropriate point image restoration process is performed on the IR data that is captured in a time zone of twilight or dawn by performing weighted averaging on a point image restoration process using the first point image restoration filter and a point image restoration process using the second point image restoration filter using a first gain α and a second gain β according to a light amount ratio between visible light and near-infrared light at the time of capturing the IR data.

公开(公告)号：US20160241779A1

公开(公告)日：2016-08-18

申请号：US15135948

申请日：2016-04-22

Applicant: FUJIFILM Corporation

Inventor： Yousuke NARUSE ,  Kenkichi HAYASHI

IPC: H04N5/232 ,  G06T5/00

CPC classification number: H04N5/23229 ,  G06T5/007

Abstract: There are provided a signal processing device, an imaging apparatus, a parameter generating method, a signal processing method, and a program that enable desired frequency component adjustment without complicating the processing. An image processing unit 35 includes a signal processing section that adjusts a signal according to a frequency and a filter processing control section 37 (automatic strength adjustment section 52) that controls the signal processing section. The signal processing section includes a first filter processing section 38 that performs first filter processing and a second filter processing section 39 that performs second filter processing. The automatic strength adjustment section 52 acquires the adjustment magnification (first gain adjustment magnification U and second gain adjustment magnification V) in one of the first filter processing and the second filter processing, and calculates the adjustment magnification in the other processing based on a total gain adjustment rate D.

Abstract translation: 提供了一种信号处理装置，成像装置，参数产生方法，信号处理方法和程序，其能够在不使处理复杂化的情况下实现期望的频率分量调整。 图像处理单元35包括根据频率调节信号的信号处理部分和控制信号处理部分的滤波处理控制部分37（自动强度调节部分52）。 信号处理部分包括执行第一滤波处理的第一滤波处理部分38和进行第二滤波处理的第二滤波处理部分39。 自动强度调节部52在第一滤波处理和第二滤波处理之一中获取调整倍率（第一增益调整倍率U和第二增益调整倍率V），并且基于总增益来计算其他处理中的调整倍数 调整率D.

公开(公告)号：US20160150161A1

公开(公告)日：2016-05-26

申请号：US15012239

申请日：2016-02-01

Applicant: FUJIFILM Corporation

Inventor： Kosuke IRIE ,  Masahiko SUGIMOTO ,  Yousuke NARUSE ,  Kenkichi HAYASHI

IPC: H04N5/243 ,  H04N5/232 ,  H04N5/238

CPC classification number: H04N5/243 ,  G06T5/003 ,  G06T2207/20192 ,  H04N5/23238 ,  H04N5/23296 ,  H04N5/238 ,  H04N9/045

Abstract: A restoration filter based on a point spread function of an optical system is applied to source image data acquired through photographing using the optical system to acquire restored image data (S13: filter application step). Adjustment of an amplification factor of the difference between source image data and restored image data is performed, and recovered image data is acquired from the difference after adjustment and source image data (S15: gain adjustment step). In the filter application step, a common filter determined regardless of a value of a magnification of an optical zoom of the optical system is used as the restoration filter, and in the gain adjustment step, the amplification factor is determined based on the magnification of the optical zoom of the optical system.

Abstract translation: 将基于光学系统的点扩散功能的恢复滤波器应用于通过使用光学系统拍摄获得的源图像数据，以获取恢复的图像数据（S13：滤波器应用步骤）。 执行源图像数据和恢复的图像数据之间的差异的放大因子的调整，并且从调整后的差异和源图像数据获取恢复的图像数据（S15：增益调整步骤）。 在滤波器应用步骤中，使用不考虑光学系统的光学变焦的倍率的值而确定的公共滤波器作为恢复滤波器，并且在增益调整步骤中，基于放大率 光学系统的光学变焦。

公开(公告)号：US20160140697A1

公开(公告)日：2016-05-19

申请号：US15003849

申请日：2016-01-22

Applicant: FUJIFILM Corporation

Inventor： Masahiko SUGIMOTO ,  Kenkichi HAYASHI ,  Yousuke NARUSE ,  Kosuke IRIE

IPC: G06T5/00 ,  G06T7/20 ,  H04N5/225 ,  G06T5/20

CPC classification number: G06T5/003 ,  G06T5/20 ,  G06T5/50 ,  G06T7/20 ,  G06T2207/10016 ,  G06T2207/20192 ,  G06T2207/20201 ,  H04N5/225 ,  H04N5/23229

Abstract: Disclosed are an image processing device, an imaging device, an image processing method, and a program capable of acquiring a moving image with excellent image quality while maintaining continuity of a restoration process between frames even if there is a rapid change of a photographing environment in a moving image. An image processing device includes a restoration control processing unit 36 which subjects a moving image including a plurality of frames acquired by photographing using an optical system to a restoration process based on a point spread function of the optical system to acquire recovered image data. The restoration control processing unit 36 controls the restoration process for a frame to be processed among a plurality of frames based on imaging information of a reference frame including a frame after the frame to be processed in a time series.

Abstract translation: 公开了一种图像处理装置，成像装置，图像处理方法和程序，其能够获得具有优异图像质量的运动图像，同时保持帧之间的恢复处理的连续性，即使存在拍摄环境的快速变化 运动图像。 一种图像处理装置包括：恢复控制处理单元36，其基于光学系统的点扩展功能，使用光学系统拍摄包含通过拍摄获得的多个帧的运动图像进行恢复处理，以获取恢复的图像数据。 恢复控制处理单元36基于包括在时间序列中的要处理的帧之后的帧的参考帧的成像信息，控制多个帧之间的要处理的帧的恢复处理。

公开(公告)号：US20150334359A1

公开(公告)日：2015-11-19

申请号：US14810168

申请日：2015-07-27

Applicant: FUJIFILM Corporation

Inventor： Kenkichi HAYASHI ,  Masahiko SUGIMOTO ,  Yousuke NARUSE

IPC: H04N9/04 ,  H04N9/64 ,  G06T5/20 ,  G06T3/40 ,  G06T5/00

CPC classification number: H04N9/045 ,  G06T3/4015 ,  G06T5/003 ,  G06T5/20 ,  G06T2200/32 ,  G06T2207/10024 ,  H04N9/646

Abstract: An image processing device includes a demosaicing process device, a luminance system image data acquisition device that acquires luminance system image data as image data regarding the luminance, a point image restoration process execution device, an information acquisition device that acquires control information concerning execution of the point image restoration process on the basis of imaging information concerning an imaging condition of a subject, and a point image restoration process control device.

Abstract translation: 一种图像处理装置，包括：去马赛克处理装置，获取亮度系统图像数据作为关于亮度的图像数据的亮度系统图像数据获取装置，点图像恢复处理执行装置，获取关于所述亮度的执行的控制信息的信息获取装置 基于与被摄体的成像条件有关的成像信息和点像恢复处理控制装置的点图像恢复处理。

公开(公告)号：US20150326838A1

公开(公告)日：2015-11-12

申请号：US14804915

申请日：2015-07-21

Applicant: FUJIFILM Corporation

Inventor： Tomoyuki KAWAI ,  Kenkichi HAYASHI ,  Hidekazu KURAHASHI

IPC: H04N9/04 ,  H04N9/64 ,  H04N9/73 ,  H04N5/372 ,  H04N5/374

CPC classification number: H04N9/045 ,  H01L27/14621 ,  H04N5/217 ,  H04N5/359 ,  H04N5/372 ,  H04N5/374 ,  H04N9/646 ,  H04N9/735

Abstract: Pixels constituting the imaging element include at least four types of the determination pixels for which color filter patterns of adjacent pixels thereof are different from one another. At least one of pixels, which are adjacent to each determination pixel, is a first color pixel that has a color filter with a first color. Further, among the pixels which are adjacent to each determination pixel, a pixel, which is opposed to the first color pixel with the determination pixel interposed therebetween, has a color filter other than the color filter with the first color. Abnormal oblique incident light, which is incident into the imaging element, is detected on the basis of average values of the respective pixel data pieces corresponding to the types of these determination pixels.

Abstract translation: 构成成像元件的像素包括至少四种类型的相邻像素的滤色器图案彼此不同的确定像素。 与每个确定像素相邻的像素中的至少一个是具有第一颜色的滤色器的第一颜色像素。 此外，在与每个确定像素相邻的像素中，与其中插入有确定像素的第一彩色像素相对的像素具有除了具有第一颜色的滤色器之外的滤色器。 基于与这些确定像素的类型对应的各个像素数据的平均值来检测入射到成像元件中的异常倾斜入射光。

公开(公告)号：US20150271461A1

公开(公告)日：2015-09-24

申请号：US14729872

申请日：2015-06-03

Applicant: FUJIFILM Corporation

Inventor： Kenkichi HAYASHI

IPC: H04N9/73 ,  H04N9/64 ,  H04N9/04 ,  H04N5/359

CPC classification number: H04N9/735 ,  H04N5/359 ,  H04N9/045 ,  H04N9/07 ,  H04N9/646

Abstract: According to an aspect of the present invention, when the abnormal oblique incident light is not detected, the first color mixture correction based on the pixel data of the adjacent pixel to the correction target pixel is performed for the pixel data of the correction target pixel, and when the abnormal oblique incident light is detected, the second color mixture correction based on the pixel data of the peripheral pixel to the correction target pixel is performed. Therefore, this aspect can be applied, particularly, even to an imaging element having a large array matrix size, and it is possible to solve the level difference among same-color pixels that occurs due to the influence of the leakage of the abnormal oblique incident light (the ghost light and the like) to the adjacent pixel, and to suppress the image quality degradation due to the abnormal oblique incident light.

Abstract translation: 根据本发明的一个方面，当未检测到异常倾斜入射光时，对校正对象像素的像素数据执行基于与校正对象像素相邻的像素的像素数据的第一颜色混合校正， 并且当检测到异常倾斜入射光时，执行基于周边像素对校正对象像素的像素数据的第二色彩混合校正。 因此，该方面特别适用于具有大阵列矩阵尺寸的成像元件，并且可以解决由于异常倾斜事件的泄漏的影响而发生的相同像素之间的电平差 光（鬼影等）到相邻像素，并且抑制由于异常倾斜入射光引起的图像质量劣化。

公开(公告)号：US20150195448A1

公开(公告)日：2015-07-09

申请号：US14661670

申请日：2015-03-18

Applicant: FUJIFILM Corporation

Inventor： Hiroshi ENDO ,  Kenkichi HAYASHI ,  Kousuke IRIE ,  Yousuke NARUSE

IPC: H04N5/232 ,  G06T5/00 ,  G06T7/00 ,  G02B13/00

CPC classification number: H04N5/23212 ,  G02B7/14 ,  G02B7/36 ,  G02B13/0015 ,  G06T5/001 ,  G06T5/003 ,  G06T7/529 ,  H04N5/23229 ,  H04N5/23245 ,  H04N2101/00

Abstract: According to the present invention, even if variation (estimation variation) is caused in a subject distance estimated at the time of imaging when restoration processing of a taken image is performed using a restoration filter corresponding to the subject distance, since an optimal restoration filter that conforms to a subject distance taking into account the maximum infinity-side estimation variation and does not cause overcorrection is selected, it is possible to prevent resolution degradation due to overcorrection and achieve the improvement of resolution by the restoration filter.

Abstract translation: 根据本发明，即使在使用与被摄体距离对应的恢复滤波器进行拍摄图像的恢复处理时，在成像时估计的被摄体距离中产生变化（估计变化），因此，最佳恢复滤波器 考虑到最大无穷大侧估计变化并且不引起过度校正被选择，可以防止由于过度校正引起的分辨率劣化，并且通过恢复滤波器实现分辨率的提高。