公开(公告)号：US20160055628A1

公开(公告)日：2016-02-25

申请号：US14933759

申请日：2015-11-05

Applicant: FUJIFILM Corporation

Inventor： Kenkichi HAYASHI ,  Masahiko SUGIMOTO ,  Yousuke NARUSE

IPC: G06T5/00 ,  H04N5/357

CPC classification number: G06T5/003 ,  G06T2207/20024 ,  G06T2207/20201 ,  H04N5/23212 ,  H04N5/3572 ,  H04N9/045

Abstract: An image processing device includes a point-image restoration processing unit 40 which receives a photographic image as input, and subjects the photographic image to a point-image restoration process based on point-image restoration information to generate a restored image, an area information output unit 45 which outputs area information relating to a specific area in the restored image where restoration strength of the point-image restoration process based on the point-image restoration information is equal to or greater than a threshold value, a display control unit 50 which receives the restored image and the area information as input and performs display control to highlight the specific area in the restored image based on the area information, and a display unit 55 which highlights at least the specific area based on the display control by the display control unit 50.

Abstract translation: 图像处理装置包括点摄像恢复处理单元40，其接收摄影图像作为输入，并且基于点图像恢复信息对摄影图像进行点图像恢复处理，以生成恢复图像，区域信息输出 单元45，其输出与基于点图像恢复信息的点图像恢复处理的恢复强度等于或大于阈值的还原图像中的特定区域相关的区域信息;接收 恢复的图像和区域信息作为输入，并且基于区域信息执行显示控制以突出恢复的图像中的特定区域;以及显示单元55，其基于显示控制单元的显示控制至少突出显示特定区域 50。

公开(公告)号：US20150199795A1

公开(公告)日：2015-07-16

申请号：US14668256

申请日：2015-03-25

Applicant: FUJIFILM CORPORATION

Inventor： Yousuke NARUSE ,  Kenkichi HAYASHI ,  Hiroshi ENDO ,  Kousuke IRIE

IPC: G06T5/00 ,  G06T5/10

CPC classification number: G06T5/001 ,  G06T5/003 ,  G06T5/10 ,  H04N5/217 ,  H04N5/23209

Abstract: An image processing device includes a statistical information acquiring unit, an optical information acquiring unit, a filter information calculating unit and a filter coefficient calculating unit. The filter information calculating unit obtains filter information of a restoration filter for point image restoration processing according to at least one of statistical information and optical information. The filter information includes information related to number of taps of the restoration filter and information indicating a kind of symmetry of the restoration filter. The filter coefficient calculating unit calculates a filter coefficient of the restoration filter according to the statistical information and the optical information with at least the information related to the number of taps of the restoration filter and the information indicating the kind of the symmetry of the restoration filter of the filter information as a constraint condition.

Abstract translation: 一种图像处理装置包括统计信息获取单元，光学信息获取单元，滤波器信息计算单元和滤波器系数计算单元。 滤波器信息计算单元根据统计信息和光信息中的至少一个获得用于点图像恢复处理的恢复滤波器的滤波器信息。 滤波器信息包括与恢复滤波器的抽头数相关的信息和指示恢复滤波器的对称类型的信息。 滤波器系数计算单元根据统计信息和至少与恢复滤波器的抽头数相关的信息的光信息和表示恢复滤波器的对称类型的信息来计算恢复滤波器的滤波器系数 的过滤器信息作为约束条件。

公开(公告)号：US20150195447A1

公开(公告)日：2015-07-09

申请号：US14661361

申请日：2015-03-18

Applicant: FUJIFILM Corporation

Inventor： Hiroshi ENDO ,  Kenkichi HAYASHI ,  Kousuke IRIE ,  Yousuke NARUSE

IPC: H04N5/232 ,  G06T5/00 ,  G02B13/00

CPC classification number: H04N5/23212 ,  G02B7/38 ,  G02B13/0015 ,  G06T5/001 ,  G06T5/003 ,  H04N5/217 ,  H04N5/23209

Abstract: According to the present invention, when restoration processing of a taken image by the use of a restoration filter corresponding to a subject distance is performed, by storing only a corresponding restoration filter in a subject distance range between the estimation variation close range and the infinity such that a restoration filter in a range on the nearer side than the estimation variation close range is not provided from the beginning, it is thereby possible to reduce the number of restoration filters held beforehand.

Abstract translation: 根据本发明，当通过使用与被摄体距离相对应的恢复滤波器进行拍摄图像的恢复处理时，仅通过在估计变化近似范围和无限远之间的对象距离范围内仅存储相应的恢复滤波器， 从一开始就没有提供比估计变化近程范围更靠近的范围的恢复滤波器，从而可以减少预先保持的恢复滤波器的数量。

公开(公告)号：US20150138398A1

公开(公告)日：2015-05-21

申请号：US14564312

申请日：2014-12-09

Applicant: FUJIFILM Corporation

Inventor： Kenkichi HAYASHI

IPC: H04N9/64 ,  H04N9/65 ,  H04N9/873 ,  H04N9/04

CPC classification number: H04N9/646 ,  H04N1/648 ,  H04N5/77 ,  H04N9/045 ,  H04N9/65 ,  H04N9/793 ,  H04N9/8042 ,  H04N9/873

Abstract: Provided is an image processing system capable of coping with data which is obtained in a new color filter array, and making full use of the performance of a receiving-side device by reducing the influence of a difference in the performance of the receiving-side device on an image quality. An image processing system 100 includes a transmitting-side device 101 and a receiving-side device 102. The transmitting-side device 101 generates intermediate data by preprocessing RAW data, generates three-plane color data by processing synchronization of the intermediate data, and outputs placement information for specifying pixel positions corresponding to the three-plane color data and the intermediate data. The receiving-side device 102 restores the intermediate data using the three-plane color data and the placement information from the transmitting-side device 101, and generates the three-plane color data from the restored intermediate data.

Abstract translation: 提供了一种图像处理系统，其能够应对在新的滤色器阵列中获得的数据，并且通过减少接收侧设备的性能的差异的影响来充分利用接收侧设备的性能 对图像质量。 图像处理系统100包括发送侧设备101和接收侧设备102.发送侧设备101通过预处理RAW数据生成中间数据，通过处理中间数据的同步来生成三平面彩色数据，并输出 用于指定对应于三平面彩色数据和中间数据的像素位置的放置信息。 接收侧设备102使用来自发送侧设备101的三平面颜色数据和布局信息来恢复中间数据，并且从恢复的中间数据生成三平面颜色数据。

公开(公告)号：US20150117832A1

公开(公告)日：2015-04-30

申请号：US14589478

申请日：2015-01-05

Applicant: FUJIFILM Corporation

Inventor： Takashi AOKI ,  Yoichi IWASAKI ,  Hiroshi ENDO ,  Kenkichi HAYASHI

IPC: H04N9/077 ,  H04N9/64 ,  H04N9/80 ,  H04N5/232 ,  H04N9/04 ,  H04N5/374

CPC classification number: H04N9/077 ,  H01L27/14627 ,  H04N5/23212 ,  H04N5/345 ,  H04N5/3456 ,  H04N5/3696 ,  H04N5/3742 ,  H04N5/772 ,  H04N9/045 ,  H04N9/64 ,  H04N9/80 ,  H04N9/8042 ,  H04N2209/046

Abstract: One aspect of the present invention thinning-reads pixel signals from the multiple pixels according to a thinning pattern from an image pickup element, or extracts pixel signals from the multiple pixels according to the thinning pattern from a color image that is read from the image pickup element and corresponds to the color filter array, and acquires a thinned color image. Then, moving image data is generated on the basis of the thinned color image. Adoption of the thinned color image as a target image to be subjected to moving image processing can facilitate reduction in processing time per frame, and prevent the frame rate from decreasing. Furthermore, thinning-reading pixels from the image pickup element can facilitate reduction in time of reading an image from the image pickup element.

Abstract translation: 根据本发明的一个方面，根据来自图像拾取元件的细化图案，从多个像素稀疏读取像素信号，或者根据从图像拾取器读取的彩色图像根据稀疏图案提取来自多个像素的像素信号 元素，并对应于滤色器阵列，并获取变薄的彩色图像。 然后，基于变薄的彩色图像生成运动图像数据。 作为要进行运动图像处理的目标图像的细化彩色图像的采用可以有助于减少每帧的处理时间，并且防止帧速率降低。 此外，来自图像拾取元件的变薄读取像素可以有助于减少从图像拾取元件读取图像的时间。

公开(公告)号：US20150116554A1

公开(公告)日：2015-04-30

申请号：US14589572

申请日：2015-01-05

Applicant: FUJIFILM Corporation

Inventor： Seiji TANAKA ,  Kenkichi HAYASHI ,  Noriko KAWAMURA

IPC: H04N9/04

CPC classification number: H04N9/045 ,  H01L27/14621 ,  H01L27/14625 ,  H01L27/14645 ,  H04N9/07

Abstract: In the color imaging element and the imaging device according to an aspect of the present invention, a basic array pattern is repeatedly placed in a first direction and in a second direction, the basic array pattern includes four or more rectangular patterns each corresponding to 3×2 pixels each composed of a first filter, a color filter array includes therein grating filter lines surrounding the four directions of the rectangular pattern, the color filter array includes therein the first filters each disposed in each line in the first direction, in the second direction, in a third direction, and in a fourth direction, and the basic array pattern includes therein one or more second filters of each color, each disposed in each line in the first direction in the second direction.

Abstract translation: 在根据本发明的一个方面的彩色成像元件和成像装置中，基本阵列图案被重复地设置在第一方向和第二方向上，基本阵列图案包括四个或更多个矩形图案，每个矩形图案对应于3× 2个像素，每个由第一滤光器组成，滤色器阵列包括围绕矩形图案的四个方向的光栅滤光器线，滤色器阵列包括在第一方向上沿着第一方向设置在每一行中的第一滤光器， 在第三方向和第四方向上，基本阵列图案包括一个或多个每种颜色的第二滤光器，每个第二滤光器沿第二方向沿第一方向设置在每一行中。

公开(公告)号：US20150109494A1

公开(公告)日：2015-04-23

申请号：US14589380

申请日：2015-01-05

Applicant: FUJIFILM CORPORATION

Inventor： Seiji TANAKA ,  Kenkichi HAYASHI

IPC: H01L27/146 ,  H04N9/04

CPC classification number: H01L27/14621 ,  H04N9/045

Abstract: A color filter array of a color imaging element includes a basic array pattern P of 4×4 pixels in which RGB filters corresponding to red (R), green (G) and blue (B) are arrayed, this basic array pattern P is repeatedly disposed in a horizontal direction and a vertical direction, a G filter is disposed in each pixel line in four directions of horizontality, verticality, oblique upper right and oblique lower right, and R and B filters are disposed in each pixel line in the horizontal direction and vertical direction of the color filter array. Moreover, the color filter array includes consecutive first filters of two or more pixels in four directions of horizontality, verticality, oblique upper right and oblique lower right.

Abstract translation: 彩色成像元件的滤色器阵列包括4×4像素的基本阵列图案P，其中排列与红色（R），绿色（G）和蓝色（B）对应的RGB滤色器，该基本阵列图案P重复 在水平方向和垂直方向上配置有G滤波器，在水平方向，垂直方向，倾斜右上方，右下方的四个方向上的各像素配线中设置有G滤波器，在各水平方向的各像素配置有R和B滤波器 和滤色器阵列的垂直方向。 此外，滤色器阵列包括在水平度，垂直度，倾斜右上方和右下方四个方向上的两个或更多个像素的连续的第一滤光器。

公开(公告)号：US20140307132A1

公开(公告)日：2014-10-16

申请号：US14314555

申请日：2014-06-25

Applicant: FUJIFILM Corporation

Inventor： Tomoyuki KAWAI ,  Kenkichi HAYASHI ,  Seiji TANAKA

IPC: H04N9/64 ,  H04N9/04

CPC classification number: H04N9/64 ,  H04N9/045 ,  H04N9/07 ,  H04N2209/045

Abstract: A single-plate color imaging element where an array of the color filters includes a basic array pattern of M×N provided with first filters corresponding to a first color with one or more colors and second filters corresponding to a second color with two or more colors with contribution ratios for obtaining luminance signals lower than the first color, the first filters are arranged in a check pattern shape in the basic array pattern, one or more second filters corresponding to each color of the second color are arranged in each line in the horizontal and vertical directions of the array of the color filters in the basic array pattern, and a proportion of the number of pixels of the first color corresponding to the first filters is greater than a proportion of the number of pixels of each color of the second color corresponding to the second filters.

Abstract translation: 一种单板彩色成像元件，其中所述滤色器阵列包括具有与具有一种或多种颜色的第一颜色相对应的第一滤色器的M×N的基本阵列图案，以及对应于具有两种或更多种颜色的第二颜色的第二滤色器 用于获得低于第一颜色的亮度信号的贡献率，第一滤光器以基本阵列图案中的检查图案形状布置，对应于第二颜色的每种颜色的一个或多个第二滤光器布置在水平的每一行中 并且基本阵列图案中的滤色器的阵列的垂直方向以及与第一滤色器对应的第一颜色的像素数的比例大于第二颜色的每种颜色的像素数的比例 对应于第二过滤器。

公开(公告)号：US20140022423A1

公开(公告)日：2014-01-23

申请号：US14031790

申请日：2013-09-19

Applicant: FUJIFILM Corporation

Inventor： Kenkichi HAYASHI ,  Hiroshi ENDO ,  Noriko KAWAMURA ,  Takashi AOKI ,  Kazuki INOUE

IPC: H04N5/232

CPC classification number: H04N5/23212 ,  H04N5/3696 ,  H04N9/045 ,  H04N9/07

Abstract: An image pickup device includes: a color filter having repeatedly disposed basic array patterns configured with first and second array patterns disposed symmetrically about a point, wherein the first array pattern has a first filter placed at the 4 corner and center pixels of a 3×3 pixel square array, a second filter placed in a line at the horizontal direction center of the square array, and a third filter placed in a line at the vertical direction center of the square array, and the second array pattern has the same placement of the first filter as the first array pattern and has placement of the second filter and placement of the third filter swapped over to that of the first array pattern; and phase difference detection pixels placed at positions corresponding to the first filter at a top and bottom edge sides in the array pattern.

Abstract translation: 一种图像拾取装置包括：滤色器，其具有重复设置的基本阵列图案，该基本阵列图案配置有围绕点对称设置的第一和第二阵列图案，其中第一阵列图案具有位于4角处的第一滤光器和3×3的中心像素 像素方阵，位于正方形阵列的水平方向中心的一条线上的第二滤光器，以及放置在正方形阵列的垂直方向中心的一行的第三滤光片，第二阵列图形具有相同的位置 第一过滤器作为第一阵列图案，并且将第二过滤器的放置和第三过滤器的放置交换到第一排列图案的位置; 以及位于与阵列图案的上下边缘侧的与第一滤光片对应的位置处的相位差检测像素。

公开(公告)号：US20140022422A1

公开(公告)日：2014-01-23

申请号：US14034004

申请日：2013-09-23

Applicant: FUJIFILM Corporation

Inventor： Hiroshi ENDO ,  Takashi AOKI ,  Yoichi IWASAKI ,  Kazuki INOUE ,  Kenkichi HAYASHI ,  Seiji TANAKA ,  Noriko KAWAMURA

IPC: H04N9/07

CPC classification number: H04N9/07 ,  H04N5/23212 ,  H04N5/3696 ,  H04N9/045 ,  H04N9/077

Abstract: Interpolation precision of phase difference detection pixels is raised. An image pickup device includes: a color filter disposed with a repeating basic array pattern configured by 3×3 pixel square arrays of a first array pattern and a second array pattern disposed symmetrically about a point; a first phase difference detection pixel that is placed at a position of a pixel corresponding to 1 corner portion out of the 4 corner portions of at least one array pattern in 1 pair of the first array pattern and the second array pattern out of 2 pairs of the first array pattern and the second array pattern configuring the basic array pattern; and a second phase difference detection pixel that is placed at a position of a pixel corresponding to 1 corner portion out of the 4 corner portions in the array pattern, out of the first array pattern.

Abstract translation: 提高了相位差检测像素的插值精度。 一种图像拾取装置，包括：滤色器，其配置有由第一阵列图案的3×3像素正方形阵列和围绕点对称设置的第二阵列图案构成的重复基本阵列图案; 第一相位差检测像素被放置在对应于1对第一阵列图案中的至少一个阵列图案的4个角部分中的1个角部分的像素的位置处，并且2对 第一阵列图案和第二阵列图案构成基本阵列图案; 以及第二相位差检测像素，该第二相位差检测像素位于与阵列图案中的4个角部中的1个角部对应的像素的位置之外。