公开(公告)号：US07907177B2

公开(公告)日：2011-03-15

申请号：US11739807

申请日：2007-04-25

申请人： Masami Haino ,  Takanori Miki

发明人： Masami Haino ,  Takanori Miki

IPC分类号： H04N5/228

CPC分类号： G01C25/005 ,  G02B27/64 ,  G06T5/003 ,  G06T2207/20056 ,  G06T2207/20201 ,  H04N5/23248 ,  H04N5/23258

摘要： An error in a camera having angular velocity sensors is eliminated. A camera is placed on a rotating table and rotated, angular velocities are detected by angular velocity sensors, and a CZP chart is photographed. The motion of the camera is computed as a locus of motion of a point light source on an imaging plane from the outputs from the angular velocity sensors. The inclination of the locus motion is compared with the inclination of a zero-crossing line which has been obtained by subjecting the photographed image to Fourier transformation, to thus compute angles of relative inclination of the angular velocity sensors with respect to the image sensor. Further, when no coincidence exists between the zero-crossing line of the data into which a PSF has been Fourier-transformed and a zero-crossing line of the data into which a photographed image has been Fourier-transformed, a computer computes a correction coefficient from a proportion of an interval between the zero-crossing lines, on condition that an error is included in the angular velocity sensors or the focal length of a photographing lens, and the error is eliminated.

摘要翻译： 消除了具有角速度传感器的相机中的错误。 将相机放置在旋转台上并旋转，角速度传感器检测角速度，并拍摄CZP图。 相机的运动被计算为来自角速度传感器的输出的成像平面上的点光源的运动轨迹。 将轨迹运动的倾斜与通过对拍摄的图像进行傅里叶变换而获得的过零线的倾斜度进行比较，从而计算角速度传感器相对于图像传感器的相对倾角。 此外，当已经对傅立叶变换了PSF的数据的过零线与经过傅里叶变换后的数据的过零行之间不一致时，计算机计算校正系数 在角速度传感器中包含误差或拍摄镜头的焦距的条件下，从零交叉线之间的间隔的比例，消除了误差。

公开(公告)号：US20080120056A1

公开(公告)日：2008-05-22

申请号：US11740313

申请日：2007-04-26

申请人： Masami Haino ,  Takanori Miki

发明人： Masami Haino ,  Takanori Miki

IPC分类号： G01P21/00

CPC分类号： G06T7/80

摘要： Inclinations of angular velocity sensors attached to a camera are detected, and outputs from the angular velocity sensors are calibrated. A camera is placed on a rotating table and rotated, angular velocities are detected by angular velocity sensors, and a CZP chart is photographed. The motion of the camera is expressed as a locus of motion of a point light source on an imaging plane from the outputs from the angular velocity sensors. The inclination of the locus motion is compared with the inclination of a zero-crossing line which has been obtained by subjecting the photographed image to Fourier transformation, to thus compute angles of relative inclination of the angular velocity sensors with respect to the image sensor.

摘要翻译： 检测安装在摄像机上的角速度传感器的倾角，校正角速度传感器的输出。 将相机放置在旋转台上并旋转，角速度传感器检测角速度，并拍摄CZP图。 相机的运动由来自角速度传感器的输出的成像平面上的点光源的运动轨迹表示。 将轨迹运动的倾斜与通过对拍摄的图像进行傅里叶变换而获得的过零线的倾斜度进行比较，从而计算角速度传感器相对于图像传感器的相对倾角。

公开(公告)号：US20080115562A1

公开(公告)日：2008-05-22

申请号：US11739807

申请日：2007-04-25

申请人： Masami Haino ,  Takanori Miki

发明人： Masami Haino ,  Takanori Miki

IPC分类号： G01B9/00 ,  G01P21/00

CPC分类号： G01C25/005 ,  G02B27/64 ,  G06T5/003 ,  G06T2207/20056 ,  G06T2207/20201 ,  H04N5/23248 ,  H04N5/23258

摘要： An error in a camera having angular velocity sensors is eliminated. A camera is placed on a rotating table and rotated, angular velocities are detected by angular velocity sensors, and a CZP chart is photographed. The motion of the camera is computed as a locus of motion of a point light source on an imaging plane from the outputs from the angular velocity sensors. The inclination of the locus motion is compared with the inclination of a zero-crossing line which has been obtained by subjecting the photographed image to Fourier transformation, to thus compute angles of relative inclination of the angular velocity sensors with respect to the image sensor. Further, when no coincidence exists between the zero-crossing line of the data into which a PSF has been Fourier-transformed and a zero-crossing line of the data into which a photographed image has been Fourier-transformed, a computer computes a correction coefficient from a proportion of an interval between the zero-crossing lines, on condition that an error is included in the angular velocity sensors or the focal length of a photographing lens, and the error is eliminated.

摘要翻译： 消除了具有角速度传感器的相机中的错误。 将相机放置在旋转台上并旋转，角速度传感器检测角速度，并拍摄CZP图。 相机的运动被计算为来自角速度传感器的输出的成像平面上的点光源的运动轨迹。 将轨迹运动的倾斜与通过对拍摄的图像进行傅里叶变换而获得的过零线的倾斜度进行比较，从而计算角速度传感器相对于图像传感器的相对倾角。 此外，当已经对傅立叶变换了PSF的数据的过零线与经过傅里叶变换后的数据的过零行之间不一致时，计算机计算校正系数 在角速度传感器中包含误差或拍摄镜头的焦距的条件下，从零交叉线之间的间隔的比例，消除了误差。

公开(公告)号：US07903897B2

公开(公告)日：2011-03-08

申请号：US11565769

申请日：2006-12-01

申请人： Hiroaki Komatsu ,  Fuminori Takahashi ,  Takanori Miki ,  Masami Haino

发明人： Hiroaki Komatsu ,  Fuminori Takahashi ,  Takanori Miki ,  Masami Haino

IPC分类号： G06K9/00 ,  G06K9/40 ,  G06K1/00 ,  H04N5/225 ,  H04N5/228 ,  H04N9/73 ,  H04N5/217 ,  H04N9/64 ,  H04N1/60 ,  G06F15/00 ,  G03F3/08

CPC分类号： H04N5/23248 ,  G06T5/003 ,  G06T5/50 ,  G06T2207/20201

摘要： Apparatus includes a change operator for detecting change factor information which causes the deterioration in the image; an iterative processing operator which iterates a processing cycle comprising; a first processing step to apply a first calculation to a first image utilizing the change factor information to generate a second image, calculating difference data between the deteriorated image and the second image; a second processing step to apply a second calculation to the second image utilizing the difference data to generate a third image; and a replacing step to replace the first image with the third image; wherein the processing cycle further includes (a) detecting whether a coincidence exists between the sign of a first difference data and the sign of a second difference data or not, and (b) increasing an absolute value of the difference data utilized in the second processing step when the coincidence is detected in step (a).

摘要翻译： 装置包括用于检测导致图像劣化的变化因子信息的变换算子; 迭代处理算子，迭代处理循环，包括： 第一处理步骤，利用变化因子信息对第一图像应用第一计算以产生第二图像，计算退化图像和第二图像之间的差分数据; 第二处理步骤，利用差分数据对第二图像应用第二计算以产生第三图像; 以及用第三图像替换第一图像的替换步骤; 其中所述处理周期还包括（a）检测第一差分数据的符号与第二差分数据的符号之间是否存在一致性，以及（b）增加在第二处理中使用的差异数据的绝对值 在步骤（a）中检测到重合时的步骤。

公开(公告)号：US20090027508A1

公开(公告)日：2009-01-29

申请号：US11962157

申请日：2007-12-21

申请人： Takanori Miki ,  Masami Haino

发明人： Takanori Miki ,  Masami Haino

IPC分类号： H04N5/228

CPC分类号： H04N5/23248 ,  H04N5/23258 ,  H04N5/23267 ,  H04N2201/0065

摘要： In a system built from an imaging device and an output device, camera shake compensation is performed while processing load imposed on the imaging device is being lessened. An image processing system is built from a digital camera and a printer. Image data pertaining to a subject are recorded in a recording medium. Further, the amount of blurring of the digital camera is detected by means of a gyroscopic sensor, and PSF data are recorded in the recording medium. The printer is equipped with an image conversion section, a PSF conversion section, and an image restoration section, and a resolution of the image data and a resolution of the PSF data are converted, thereby restoring an original image.

摘要翻译： 在从成像设备和输出设备构建的系统中，在施加在成像设备上的负载被减小的同时执行相机抖动补偿。 图像处理系统由数码相机和打印机构成。 与被摄体有关的图像数据被记录在记录介质中。 此外，通过陀螺传感器检测数字照相机的模糊量，并且将PSF数据记录在记录介质中。 打印机配备有图像转换部分，PSF转换部分和图像恢复部分，并且转换图像数据的分辨率和PSF数据的分辨率，从而恢复原始图像。

公开(公告)号：US07848587B2

公开(公告)日：2010-12-07

申请号：US11681801

申请日：2007-03-05

申请人： Takanori Miki ,  Masami Haino ,  Fuminori Takahashi ,  Hiroaki Komatsu

发明人： Takanori Miki ,  Masami Haino ,  Fuminori Takahashi ,  Hiroaki Komatsu

IPC分类号： G06K9/40 ,  H04N5/228 ,  H04N5/217

CPC分类号： G06T5/003 ,  G06T7/269 ,  G06T2207/20201

摘要： An image deteriorated by camera shake, or the like, is restored in a short period of time. A ∇J computation section computes an evaluation value J from a deteriorated image G captured by means of photographing, a restored image F, and a PSF computed from an angular velocity detected by an angular velocity sensor, and further computes ∇J. When the square of norm of ∇J exceeds a threshold value, there is iterated processing for computing a new, restored image F by means of subtracting ε·∇J from the restored image F. A convergence parameter computation section sets the convergence parameter ε as a value which first shows an increase and subsequently a decrease depending on the number of iterations, thereby increasing the speed of convergence and inhibiting divergence.

摘要翻译： 通过相机抖动等劣化的图像在短时间内恢复。 A∇J计算部分根据由角速度传感器检测的角速度计算出的通过拍摄捕获的劣化图像G，恢复图像F和PSF计算评估值J，并且还计算∇J。 当∇J的范数的平方值超过阈值时，通过从恢复的图像F中减去＆egr |∇J来计算新的恢复图像F的迭代处理。收敛参数计算部分设置收敛参数＆egr ; 作为首先显示增加的值，随后根据迭代次数减少，从而增加收敛速度并抑制发散。

公开(公告)号：US20080025626A1

公开(公告)日：2008-01-31

申请号：US11565769

申请日：2006-12-01

申请人： Hiroaki Komatsu ,  Fuminori Takahashi ,  Takanori Miki ,  Masami Haino

发明人： Hiroaki Komatsu ,  Fuminori Takahashi ,  Takanori Miki ,  Masami Haino

IPC分类号： G06K9/36

CPC分类号： H04N5/23248 ,  G06T5/003 ,  G06T5/50 ,  G06T2207/20201

摘要： An image processing apparatus includes a processor for restoring a pre-change image, an image which should have been originally captured, or an image approximating the same from source image data having undergone a change, such as deterioration, wherein the processor performs at least once iterative processing including generation of comparative data from arbitrary image data by utilization of change factor information data as to a factor responsible for a change in an image, comparison, with the comparative data, of source image data to be compared, generation of restored data by distribution of acquired difference data to the arbitrary image data by utilizing the change factor information data, and use of the restored data in place of the arbitrary image data, thereby iterating analogous processing; and accelerated processing for distributing a first corrected value, whose absolute value is larger than that of the difference data, in place of the difference data.

摘要翻译： 一种图像处理装置包括：处理器，用于恢复预先改变的图像，应该最初被捕获的图像，或者从已经经历诸如劣化的变化的源图像数据近似的图像，其中处理器执行至少一次 迭代处理，包括通过利用变化因子信息数据生成来自任意图像数据的比较数据，关于影响图像变化的因素，与比较数据比较要比较的源图像数据，生成恢复数据，通过 通过利用变化因子信息数据将获得的差分数据分配给任意图像数据，以及使用恢复的数据代替任意图像数据，从而迭代类似处理; 以及用于分配其绝对值大于差异数据的绝对值的第一校正值的加速处理来代替差分数据。

公开(公告)号：US20080002900A1

公开(公告)日：2008-01-03

申请号：US11681801

申请日：2007-03-05

申请人： Takanori Miki ,  Masami Haino ,  Fuminori Takahashi ,  Hiroaki Komatsu

发明人： Takanori Miki ,  Masami Haino ,  Fuminori Takahashi ,  Hiroaki Komatsu

IPC分类号： G06K9/40

CPC分类号： G06T5/003 ,  G06T7/269 ,  G06T2207/20201

摘要： An image deteriorated by camera shake, or the like, is restored in a short period of time. A ∇J computation section computes an evaluation value J from a deteriorated image G captured by means of photographing, a restored image F, and a PSF computed from an angular velocity detected by an angular velocity sensor, and further computes ∇J. When the square of norm of ∇J exceeds a threshold value, there is iterated processing for computing a new, restored image F by means of subtracting ε·∇J from the restored image F. A convergence parameter computation section sets the convergence parameter ε as a value which first shows an increase and subsequently a decrease depending on the number of iterations, thereby increasing the speed of convergence and inhibiting divergence.

摘要翻译： 通过相机抖动等劣化的图像在短时间内恢复。 A∇J计算部分根据由角速度传感器检测的角速度计算出的通过拍摄捕获的劣化图像G，恢复图像F和PSF计算评估值J，并且还计算∇J。 当J的范数的平方超过阈值时，通过从恢复的图像F中减去epsilon.J来计算新的恢复图像F的迭代处理。收敛参数计算部分将收敛参数ε设为 首先显示增加的值，随后根据迭代次数减少，从而增加收敛速度并抑制发散。

公开(公告)号：US20080158376A1

公开(公告)日：2008-07-03

申请号：US11755774

申请日：2007-05-31

申请人： Takanori Miki

发明人： Takanori Miki

IPC分类号： H04N5/228 ,  H04N5/222

CPC分类号： H04N5/2354 ,  H04N5/23248 ,  H04N5/2351

摘要： A flashlight-exposed region is distinguished from an unexposed region during flash (or stroboscopic) photography. A region determination section of a digital camera acquires a preview image and a preview image acquired by firing preliminary flashlight. A region where a difference between the preview images exceeds a threshold value is determined to be a flashlight-exposed region. The region determination section acquires the preview image and an image captured during firing of primary flashlight. After the preview image has been resized, the preview image is compared with the captured image, and a region where the difference between the images exceeds a threshold value is determined to be a flashlight-exposed region.

摘要翻译： 在闪光（或频闪）摄影期间，手电曝光区域与未曝光区域的区别。 数字照相机的区域确定部分获取通过点火初步手电取得的预览图像和预览图像。 将预览图像之间的差异超过阈值的区域确定为手电曝光区域。 区域确定部分获取预备图像和在主手电筒的拍摄期间拍摄的图像。 在预览图像被调整大小之后，将预览图像与捕获的图像进行比较，并且将图像之间的差超过阈值的区域确定为手电曝光区域。

公开(公告)号：US20070097267A1

公开(公告)日：2007-05-03

申请号：US11423770

申请日：2006-06-13

申请人： Junzou Sakurai ,  Takanori Miki

发明人： Junzou Sakurai ,  Takanori Miki

IPC分类号： H04N5/14

CPC分类号： H04N9/045 ,  H04N5/217 ,  H04N5/3572

摘要： Accurately suppress chromatic aberration arising in a subject image is described. An image signal, which is obtained by a lens and a CCD and pertains to a subject image, is subjected to white balance adjustment performed by a white balance adjustment circuit. The signal is supplied to a color-blurring detection circuit before undergoing gamma correction. The color-blurring detection circuit has a low slice circuit, a high-pass filter, and a high clip circuit; detects an edge portion of a highlight of a G signal constituting the image signal; and supplies the detected edge portion as a color-blurring detection signal to a color-blurring suppressor circuit disposed subsequent to a γ correction circuit. The color-blurring suppressor circuit corrects color-difference signals CB, CR, which have been subjected to gamma correction, by use of the color-blurring detection signal, thereby suppressing the color-blurring having arisen in the edge of a highlight of the image.

摘要翻译： 对被摄体图像中产生的色像差进行精确的抑制。 通过透镜和CCD获得并与被摄体图像相关的图像信号经受由白平衡调节电路执行的白平衡调整。 在进行伽马校正之前，该信号被提供给颜色模糊检测电路。 彩色模糊检测电路具有低片电路，高通滤波器和高限幅电路; 检测构成图像信号的G信号的高光的边缘部分; 并且将检测到的边缘部分作为颜色模糊检测信号提供给设置在伽马校正电路之后的色模抑制电路。 彩色模糊抑制电路通过使用颜色模糊检测信号来校正已进行伽马校正的色差信号CB，CR，从而抑制在图像的高亮边缘产生的颜色模糊 。