IMAGE PROCESSING DEVICE, IMAGE PROCESSING METHOD, AND PROGRAM

    公开(公告)号:EP3852375A1

    公开(公告)日:2021-07-21

    申请号:EP19859860.9

    申请日:2019-06-06

    申请人: Sony Corporation

    IPC分类号: H04N19/90 H04N5/30

    摘要: A polarization imaging unit 20 acquires a polarized image including polarization pixels with a plurality of polarization directions. An information compression unit 40 sets reference image information based on polarized image information of reference polarization pixels with at least a plurality of polarization directions in the polarized image and generates difference information between the polarized image information of each of polarization pixels different from the reference polarization pixels in the polarized image and the reference image information. In addition, the information compression unit 40 reduces the amount of information of the difference information generated for each of the polarization pixels with the plurality of polarization directions to generate compressed image information including the reference image information and the difference information with the reduced amount of information. An information decoding unit 70 applies a decoding process corresponding to the compression process of the information compression unit 40 to the compressed image information acquired through a recording medium 50 or a transmission path 60 to generate the polarized image and outputs the polarized image to a polarized image using unit 80.

    IMAGE PROCESSING DEVICE, IMAGE PROCESSING METHOD AND PROGRAM
    2.
    发明公开
    IMAGE PROCESSING DEVICE, IMAGE PROCESSING METHOD AND PROGRAM 审中-公开
    图像处理装置,图像处理方法和程序

    公开(公告)号:EP3296955A1

    公开(公告)日:2018-03-21

    申请号:EP16792412.5

    申请日:2016-03-01

    申请人: Sony Corporation

    IPC分类号: G06T7/20

    摘要: A normal-line information generation block 30 generates normal-line information for a frame subject to detection. A data storage block 50 stores normal-line information and the like of a key frame. A motion amount detection block 40 detects a motion amount of an imaging position of the frame subject to detection relative to an imaging position of the key frame on the basis of the normal-line information of the key frame stored in the data storage block 50 and the normal-line information of the frame subject to detection generated by the normal-line information generation block 30. Even if a positional difference of a same point is small or a luminance difference occurs between a taken image of the key frame and a taken image of a current frame, a motion amount of the imaging position of the frame subject to detection relative to the imaging position of the key frame can be accurately detected on the basis of normal-line information. Therefore, an observation position can be accurately detected.

    摘要翻译: 正常线信息生成块30生成用于检测的帧的正常线信息。 数据存储块50存储关键帧的正常线信息等。 运动量检测块40基于存储在数据存储块50中的关键帧的法线信息,检测被检测帧的成像位置相对于关键帧的成像位置的运动量,以及 由法线信息生成块30生成的检测对象帧的法线信息。即使在关键帧的拍摄图像和拍摄图像之间出现相同点的位置差异小或亮度差异 可以基于正常线信息精确地检测被检测帧的成像位置相对于关键帧的成像位置的运动量。 因此,可以准确地检测观察位置。

    IMAGE PROCESSING DEVICE, IMAGE PROCESSING METHOD AND IMAGE CAPTURING ELEMENT
    3.
    发明公开
    IMAGE PROCESSING DEVICE, IMAGE PROCESSING METHOD AND IMAGE CAPTURING ELEMENT 审中-公开
    图像处理设备,图像处理方法和图像捕获元件

    公开(公告)号:EP3264754A1

    公开(公告)日:2018-01-03

    申请号:EP15883375.6

    申请日:2015-12-08

    申请人: Sony Corporation

    摘要: An imaging unit 20 has a configuration in which an identical polarization pixel block made up of a plurality of pixels with an identical polarization direction is provided for each of a plurality of polarization directions and pixels of respective predetermined colors are provided in the identical polarization pixel block.
    A correction processing unit 31 performs correction processing such as white balance correction on a polarized image generated by the imaging unit 20. A polarized image processing unit 32 separates or extracts a reflection component using the polarized image after the correction processing. By using a polarized image of the separated or extracted reflection component, for example, it is possible to generate normal line information with high accuracy.

    摘要翻译: 成像单元20具有这样的配置,其中为多个偏振方向中的每一个提供由具有相同偏振方向的多个像素组成的相同偏振像素块,并且在相同偏振像素块中提供各个预定颜色的像素 。 校正处理单元31对由成像单元20产生的偏振图像执行诸如白平衡校正之类的校正处理。偏振图像处理单元32使用校正处理之后的偏振图像来分离或提取反射分量。 例如,通过使用分离或提取的反射分量的偏振图像,可以高准确度地生成法线信息。

    IMAGE PROCESSING DEVICE AND IMAGE PROCESSING METHOD

    公开(公告)号:EP3376759A1

    公开(公告)日:2018-09-19

    申请号:EP16863889.8

    申请日:2016-09-09

    申请人: Sony Corporation

    摘要: The polarization imaging unit 21 generates a polarized image including pixels for each of a plurality of polarization components. The demosaicing unit 41 calculates a pixel signal for each polarization component by using the pixel signal of the target pixel of the polarized image and the pixel signal of the pixel for each of the identical polarization components located near the target pixel. In one example, a low frequency component is calculated for each polarization component by using the pixel signal of the pixel located near the target pixel for each of the identical polarization components. In addition, component information indicating the relationship between the low frequency component of the polarization component of the polarized image and the pixel signal of the target pixel is acquired. Furthermore, the pixel signal for each polarization component in the target pixel is calculated on the basis of the low frequency component and the component information for each polarization component. The pixel signal for each polarization component is obtained for each pixel of the polarized image, so it is possible to acquire normal information or a non-polarized light image with high resolution.

    IMAGE PROCESSING DEVICE AND IMAGE PROCESSING METHOD
    5.
    发明公开
    IMAGE PROCESSING DEVICE AND IMAGE PROCESSING METHOD 审中-公开
    图像处理装置和图像处理方法

    公开(公告)号:EP3086282A1

    公开(公告)日:2016-10-26

    申请号:EP14871081.7

    申请日:2014-11-17

    申请人: Sony Corporation

    发明人: KONDO, Yuhi

    IPC分类号: G06T7/00

    CPC分类号: G06K9/4671 G06K9/2036

    摘要: A polarization image acquisition unit (11) acquires polarization images of three or more polarization directions. A feature quantity computation unit (15) computes image feature quantities on the basis of the acquired polarization images. For example, the luminance of each polarization image is normalized for each pixel, and the normalized luminance of the polarization image is used as the image feature quantity. The luminance of the polarization image changes according to the surface shape of an object. Thus, the image feature quantities computed on the basis of the polarization images are feature quantities corresponding to the surface shape of the object. Image processing, for example, image recognition, feature point detection, feature point matching, or the like, can be performed on the basis of the surface shape of the object using such image feature quantities.

    摘要翻译: 偏振图像获取单元(11)获取三个或更多个偏振方向的偏振图像。 特征量计算单元(15)基于所获取的偏振图像来计算图像特征量。 例如,对于每个像素对每个偏振图像的亮度进行归一化,并且将偏振图像的归一化亮度用作图像特征量。 偏振图像的亮度根据物体的表面形状而变化。 因此,基于偏振图像计算的图像特征量是与对象的表面形状相对应的特征量。 可以基于使用这种图像特征量的对象的表面形状来执行图像处理,例如,图像识别,特征点检测,特征点匹配等。

    IMAGE PROCESSING DEVICE, IMAGE PROCESSING METHOD, AND PROGRAM
    8.
    发明公开
    IMAGE PROCESSING DEVICE, IMAGE PROCESSING METHOD, AND PROGRAM 审中-公开
    图像处理装置,图像处理方法和程序

    公开(公告)号:EP3291052A1

    公开(公告)日:2018-03-07

    申请号:EP16786192.1

    申请日:2016-03-01

    申请人: Sony Corporation

    摘要: A polarized image acquisition section 20 acquires a plurality of polarized images having different polarization directions. The polarized images show, for example, an input indicator for a user interface as a recognition target object. A normal line calculation section 30 calculates normal lines for individual pixels of the recognition target object in accordance with the polarized images acquired by the polarized image acquisition section 20. The normal lines represent information based on the three-dimensional shape of the recognition target object. A recognition section 40 recognizes the object by using the normal lines calculated by the normal line calculation section 30, determines, for example, the type, position, and posture of the input indicator, and outputs the result of determination as input information on the user interface. The object can be recognized easily and with high accuracy.

    摘要翻译: 偏振图像获取部分20获取具有不同偏振方向的多个偏振图像。 偏振图像例如将用于用户界面的输入指示符显示为识别目标对象。 法线计算部分30根据偏振图像获取部分20获取的偏振图像计算识别目标对象的各个像素的法线。法线表示基于识别目标对象的三维形状的信息。 识别部分40通过使用由法线计算部分30计算的法线来识别对象,例如确定输入指示符的类型,位置和姿势,并且将确定结果输出为关于用户的输入信息 接口。 该物体可以容易且高精度地识别。