公开(公告)号：US20150124883A1

公开(公告)日：2015-05-07

申请号：US14366498

申请日：2012-10-24

Applicant: Sony Computer Entertainment Inc.

Inventor： Tetsugo Inada ,  Akio Ohba ,  Hiroyuki Segawa

IPC: H04N19/51

CPC classification number: H04N19/51 ,  H04N19/105 ,  H04N19/137 ,  H04N19/14 ,  H04N19/167 ,  H04N19/174 ,  H04N19/198 ,  H04N19/428 ,  H04N19/587 ,  H04N19/59 ,  H04N19/593

Abstract: A frame sequence of moving picture data is divided into a tile image sequence 250, and the color space of the tile image sequence 250 is converted to generate a YCbCr image sequence 252 (S10). Each frame is reduced to ½ time in the vertical and horizontal directions (S12), and a compression process is carried out to generate compression data 260 of a reference image (S14). The compression data 260 of the reference image is decoded and decompressed similarly as upon image display to restore a YCbCr image as the reference image, and a difference image sequence 262 is generated from the reference image and the original YCbCr image 252 (S16). Then, compression data 266 of a difference image is generated (S18), and compression data 268 obtained by connecting the compression data 260 of the reference image and the compression data 266 of the difference image is generated for every four frames of a tile image (S20).

Abstract translation: 运动图像数据的帧序列被划分为瓦片图像序列250，并且将图像图像序列250的颜色空间转换为生成YCbCr图像序列252（S10）。 每个帧在垂直和水平方向上减少到1/2时间（S12），并执行压缩处理以产生参考图像的压缩数据260（S14）。 参考图像的压缩数据260与图像显示类似地进行解码和解压缩，以恢复作为参考图像的YCbCr图像，并且从参考图像和原始YCbCr图像252生成差分图像序列262（S16）。 然后，生成差分图像的压缩数据266（S18），并且通过连接参考图像的压缩数据260和差分图像的压缩数据266获得的压缩数据268针对瓦片图像的每四帧产生 S20）。

公开(公告)号：US20150077520A1

公开(公告)日：2015-03-19

申请号：US14397654

申请日：2013-04-11

Applicant: Sony Computer Entertainment Inc.

Inventor： Akio Ohba ,  Hiroyuki Segawa ,  Tetsugo Inada

IPC: H04N13/02 ,  H04N13/00

CPC classification number: H04N13/239 ,  A63F13/213 ,  G06F3/011 ,  G06F3/017 ,  G06F3/0304 ,  G06T7/593 ,  G06T2207/10012 ,  H04N13/128

Abstract: An information processor includes a detection plane definition portion defining a detection plane in a 3D space of a camera coordinate system of a first camera and calculates vertex coordinates of a detection area by projecting the detection plane onto a plane of a left image shot by the first camera. A feature quantity calculation portion generates feature point image of left and right images. A parallax correction area derivation portion derives an area as a parallax correction area. The parallax correction area is obtained by moving, to a left, an area of a right image identical to the detection area of the left image by as much as the parallax appropriate to a position of the detection plane in a depth direction. A matching portion performs block matching for the feature point images of each area, thus deriving a highly rated feature point. A position information output portion generates information to be used by an output information generation section based on the matching result and output that information.

Abstract translation: 信息处理器包括检测平面定义部分，其定义第一相机的相机坐标系的3D空间中的检测平面，并通过将检测平面投影到由第一相机拍摄的左图像的平面上来计算检测区域的顶点坐标 相机。 特征量计算部分生成左图像和右图像的特征点图像。 视差校正区域导出部分将区域导出为视差校正区域。 视差校正区域通过向与左侧图像的检测区域相同的右侧图像的区域向左移动与在深度方向上的检测平面的位置相适应的视差来获得。 匹配部分对每个区域的特征点图像执行块匹配，从而导出高度评价的特征点。 位置信息输出部根据匹配结果生成要由输出信息生成部使用的信息，并输出该信息。

公开(公告)号：US20140153634A1

公开(公告)日：2014-06-05

申请号：US14234492

申请日：2012-07-02

Applicant: Sony Computer Entertainment Inc.

Inventor： Tetsugo Inada ,  Akio Ohba ,  Hiroyuki Segawa

IPC: H04N19/30

CPC classification number: H04N19/30 ,  H04N5/76 ,  H04N9/8042 ,  H04N19/115 ,  H04N19/162 ,  H04N19/174 ,  H04N19/187 ,  H04N19/33 ,  H04N19/59 ,  H04N21/234327 ,  H04N21/23439 ,  H04N21/8456

Abstract: Frames of a moving image are configured as a hierarchical structure where each frame is represented with a plurality of resolutions. Some layers are set as original image layers, and the other layers are set as difference image layers in hierarchical data representing a frame at each time step. In the case that an area is to be displayed in the resolution of the difference image layer, to respective pixel values of a difference image of the area, respective pixel values of an image of a corresponding area retained by the original image layer of lower resolution, the image enlarged to the resolution of the difference image layer, are added. A layer to be set as a difference image layer is switched to another layer as time passes.

Abstract translation: 运动图像的帧被配置为其中每个帧以多个分辨率表示的分层结构。 一些层被设置为原始图像层，并且其他层被设置为表示每个时间步长的帧的分层数据中的差分图像层。 在以差分图像层的分辨率显示区域的情况下，对于区域的差分图像的各个像素值，由较低分辨率的原始图像层保留的对应区域的图像的各个像素值 ，将图像放大到差分图像层的分辨率。 随着时间的流逝，要设置为差分图像层的层被切换到另一层。

公开(公告)号：US09619868B2

公开(公告)日：2017-04-11

申请号：US14652536

申请日：2013-07-22

Applicant: Sony Computer Entertainment Inc.

Inventor： Akio Ohba ,  Hiroyuki Segawa ,  Tetsugo Inada ,  Hidehiko Ogasawara ,  Hirofumi Okamoto

IPC: G06K9/54 ,  G06T5/00 ,  G06F3/03 ,  H04N13/00 ,  G06K9/62 ,  G06T5/40 ,  G06F3/01 ,  H04N5/225 ,  H04N5/235 ,  G06F3/00 ,  G06T5/50

CPC classification number: G06T5/00 ,  G06F3/005 ,  G06F3/011 ,  G06F3/0304 ,  G06K9/6201 ,  G06T5/009 ,  G06T5/40 ,  G06T5/50 ,  G06T2207/10012 ,  H04N5/2258 ,  H04N5/2353 ,  H04N5/2355 ,  H04N13/00 ,  H04N13/156 ,  H04N2013/0074

Abstract: An imaging device includes a first camera and a second camera and shoots the same object under different shooting conditions. A shot-image data acquirer of an image analyzer acquires data of two images simultaneously shot from the imaging device. A correcting section aligns the distributions of the luminance value between the two images by carrying out correction for either one of the two images. A correction table managing section switches and generates a correction table to be used according to the function implemented by the information processing device. A correction table storage stores the correction table showing the correspondence relationship between the luminance values before and after correction. A depth image generator performs stereo matching by using the two images and generates a depth image.

公开(公告)号：US09460337B2

公开(公告)日：2016-10-04

申请号：US14437605

申请日：2013-07-22

Applicant: SONY COMPUTER ENTERTAINMENT INC.

Inventor： Akio Ohba ,  Hiroyuki Segawa ,  Tetsugo Inada ,  Hirofumi Okamoto

IPC: G06K9/00 ,  G06T7/20

CPC classification number: G06K9/00261 ,  G06T7/246 ,  G06T2207/10021 ,  G06T2207/20016 ,  G06T2207/30201

Abstract: An image storage section 48 stores shot image data with a plurality of resolutions transmitted from an imaging device. Depth images 152 with a plurality of resolutions are generated using stereo images with a plurality of resolution levels from the shot image data (S10). Next, template matching is performed using a reference template image 154 that represents a desired shape and size, thus extracting a candidate area for a target picture having the shape and size for each distance range associated with one of the resolutions (S12). A more detailed analysis is performed on the extracted candidate areas using the shot image stored in the image storage section 48 (S14). In some cases, a further image analysis is performed based on the analysis result using a shot image with a higher resolution level (S16a and S16b).

Abstract translation: 图像存储部分48存储从成像装置传输的多个分辨率的拍摄图像数据。 使用来自拍摄图像数据的具有多个分辨率级别的立体图像生成具有多个分辨率的深度图像152（S10）。 接下来，使用表示期望的形状和大小的参考模板图像154来执行模板匹配，从而提取具有与分辨率之一相关联的每个距离范围的形状和大小的目标图片的候选区域（S12）。 使用存储在图像存储部分48中的拍摄图像对所提取的候选区域进行更详细的分析（S14）。 在一些情况下，使用具有较高分辨率水平的拍摄图像（S16a和S16b），基于分析结果进行进一步的图像分析。

公开(公告)号：US09253480B2

公开(公告)日：2016-02-02

申请号：US13760202

申请日：2013-02-06

Applicant: Sony Computer Entertainment Inc.

Inventor： Akio Ohba ,  Nobuo Sasaki ,  Akihiko Sugawara ,  Hiroyuki Segawa ,  Tetsugo Inada

IPC: H04N13/04 ,  G02B27/22 ,  H04N13/00 ,  H04N13/02

CPC classification number: H04N13/366 ,  G02B27/2214 ,  H04N13/128 ,  H04N13/279 ,  H04N13/31 ,  H04N13/376 ,  H04N13/383

Abstract: A viewpoint detection unit detects a user viewing a stereoscopic image, including a parallax image of a subject as viewed from a predetermined position defined as a reference view position, and tracks a viewpoint of the detected user. A motion parallax correction unit determines, if a speed of movement of the viewpoint becomes equal to or higher than a predetermined level, an amount of motion parallax correction for the parallax image, on the basis of an amount of movement of the viewpoint, so as to generate a stereoscopic image corrected for motion parallax, generates, if the speed of movement of the viewpoint subsequently becomes lower than a predetermined level, a stereoscopic image by changing the amount of motion parallax correction in steps until the parallax image return to parallax images as seen from the reference view position.

Abstract translation: 视点检测单元检测观看立体图像的用户，其包括从被定义为参考视图位置的预定位置观看的被摄体的视差图像，并且跟踪检测到的用户的视点。 运动视差校正单元基于视点的移动量来确定视点的移动速度等于或高于预定水平的视差图像的运动视差校正量，从而 以产生对运动视差进行校正的立体图像，如果视点的移动速度随后变得低于预定水平，则产生立体图像，通过改变运动视差校正的量直到视差图像返回到视差图像为止 从参考视图位置看。

公开(公告)号：US20150229927A1

公开(公告)日：2015-08-13

申请号：US14426658

申请日：2013-07-22

Applicant: SONY COMPUTER ENTERTAINMENT INC.

Inventor： Tetsugo Inada ,  Akio Ohba ,  Hiroyuki Segawa

IPC: H04N19/136 ,  G06T5/00 ,  H04N19/137 ,  H04N19/44 ,  H04N19/167 ,  G06T17/10

CPC classification number: H04N19/136 ,  G06T5/001 ,  G06T17/10 ,  H04N19/119 ,  H04N19/137 ,  H04N19/167 ,  H04N19/176 ,  H04N19/44 ,  H04N19/46 ,  H04N19/503 ,  H04N19/59 ,  H04N19/90

Abstract: A tile image sequence 250 obtained by dividing a frame into a predetermined size is further divided into another predetermined size on an image plane to generate a voxel (for example, a voxel 252) (S10). If a redundancy in a space direction or a time direction exists, then data is reduced in the direction (S12), and sequences in the time direction are deployed on a two-dimensional plane (S14). Voxel images are placed on an image plane of a predetermined size to generate one integrated image 258 (S16). In a grouping pattern which exhibits a minimum quantization error, pixels are collectively placed in the region of each voxel image for each group (integrated image 262) (S18). The integrated image 262 after the re-placement is compressed in accordance with a predetermined compression method to generate a compressed image 266 and reference information 264 for determining the position of a needed pixel (S20).

Abstract translation: 通过将帧划分为预定大小而获得的瓦片图像序列250在图像平面上被进一步分割为另一预定尺寸，以生成体素（例如，体素252）（S10）。 如果存在空间方向或时间方向的冗余，则在方向上减少数据（S12），并且将时间方向的顺序部署在二维平面上（S14）。 体素图像被放置在预定尺寸的图像平面上以产生一个集成图像258（S16）。 在具有最小量化误差的分组模式中，像素被集体地放置在每个组的每个体素图像的区域中（集成图像262）（S18）。 根据预定的压缩方法压缩重新放置后的集成图像262，以产生用于确定所需像素的位置的压缩图像266和参考信息264（S20）。

公开(公告)号：US20140294289A1

公开(公告)日：2014-10-02

申请号：US14189026

申请日：2014-02-25

Applicant: Sony Computer Entertainment Inc. ,  Sony Corporation

Inventor： Ayaka Nakatani ,  Yoshihiro Myokan ,  Akio Ohba ,  Tetsugo Inada ,  Hiroyuki Segawa

IPC: G06T7/00

CPC classification number: G06T7/50 ,  G06T7/593 ,  G06T2207/10012 ,  G06T2207/20228 ,  H04N13/106 ,  H04N13/122 ,  H04N13/128 ,  H04N2013/0074

Abstract: There is provided an image processing apparatus including a stereo matching unit configured to obtain right and left disparity images by using stereo matching, based on a pair of images captured by right and left cameras, respectively, a filter processing unit configured to perform filter processing on the disparity images, and a first merging unit configured to make a comparison, in the disparity images that have undergone the filter processing, between disparity values at mutually corresponding positions in the right and left disparity images and to merge the disparity values of the right and left disparity images based on a comparison result.

Abstract translation: 提供了一种图像处理装置，其包括：立体匹配单元，被配置为分别基于由左右相机拍摄的一对图像，通过使用立体匹配来获得左右视差图像;滤波处理单元，被配置为对 视差图像，以及第一合并单元，被配置为在经过滤波处理的视差图像中进行在左右视差图像中相互对应的位置处的视差值之间的比较，并且合并右侧和右侧视差图像的视差值 基于比较结果的左视差图像。

公开(公告)号：US08531488B2

公开(公告)日：2013-09-10

申请号：US13714752

申请日：2012-12-14

Applicant: Sony Computer Entertainment Inc.

Inventor： Akio Ohba ,  Hiroyuki Segawa ,  Tetsugo Inada

IPC: G09G5/00 ,  G06F3/048

CPC classification number: G09G5/34 ,  G06T19/00 ,  G06T2210/36 ,  G09G5/14

Abstract: A hard disk drive stores hierarchical image data, a speed map holding, for each tile image, an index of the processing time required to render a tile image having a predetermined image size obtained by partitioning the image, and scenario data which defines viewpoint shifting. In a control unit of an information processing apparatus having a function of displaying an image, an input information acquisition unit acquires information with respect to the user's input operation via an input device. A loading unit loads necessary data for image displaying from the hard disk drive. A shifting condition adjustment unit adjusts the viewpoint shifting speed based upon the speed map. A frame coordinate determination unit sequentially determines frame coordinates of a display area. A decoding unit decodes compressed image data. A display image processing unit renders a display image.

Abstract translation: 硬盘驱动器存储分层图像数据，对于每个瓦片图像，速度图保持渲染具有通过划分图像获得的预定图像大小的瓦片图像所需的处理时间的索引，以及定义视点移位的场景数据。 在具有显示图像功能的信息处理装置的控制单元中，输入信息获取单元经由输入装置获取关于用户的输入操作的信息。 加载单元加载从硬盘驱动器进行图像显示的必要数据。 变速状态调整单元基于速度图来调整视点移动速度。 帧坐标确定单元依次确定显示区域的帧坐标。 解码单元解码压缩图像数据。 显示图像处理单元呈现显示图像。

公开(公告)号：US20130100255A1

公开(公告)日：2013-04-25

申请号：US13714765

申请日：2012-12-14

Applicant: Sony Computer Entertainment Inc.

Inventor： Akio Ohba ,  Hiroyuki Segawa ,  Tetsugo Inada

IPC: H04N13/02

CPC classification number: H04N13/239 ,  G01S3/784 ,  G06K9/3216 ,  G06K2009/3225 ,  G06T3/4038 ,  H04N5/232 ,  H04N5/2353 ,  H04N13/156 ,  H04N13/271

Abstract: An input information acquisition unit of an information processing device acknowledges a user input. An imaging condition control unit initiates imaging using the imaging condition determined according to the user input or a result of analyzing a captured image. An imaging condition storage unit stores an imaging condition table that maps target functions to imaging conditions. First and second image analysis units and acquire images captured by first and second cameras and installed in the imaging device and perform necessary image analysis. An information integration unit integrates images captured by the pair of cameras and results of analysis. An image data generation unit generates data for an image output as a result of the process.

Abstract translation: 信息处理装置的输入信息获取单元确认用户输入。 成像条件控制单元使用根据用户输入确定的成像条件或分析拍摄图像的结果来启动成像。 成像条件存储单元存储将目标函数映射到成像条件的成像条件表。 第一和第二图像分析单元，并获取由第一和第二相机拍摄并安装在成像装置中并执行必要的图像分析的图像。 信息集成单元集成了由摄像机拍摄的图像和分析结果。 图像数据生成单元生成作为处理结果的图像输出的数据。