公开(公告)号：US20150301616A1

公开(公告)日：2015-10-22

申请号：US14740696

申请日：2015-06-16

Applicant: Sony Computer Entertainment Inc.

Inventor： Teiyu GOTO ,  Katsu Saito ,  Akio Ohba ,  Hiroyuki Segawa

IPC: G06F3/033 ,  A63F13/24

CPC classification number: A63F13/213 ,  A63F13/06 ,  A63F13/24 ,  A63F13/42 ,  A63F2300/1006 ,  A63F2300/1043 ,  A63F2300/1093 ,  A63F2300/301 ,  A63F2300/6045 ,  G06F3/033

Abstract: A game controller includes a plurality of LEDs formed on the rear of a case. The plurality of LEDs are arranged two-dimensionally in its layout area. The game controller has a plurality of PWM control units which are provided inside the case and control the lighting of the plurality of LEDs, respectively. The PWM control units control the lighting of the LEDs based on a control signal from a game apparatus. The game apparatus acquires a captured image of the game controller, and acquires the position of the game controller in the captured image based on the positions of the LEDs in the captured image.

Abstract translation: 游戏控制器包括形成在壳体后部的多个LED。 多个LED在其布局区域中二维布置。 游戏控制器具有设置在壳体内的多个PWM控制单元，分别控制多个LED的点亮。 PWM控制单元基于来自游戏装置的控制信号来控制LED的点亮。 游戏装置获取游戏控制器的拍摄图像，并且基于拍摄图像中的LED的位置来获取拍摄图像中的游戏控制器的位置。

公开(公告)号：US20150287215A1

公开(公告)日：2015-10-08

申请号：US14435278

申请日：2013-07-18

Applicant: Sony Computer Entertainment Inc.

Inventor： Akio Ohba ,  Hiroyuki Segawa ,  Tetsugo Inada ,  Hirofumi Okamoto

IPC: G06T7/20 ,  H04N13/00 ,  G06T7/00

CPC classification number: G06T7/50 ,  G06K9/00228 ,  G06T7/74 ,  G06T2207/10012 ,  G06T2207/30196 ,  H04N13/128 ,  H04N13/239 ,  H04N2013/0081

Abstract: An image acquisition section of an information processor acquires stereo images from an imaging device. An input information acquisition section acquires an instruction input from a user. A depth image acquisition portion of a position information generation section generates a depth image representing a position distribution of subjects existing in the field of view of the imaging device in the depth direction using stereo images. A matching portion adjusts the size of a reference template image in accordance with the position of each of the subjects in the depth direction represented by the depth image first, then performs template matching on the depth image, thus identifying the position of a target having a given shape and size in the three-dimensional space. An output information generation section generates output information by performing necessary processes based on the target position.

Abstract translation: 信息处理器的图像获取部分从成像装置获取立体图像。 输入信息获取部分获取从用户输入的指令。 位置信息生成部分的深度图像获取部分使用立体图像生成表示在深度方向上存在于成像装置的视野中的被摄体的位置分布的深度图像。 匹配部分根据由深度图像表示的深度方向上的每个被摄体的位置首先调整参考模板图像的尺寸，然后对深度图像执行模板匹配，从而识别具有 给定的形状和尺寸在三维空间。 输出信息生成部通过基于目标位置执行必要的处理来生成输出信息。

公开(公告)号：US20150124883A1

公开(公告)日：2015-05-07

申请号：US14366498

申请日：2012-10-24

Applicant: Sony Computer Entertainment Inc.

Inventor： Tetsugo Inada ,  Akio Ohba ,  Hiroyuki Segawa

IPC: H04N19/51

CPC classification number: H04N19/51 ,  H04N19/105 ,  H04N19/137 ,  H04N19/14 ,  H04N19/167 ,  H04N19/174 ,  H04N19/198 ,  H04N19/428 ,  H04N19/587 ,  H04N19/59 ,  H04N19/593

Abstract: A frame sequence of moving picture data is divided into a tile image sequence 250, and the color space of the tile image sequence 250 is converted to generate a YCbCr image sequence 252 (S10). Each frame is reduced to ½ time in the vertical and horizontal directions (S12), and a compression process is carried out to generate compression data 260 of a reference image (S14). The compression data 260 of the reference image is decoded and decompressed similarly as upon image display to restore a YCbCr image as the reference image, and a difference image sequence 262 is generated from the reference image and the original YCbCr image 252 (S16). Then, compression data 266 of a difference image is generated (S18), and compression data 268 obtained by connecting the compression data 260 of the reference image and the compression data 266 of the difference image is generated for every four frames of a tile image (S20).

Abstract translation: 运动图像数据的帧序列被划分为瓦片图像序列250，并且将图像图像序列250的颜色空间转换为生成YCbCr图像序列252（S10）。 每个帧在垂直和水平方向上减少到1/2时间（S12），并执行压缩处理以产生参考图像的压缩数据260（S14）。 参考图像的压缩数据260与图像显示类似地进行解码和解压缩，以恢复作为参考图像的YCbCr图像，并且从参考图像和原始YCbCr图像252生成差分图像序列262（S16）。 然后，生成差分图像的压缩数据266（S18），并且通过连接参考图像的压缩数据260和差分图像的压缩数据266获得的压缩数据268针对瓦片图像的每四帧产生 S20）。

公开(公告)号：US20150077520A1

公开(公告)日：2015-03-19

申请号：US14397654

申请日：2013-04-11

Applicant: Sony Computer Entertainment Inc.

Inventor： Akio Ohba ,  Hiroyuki Segawa ,  Tetsugo Inada

IPC: H04N13/02 ,  H04N13/00

CPC classification number: H04N13/239 ,  A63F13/213 ,  G06F3/011 ,  G06F3/017 ,  G06F3/0304 ,  G06T7/593 ,  G06T2207/10012 ,  H04N13/128

Abstract: An information processor includes a detection plane definition portion defining a detection plane in a 3D space of a camera coordinate system of a first camera and calculates vertex coordinates of a detection area by projecting the detection plane onto a plane of a left image shot by the first camera. A feature quantity calculation portion generates feature point image of left and right images. A parallax correction area derivation portion derives an area as a parallax correction area. The parallax correction area is obtained by moving, to a left, an area of a right image identical to the detection area of the left image by as much as the parallax appropriate to a position of the detection plane in a depth direction. A matching portion performs block matching for the feature point images of each area, thus deriving a highly rated feature point. A position information output portion generates information to be used by an output information generation section based on the matching result and output that information.

Abstract translation: 信息处理器包括检测平面定义部分，其定义第一相机的相机坐标系的3D空间中的检测平面，并通过将检测平面投影到由第一相机拍摄的左图像的平面上来计算检测区域的顶点坐标 相机。 特征量计算部分生成左图像和右图像的特征点图像。 视差校正区域导出部分将区域导出为视差校正区域。 视差校正区域通过向与左侧图像的检测区域相同的右侧图像的区域向左移动与在深度方向上的检测平面的位置相适应的视差来获得。 匹配部分对每个区域的特征点图像执行块匹配，从而导出高度评价的特征点。 位置信息输出部根据匹配结果生成要由输出信息生成部使用的信息，并输出该信息。

公开(公告)号：US20140153634A1

公开(公告)日：2014-06-05

申请号：US14234492

申请日：2012-07-02

Applicant: Sony Computer Entertainment Inc.

Inventor： Tetsugo Inada ,  Akio Ohba ,  Hiroyuki Segawa

IPC: H04N19/30

CPC classification number: H04N19/30 ,  H04N5/76 ,  H04N9/8042 ,  H04N19/115 ,  H04N19/162 ,  H04N19/174 ,  H04N19/187 ,  H04N19/33 ,  H04N19/59 ,  H04N21/234327 ,  H04N21/23439 ,  H04N21/8456

Abstract: Frames of a moving image are configured as a hierarchical structure where each frame is represented with a plurality of resolutions. Some layers are set as original image layers, and the other layers are set as difference image layers in hierarchical data representing a frame at each time step. In the case that an area is to be displayed in the resolution of the difference image layer, to respective pixel values of a difference image of the area, respective pixel values of an image of a corresponding area retained by the original image layer of lower resolution, the image enlarged to the resolution of the difference image layer, are added. A layer to be set as a difference image layer is switched to another layer as time passes.

Abstract translation: 运动图像的帧被配置为其中每个帧以多个分辨率表示的分层结构。 一些层被设置为原始图像层，并且其他层被设置为表示每个时间步长的帧的分层数据中的差分图像层。 在以差分图像层的分辨率显示区域的情况下，对于区域的差分图像的各个像素值，由较低分辨率的原始图像层保留的对应区域的图像的各个像素值 ，将图像放大到差分图像层的分辨率。 随着时间的流逝，要设置为差分图像层的层被切换到另一层。

公开(公告)号：US09619868B2

公开(公告)日：2017-04-11

申请号：US14652536

申请日：2013-07-22

Applicant: Sony Computer Entertainment Inc.

Inventor： Akio Ohba ,  Hiroyuki Segawa ,  Tetsugo Inada ,  Hidehiko Ogasawara ,  Hirofumi Okamoto

IPC: G06K9/54 ,  G06T5/00 ,  G06F3/03 ,  H04N13/00 ,  G06K9/62 ,  G06T5/40 ,  G06F3/01 ,  H04N5/225 ,  H04N5/235 ,  G06F3/00 ,  G06T5/50

CPC classification number: G06T5/00 ,  G06F3/005 ,  G06F3/011 ,  G06F3/0304 ,  G06K9/6201 ,  G06T5/009 ,  G06T5/40 ,  G06T5/50 ,  G06T2207/10012 ,  H04N5/2258 ,  H04N5/2353 ,  H04N5/2355 ,  H04N13/00 ,  H04N13/156 ,  H04N2013/0074

Abstract: An imaging device includes a first camera and a second camera and shoots the same object under different shooting conditions. A shot-image data acquirer of an image analyzer acquires data of two images simultaneously shot from the imaging device. A correcting section aligns the distributions of the luminance value between the two images by carrying out correction for either one of the two images. A correction table managing section switches and generates a correction table to be used according to the function implemented by the information processing device. A correction table storage stores the correction table showing the correspondence relationship between the luminance values before and after correction. A depth image generator performs stereo matching by using the two images and generates a depth image.

公开(公告)号：US09460337B2

公开(公告)日：2016-10-04

申请号：US14437605

申请日：2013-07-22

Applicant: SONY COMPUTER ENTERTAINMENT INC.

Inventor： Akio Ohba ,  Hiroyuki Segawa ,  Tetsugo Inada ,  Hirofumi Okamoto

IPC: G06K9/00 ,  G06T7/20

CPC classification number: G06K9/00261 ,  G06T7/246 ,  G06T2207/10021 ,  G06T2207/20016 ,  G06T2207/30201

Abstract: An image storage section 48 stores shot image data with a plurality of resolutions transmitted from an imaging device. Depth images 152 with a plurality of resolutions are generated using stereo images with a plurality of resolution levels from the shot image data (S10). Next, template matching is performed using a reference template image 154 that represents a desired shape and size, thus extracting a candidate area for a target picture having the shape and size for each distance range associated with one of the resolutions (S12). A more detailed analysis is performed on the extracted candidate areas using the shot image stored in the image storage section 48 (S14). In some cases, a further image analysis is performed based on the analysis result using a shot image with a higher resolution level (S16a and S16b).

Abstract translation: 图像存储部分48存储从成像装置传输的多个分辨率的拍摄图像数据。 使用来自拍摄图像数据的具有多个分辨率级别的立体图像生成具有多个分辨率的深度图像152（S10）。 接下来，使用表示期望的形状和大小的参考模板图像154来执行模板匹配，从而提取具有与分辨率之一相关联的每个距离范围的形状和大小的目标图片的候选区域（S12）。 使用存储在图像存储部分48中的拍摄图像对所提取的候选区域进行更详细的分析（S14）。 在一些情况下，使用具有较高分辨率水平的拍摄图像（S16a和S16b），基于分析结果进行进一步的图像分析。

公开(公告)号：US09253480B2

公开(公告)日：2016-02-02

申请号：US13760202

申请日：2013-02-06

Applicant: Sony Computer Entertainment Inc.

Inventor： Akio Ohba ,  Nobuo Sasaki ,  Akihiko Sugawara ,  Hiroyuki Segawa ,  Tetsugo Inada

IPC: H04N13/04 ,  G02B27/22 ,  H04N13/00 ,  H04N13/02

CPC classification number: H04N13/366 ,  G02B27/2214 ,  H04N13/128 ,  H04N13/279 ,  H04N13/31 ,  H04N13/376 ,  H04N13/383

Abstract: A viewpoint detection unit detects a user viewing a stereoscopic image, including a parallax image of a subject as viewed from a predetermined position defined as a reference view position, and tracks a viewpoint of the detected user. A motion parallax correction unit determines, if a speed of movement of the viewpoint becomes equal to or higher than a predetermined level, an amount of motion parallax correction for the parallax image, on the basis of an amount of movement of the viewpoint, so as to generate a stereoscopic image corrected for motion parallax, generates, if the speed of movement of the viewpoint subsequently becomes lower than a predetermined level, a stereoscopic image by changing the amount of motion parallax correction in steps until the parallax image return to parallax images as seen from the reference view position.

Abstract translation: 视点检测单元检测观看立体图像的用户，其包括从被定义为参考视图位置的预定位置观看的被摄体的视差图像，并且跟踪检测到的用户的视点。 运动视差校正单元基于视点的移动量来确定视点的移动速度等于或高于预定水平的视差图像的运动视差校正量，从而 以产生对运动视差进行校正的立体图像，如果视点的移动速度随后变得低于预定水平，则产生立体图像，通过改变运动视差校正的量直到视差图像返回到视差图像为止 从参考视图位置看。

公开(公告)号：US20150229927A1

公开(公告)日：2015-08-13

申请号：US14426658

申请日：2013-07-22

Applicant: SONY COMPUTER ENTERTAINMENT INC.

Inventor： Tetsugo Inada ,  Akio Ohba ,  Hiroyuki Segawa

IPC: H04N19/136 ,  G06T5/00 ,  H04N19/137 ,  H04N19/44 ,  H04N19/167 ,  G06T17/10

CPC classification number: H04N19/136 ,  G06T5/001 ,  G06T17/10 ,  H04N19/119 ,  H04N19/137 ,  H04N19/167 ,  H04N19/176 ,  H04N19/44 ,  H04N19/46 ,  H04N19/503 ,  H04N19/59 ,  H04N19/90

Abstract: A tile image sequence 250 obtained by dividing a frame into a predetermined size is further divided into another predetermined size on an image plane to generate a voxel (for example, a voxel 252) (S10). If a redundancy in a space direction or a time direction exists, then data is reduced in the direction (S12), and sequences in the time direction are deployed on a two-dimensional plane (S14). Voxel images are placed on an image plane of a predetermined size to generate one integrated image 258 (S16). In a grouping pattern which exhibits a minimum quantization error, pixels are collectively placed in the region of each voxel image for each group (integrated image 262) (S18). The integrated image 262 after the re-placement is compressed in accordance with a predetermined compression method to generate a compressed image 266 and reference information 264 for determining the position of a needed pixel (S20).

Abstract translation: 通过将帧划分为预定大小而获得的瓦片图像序列250在图像平面上被进一步分割为另一预定尺寸，以生成体素（例如，体素252）（S10）。 如果存在空间方向或时间方向的冗余，则在方向上减少数据（S12），并且将时间方向的顺序部署在二维平面上（S14）。 体素图像被放置在预定尺寸的图像平面上以产生一个集成图像258（S16）。 在具有最小量化误差的分组模式中，像素被集体地放置在每个组的每个体素图像的区域中（集成图像262）（S18）。 根据预定的压缩方法压缩重新放置后的集成图像262，以产生用于确定所需像素的位置的压缩图像266和参考信息264（S20）。

公开(公告)号：US08531488B2

公开(公告)日：2013-09-10

申请号：US13714752

申请日：2012-12-14

Applicant: Sony Computer Entertainment Inc.

Inventor： Akio Ohba ,  Hiroyuki Segawa ,  Tetsugo Inada

IPC: G09G5/00 ,  G06F3/048

CPC classification number: G09G5/34 ,  G06T19/00 ,  G06T2210/36 ,  G09G5/14

Abstract: A hard disk drive stores hierarchical image data, a speed map holding, for each tile image, an index of the processing time required to render a tile image having a predetermined image size obtained by partitioning the image, and scenario data which defines viewpoint shifting. In a control unit of an information processing apparatus having a function of displaying an image, an input information acquisition unit acquires information with respect to the user's input operation via an input device. A loading unit loads necessary data for image displaying from the hard disk drive. A shifting condition adjustment unit adjusts the viewpoint shifting speed based upon the speed map. A frame coordinate determination unit sequentially determines frame coordinates of a display area. A decoding unit decodes compressed image data. A display image processing unit renders a display image.

Abstract translation: 硬盘驱动器存储分层图像数据，对于每个瓦片图像，速度图保持渲染具有通过划分图像获得的预定图像大小的瓦片图像所需的处理时间的索引，以及定义视点移位的场景数据。 在具有显示图像功能的信息处理装置的控制单元中，输入信息获取单元经由输入装置获取关于用户的输入操作的信息。 加载单元加载从硬盘驱动器进行图像显示的必要数据。 变速状态调整单元基于速度图来调整视点移动速度。 帧坐标确定单元依次确定显示区域的帧坐标。 解码单元解码压缩图像数据。 显示图像处理单元呈现显示图像。