公开(公告)号：US09253480B2

公开(公告)日：2016-02-02

申请号：US13760202

申请日：2013-02-06

Applicant: Sony Computer Entertainment Inc.

Inventor： Akio Ohba ,  Nobuo Sasaki ,  Akihiko Sugawara ,  Hiroyuki Segawa ,  Tetsugo Inada

IPC: H04N13/04 ,  G02B27/22 ,  H04N13/00 ,  H04N13/02

CPC classification number: H04N13/366 ,  G02B27/2214 ,  H04N13/128 ,  H04N13/279 ,  H04N13/31 ,  H04N13/376 ,  H04N13/383

Abstract: A viewpoint detection unit detects a user viewing a stereoscopic image, including a parallax image of a subject as viewed from a predetermined position defined as a reference view position, and tracks a viewpoint of the detected user. A motion parallax correction unit determines, if a speed of movement of the viewpoint becomes equal to or higher than a predetermined level, an amount of motion parallax correction for the parallax image, on the basis of an amount of movement of the viewpoint, so as to generate a stereoscopic image corrected for motion parallax, generates, if the speed of movement of the viewpoint subsequently becomes lower than a predetermined level, a stereoscopic image by changing the amount of motion parallax correction in steps until the parallax image return to parallax images as seen from the reference view position.

Abstract translation: 视点检测单元检测观看立体图像的用户，其包括从被定义为参考视图位置的预定位置观看的被摄体的视差图像，并且跟踪检测到的用户的视点。 运动视差校正单元基于视点的移动量来确定视点的移动速度等于或高于预定水平的视差图像的运动视差校正量，从而 以产生对运动视差进行校正的立体图像，如果视点的移动速度随后变得低于预定水平，则产生立体图像，通过改变运动视差校正的量直到视差图像返回到视差图像为止 从参考视图位置看。

公开(公告)号：US20150229927A1

公开(公告)日：2015-08-13

申请号：US14426658

申请日：2013-07-22

Applicant: SONY COMPUTER ENTERTAINMENT INC.

Inventor： Tetsugo Inada ,  Akio Ohba ,  Hiroyuki Segawa

IPC: H04N19/136 ,  G06T5/00 ,  H04N19/137 ,  H04N19/44 ,  H04N19/167 ,  G06T17/10

CPC classification number: H04N19/136 ,  G06T5/001 ,  G06T17/10 ,  H04N19/119 ,  H04N19/137 ,  H04N19/167 ,  H04N19/176 ,  H04N19/44 ,  H04N19/46 ,  H04N19/503 ,  H04N19/59 ,  H04N19/90

Abstract: A tile image sequence 250 obtained by dividing a frame into a predetermined size is further divided into another predetermined size on an image plane to generate a voxel (for example, a voxel 252) (S10). If a redundancy in a space direction or a time direction exists, then data is reduced in the direction (S12), and sequences in the time direction are deployed on a two-dimensional plane (S14). Voxel images are placed on an image plane of a predetermined size to generate one integrated image 258 (S16). In a grouping pattern which exhibits a minimum quantization error, pixels are collectively placed in the region of each voxel image for each group (integrated image 262) (S18). The integrated image 262 after the re-placement is compressed in accordance with a predetermined compression method to generate a compressed image 266 and reference information 264 for determining the position of a needed pixel (S20).

Abstract translation: 通过将帧划分为预定大小而获得的瓦片图像序列250在图像平面上被进一步分割为另一预定尺寸，以生成体素（例如，体素252）（S10）。 如果存在空间方向或时间方向的冗余，则在方向上减少数据（S12），并且将时间方向的顺序部署在二维平面上（S14）。 体素图像被放置在预定尺寸的图像平面上以产生一个集成图像258（S16）。 在具有最小量化误差的分组模式中，像素被集体地放置在每个组的每个体素图像的区域中（集成图像262）（S18）。 根据预定的压缩方法压缩重新放置后的集成图像262，以产生用于确定所需像素的位置的压缩图像266和参考信息264（S20）。

公开(公告)号：US08531488B2

公开(公告)日：2013-09-10

申请号：US13714752

申请日：2012-12-14

Applicant: Sony Computer Entertainment Inc.

Inventor： Akio Ohba ,  Hiroyuki Segawa ,  Tetsugo Inada

IPC: G09G5/00 ,  G06F3/048

CPC classification number: G09G5/34 ,  G06T19/00 ,  G06T2210/36 ,  G09G5/14

Abstract: A hard disk drive stores hierarchical image data, a speed map holding, for each tile image, an index of the processing time required to render a tile image having a predetermined image size obtained by partitioning the image, and scenario data which defines viewpoint shifting. In a control unit of an information processing apparatus having a function of displaying an image, an input information acquisition unit acquires information with respect to the user's input operation via an input device. A loading unit loads necessary data for image displaying from the hard disk drive. A shifting condition adjustment unit adjusts the viewpoint shifting speed based upon the speed map. A frame coordinate determination unit sequentially determines frame coordinates of a display area. A decoding unit decodes compressed image data. A display image processing unit renders a display image.

Abstract translation: 硬盘驱动器存储分层图像数据，对于每个瓦片图像，速度图保持渲染具有通过划分图像获得的预定图像大小的瓦片图像所需的处理时间的索引，以及定义视点移位的场景数据。 在具有显示图像功能的信息处理装置的控制单元中，输入信息获取单元经由输入装置获取关于用户的输入操作的信息。 加载单元加载从硬盘驱动器进行图像显示的必要数据。 变速状态调整单元基于速度图来调整视点移动速度。 帧坐标确定单元依次确定显示区域的帧坐标。 解码单元解码压缩图像数据。 显示图像处理单元呈现显示图像。

公开(公告)号：US20130100255A1

公开(公告)日：2013-04-25

申请号：US13714765

申请日：2012-12-14

Applicant: Sony Computer Entertainment Inc.

Inventor： Akio Ohba ,  Hiroyuki Segawa ,  Tetsugo Inada

IPC: H04N13/02

CPC classification number: H04N13/239 ,  G01S3/784 ,  G06K9/3216 ,  G06K2009/3225 ,  G06T3/4038 ,  H04N5/232 ,  H04N5/2353 ,  H04N13/156 ,  H04N13/271

Abstract: An input information acquisition unit of an information processing device acknowledges a user input. An imaging condition control unit initiates imaging using the imaging condition determined according to the user input or a result of analyzing a captured image. An imaging condition storage unit stores an imaging condition table that maps target functions to imaging conditions. First and second image analysis units and acquire images captured by first and second cameras and installed in the imaging device and perform necessary image analysis. An information integration unit integrates images captured by the pair of cameras and results of analysis. An image data generation unit generates data for an image output as a result of the process.

Abstract translation: 信息处理装置的输入信息获取单元确认用户输入。 成像条件控制单元使用根据用户输入确定的成像条件或分析拍摄图像的结果来启动成像。 成像条件存储单元存储将目标函数映射到成像条件的成像条件表。 第一和第二图像分析单元，并获取由第一和第二相机拍摄并安装在成像装置中并执行必要的图像分析的图像。 信息集成单元集成了由摄像机拍摄的图像和分析结果。 图像数据生成单元生成作为处理结果的图像输出的数据。

公开(公告)号：US20130100171A1

公开(公告)日：2013-04-25

申请号：US13714752

申请日：2012-12-14

Applicant: Sony Computer Entertainment Inc.

Inventor： Akio Ohba ,  Hiroyuki Segawa ,  Tetsugo Inada

IPC: G09G5/34

CPC classification number: G09G5/34 ,  G06T19/00 ,  G06T2210/36 ,  G09G5/14

Abstract: A hard disk drive stores hierarchical image data, a speed map holding, for each tile image, an index of the processing time required to render a tile image having a predetermined image size obtained by partitioning the image, and scenario data which defines viewpoint shifting. In a control unit of an information processing apparatus having a function of displaying an image, an input information acquisition unit acquires information with respect to the user's input operation via an input device. A loading unit loads necessary data for image displaying from the hard disk drive. A shifting condition adjustment unit adjusts the viewpoint shifting speed based upon the speed map. A frame coordinate determination unit sequentially determines frame coordinates of a display area. A decoding unit decodes compressed image data. A display image processing unit renders a display image.

Abstract translation: 硬盘驱动器存储分层图像数据，对于每个瓦片图像，速度图保持渲染具有通过划分图像获得的预定图像大小的瓦片图像所需的处理时间的索引，以及定义视点移位的场景数据。 在具有显示图像功能的信息处理装置的控制单元中，输入信息获取单元经由输入装置获取关于用户的输入操作的信息。 加载单元加载从硬盘驱动器进行图像显示的必要数据。 变速状态调整单元基于速度图来调整视点移动速度。 帧坐标确定单元依次确定显示区域的帧坐标。 解码单元解码压缩图像数据。 显示图像处理单元呈现显示图像。

公开(公告)号：US20180322651A1

公开(公告)日：2018-11-08

申请号：US15772935

申请日：2016-09-29

Applicant: Sony Corporation ,  Sony Interactive Entertainment Inc.

Inventor： Atsushi Kimura ,  Daisuke Tahara ,  Hiroyuki Segawa ,  Tetsugo Inada ,  Akio Ohba ,  Hirofumi Okamoto

IPC: G06T7/70 ,  G06K9/00

CPC classification number: G06T7/70 ,  G06K9/00369 ,  G06T1/00 ,  G06T7/60 ,  G06T2207/30196

Abstract: [Object] To perform more stable and highly accurate attitude estimation.[Solution] The attitude optimization unit optimizes the articulation position, the angle, the number of articulations, and the like which are attitude parameters of a human body model (tree structure) by a plurality of optimization techniques so as to match a region in which a human body can exist, and switches among a plurality of optimization techniques and uses an optimum technique. Note that optimization techniques include 1. initial value, 2. algorithm, and 3, restriction, and optimization is performed by switching among these three. For example, it is possible to apply the present disclosure to an image processing device that performs image processing of optimizing the articulation position and angle of a human body model.

公开(公告)号：US10885656B2

公开(公告)日：2021-01-05

申请号：US15772935

申请日：2016-09-29

Applicant: Sony Corporation ,  Sony Interactive Entertainment Inc.

Inventor： Atsushi Kimura ,  Daisuke Tahara ,  Hiroyuki Segawa ,  Tetsugo Inada ,  Akio Ohba ,  Hirofumi Okamoto

IPC: G06T7/70 ,  G06T7/60 ,  G06T7/73 ,  G06K9/00

Abstract: [Object] To perform more stable and highly accurate attitude estimation.
[Solution] The attitude optimization unit optimizes the articulation position, the angle, the number of articulations, and the like which are attitude parameters of a human body model (tree structure) by a plurality of optimization techniques so as to match a region in which a human body can exist, and switches among a plurality of optimization techniques and uses an optimum technique. Note that optimization techniques include 1. initial value, 2. algorithm, and 3, restriction, and optimization is performed by switching among these three. For example, it is possible to apply the present disclosure to an image processing device that performs image processing of optimizing the articulation position and angle of a human body model.

公开(公告)号：US10507381B2

公开(公告)日：2019-12-17

申请号：US15761975

申请日：2016-10-03

Applicant: Sony Corporation ,  Sony Interactive Entertainment Inc.

Inventor： Hiroshi Katoh ,  Tetsugo Inada ,  Tatsuki Kashitani ,  Takaaki Kato

IPC: A63F13/21 ,  A63F13/211 ,  G01B11/26 ,  G01B11/00 ,  G06T19/00 ,  A63F13/428 ,  A63F13/40 ,  A63F13/655 ,  A63F13/213 ,  A63F13/212

Abstract: A first estimating unit estimates at least one of a position and an attitude of a predetermined object on the basis of an image of a periphery of the object, the image being obtained from an imaging device, and generates an estimation result not including an accumulated error. A second estimating unit estimates at least one of the position and the attitude of the object on the basis of the image, and generates an estimation result including an accumulated error. A correcting unit compares the estimation result of the first estimating unit and the estimation result of the second estimating unit with each other, and corrects, on the basis of a result of the comparison, a subsequent estimation result of the second estimating unit, the subsequent estimation result being subsequent to the estimation result of the second estimating unit which estimation result is used for the comparison. An App executing unit performs predetermined data processing on the basis of the estimation result of the second estimating unit which estimation result is corrected by the correcting unit.

公开(公告)号：US20180272231A1

公开(公告)日：2018-09-27

申请号：US15761975

申请日：2016-10-03

Applicant: Sony Corporation ,  Sony Interactive Entertainment Inc.

Inventor： Hiroshi Katoh ,  Tetsugo Inada ,  Tatsuki Kashitani ,  Takaaki Kato

IPC: A63F13/211 ,  A63F13/212 ,  A63F13/213 ,  A63F13/40 ,  A63F13/428 ,  A63F13/655

CPC classification number: A63F13/211 ,  A63F13/212 ,  A63F13/213 ,  A63F13/40 ,  A63F13/428 ,  A63F13/655 ,  A63F2300/8082 ,  G01B11/00 ,  G01B11/26 ,  G06T19/00

Abstract: A first estimating unit estimates at least one of a position and an attitude of a predetermined object on the basis of an image of a periphery of the object, the image being obtained from an imaging device, and generates an estimation result not including an accumulated error. A second estimating unit estimates at least one of the position and the attitude of the object on the basis of the image, and generates an estimation result including an accumulated error. A correcting unit compares the estimation result of the first estimating unit and the estimation result of the second estimating unit with each other, and corrects, on the basis of a result of the comparison, a subsequent estimation result of the second estimating unit, the subsequent estimation result being subsequent to the estimation result of the second estimating unit which estimation result is used for the comparison. An App executing unit performs predetermined data processing on the basis of the estimation result of the second estimating unit which estimation result is corrected by the correcting unit.