公开(公告)号：US09715718B2

公开(公告)日：2017-07-25

申请号：US14301954

申请日：2014-06-11

Applicant: Sony Computer Entertainment Inc.

Inventor： Akio Ohba ,  Hiroyuki Segawa ,  Tetsugo Inada

IPC: G06T3/40 ,  G06F3/00 ,  G06T13/80

CPC classification number: G06T3/40 ,  G06F3/00 ,  G06F2203/04806 ,  G06T13/80

Abstract: An image processing device includes: an input information obtaining section for obtaining input information for changing a display region in an image as a display object; a display image processing section for generating an image inside the display region determined on a basis of the input information as a display image; and a display section for displaying the generated display image on a display, wherein when the input information obtaining section obtains input information for scaling the display image, the display image processing section scales the display image according to the input information, and performs image manipulation making visibility of a region in a predetermined range including a focus as a center of scaling in an image plane different from visibility of another region.

公开(公告)号：US09357203B2

公开(公告)日：2016-05-31

申请号：US13714765

申请日：2012-12-14

Applicant: Sony Computer Entertainment Inc.

Inventor： Akio Ohba ,  Hiroyuki Segawa ,  Tetsugo Inada

IPC: H04N13/02 ,  G06T3/40 ,  H04N5/232 ,  H04N5/235 ,  H04N13/00 ,  G01S3/784 ,  G06K9/32

CPC classification number: H04N13/239 ,  G01S3/784 ,  G06K9/3216 ,  G06K2009/3225 ,  G06T3/4038 ,  H04N5/232 ,  H04N5/2353 ,  H04N13/156 ,  H04N13/271

Abstract: An input information acquisition unit of an information processing device acknowledges a user input. An imaging condition control unit initiates imaging using the imaging condition determined according to the user input or a result of analyzing a captured image. An imaging condition storage unit stores an imaging condition table that maps target functions to imaging conditions. First and second image analysis units and acquire images captured by first and second cameras and installed in the imaging device and perform necessary image analysis. An information integration unit integrates images captured by the pair of cameras and results of analysis. An image data generation unit generates data for an image output as a result of the process.

Abstract translation: 信息处理装置的输入信息获取单元确认用户输入。 成像条件控制单元使用根据用户输入确定的成像条件或分析拍摄图像的结果来启动成像。 成像条件存储单元存储将目标函数映射到成像条件的成像条件表。 第一和第二图像分析单元，并获取由第一和第二相机拍摄并安装在成像装置中并执行必要的图像分析的图像。 信息集成单元集成了由摄像机拍摄的图像和分析结果。 图像数据生成单元生成作为处理结果的图像输出的数据。

公开(公告)号：US20150287215A1

公开(公告)日：2015-10-08

申请号：US14435278

申请日：2013-07-18

Applicant: Sony Computer Entertainment Inc.

Inventor： Akio Ohba ,  Hiroyuki Segawa ,  Tetsugo Inada ,  Hirofumi Okamoto

IPC: G06T7/20 ,  H04N13/00 ,  G06T7/00

CPC classification number: G06T7/50 ,  G06K9/00228 ,  G06T7/74 ,  G06T2207/10012 ,  G06T2207/30196 ,  H04N13/128 ,  H04N13/239 ,  H04N2013/0081

Abstract: An image acquisition section of an information processor acquires stereo images from an imaging device. An input information acquisition section acquires an instruction input from a user. A depth image acquisition portion of a position information generation section generates a depth image representing a position distribution of subjects existing in the field of view of the imaging device in the depth direction using stereo images. A matching portion adjusts the size of a reference template image in accordance with the position of each of the subjects in the depth direction represented by the depth image first, then performs template matching on the depth image, thus identifying the position of a target having a given shape and size in the three-dimensional space. An output information generation section generates output information by performing necessary processes based on the target position.

Abstract translation: 信息处理器的图像获取部分从成像装置获取立体图像。 输入信息获取部分获取从用户输入的指令。 位置信息生成部分的深度图像获取部分使用立体图像生成表示在深度方向上存在于成像装置的视野中的被摄体的位置分布的深度图像。 匹配部分根据由深度图像表示的深度方向上的每个被摄体的位置首先调整参考模板图像的尺寸，然后对深度图像执行模板匹配，从而识别具有 给定的形状和尺寸在三维空间。 输出信息生成部通过基于目标位置执行必要的处理来生成输出信息。

公开(公告)号：US20150124883A1

公开(公告)日：2015-05-07

申请号：US14366498

申请日：2012-10-24

Applicant: Sony Computer Entertainment Inc.

Inventor： Tetsugo Inada ,  Akio Ohba ,  Hiroyuki Segawa

IPC: H04N19/51

CPC classification number: H04N19/51 ,  H04N19/105 ,  H04N19/137 ,  H04N19/14 ,  H04N19/167 ,  H04N19/174 ,  H04N19/198 ,  H04N19/428 ,  H04N19/587 ,  H04N19/59 ,  H04N19/593

Abstract: A frame sequence of moving picture data is divided into a tile image sequence 250, and the color space of the tile image sequence 250 is converted to generate a YCbCr image sequence 252 (S10). Each frame is reduced to ½ time in the vertical and horizontal directions (S12), and a compression process is carried out to generate compression data 260 of a reference image (S14). The compression data 260 of the reference image is decoded and decompressed similarly as upon image display to restore a YCbCr image as the reference image, and a difference image sequence 262 is generated from the reference image and the original YCbCr image 252 (S16). Then, compression data 266 of a difference image is generated (S18), and compression data 268 obtained by connecting the compression data 260 of the reference image and the compression data 266 of the difference image is generated for every four frames of a tile image (S20).

Abstract translation: 运动图像数据的帧序列被划分为瓦片图像序列250，并且将图像图像序列250的颜色空间转换为生成YCbCr图像序列252（S10）。 每个帧在垂直和水平方向上减少到1/2时间（S12），并执行压缩处理以产生参考图像的压缩数据260（S14）。 参考图像的压缩数据260与图像显示类似地进行解码和解压缩，以恢复作为参考图像的YCbCr图像，并且从参考图像和原始YCbCr图像252生成差分图像序列262（S16）。 然后，生成差分图像的压缩数据266（S18），并且通过连接参考图像的压缩数据260和差分图像的压缩数据266获得的压缩数据268针对瓦片图像的每四帧产生 S20）。

公开(公告)号：US20150077520A1

公开(公告)日：2015-03-19

申请号：US14397654

申请日：2013-04-11

Applicant: Sony Computer Entertainment Inc.

Inventor： Akio Ohba ,  Hiroyuki Segawa ,  Tetsugo Inada

IPC: H04N13/02 ,  H04N13/00

CPC classification number: H04N13/239 ,  A63F13/213 ,  G06F3/011 ,  G06F3/017 ,  G06F3/0304 ,  G06T7/593 ,  G06T2207/10012 ,  H04N13/128

Abstract: An information processor includes a detection plane definition portion defining a detection plane in a 3D space of a camera coordinate system of a first camera and calculates vertex coordinates of a detection area by projecting the detection plane onto a plane of a left image shot by the first camera. A feature quantity calculation portion generates feature point image of left and right images. A parallax correction area derivation portion derives an area as a parallax correction area. The parallax correction area is obtained by moving, to a left, an area of a right image identical to the detection area of the left image by as much as the parallax appropriate to a position of the detection plane in a depth direction. A matching portion performs block matching for the feature point images of each area, thus deriving a highly rated feature point. A position information output portion generates information to be used by an output information generation section based on the matching result and output that information.

Abstract translation: 信息处理器包括检测平面定义部分，其定义第一相机的相机坐标系的3D空间中的检测平面，并通过将检测平面投影到由第一相机拍摄的左图像的平面上来计算检测区域的顶点坐标 相机。 特征量计算部分生成左图像和右图像的特征点图像。 视差校正区域导出部分将区域导出为视差校正区域。 视差校正区域通过向与左侧图像的检测区域相同的右侧图像的区域向左移动与在深度方向上的检测平面的位置相适应的视差来获得。 匹配部分对每个区域的特征点图像执行块匹配，从而导出高度评价的特征点。 位置信息输出部根据匹配结果生成要由输出信息生成部使用的信息，并输出该信息。

公开(公告)号：US20140153634A1

公开(公告)日：2014-06-05

申请号：US14234492

申请日：2012-07-02

Applicant: Sony Computer Entertainment Inc.

Inventor： Tetsugo Inada ,  Akio Ohba ,  Hiroyuki Segawa

IPC: H04N19/30

CPC classification number: H04N19/30 ,  H04N5/76 ,  H04N9/8042 ,  H04N19/115 ,  H04N19/162 ,  H04N19/174 ,  H04N19/187 ,  H04N19/33 ,  H04N19/59 ,  H04N21/234327 ,  H04N21/23439 ,  H04N21/8456

Abstract: Frames of a moving image are configured as a hierarchical structure where each frame is represented with a plurality of resolutions. Some layers are set as original image layers, and the other layers are set as difference image layers in hierarchical data representing a frame at each time step. In the case that an area is to be displayed in the resolution of the difference image layer, to respective pixel values of a difference image of the area, respective pixel values of an image of a corresponding area retained by the original image layer of lower resolution, the image enlarged to the resolution of the difference image layer, are added. A layer to be set as a difference image layer is switched to another layer as time passes.

Abstract translation: 运动图像的帧被配置为其中每个帧以多个分辨率表示的分层结构。 一些层被设置为原始图像层，并且其他层被设置为表示每个时间步长的帧的分层数据中的差分图像层。 在以差分图像层的分辨率显示区域的情况下，对于区域的差分图像的各个像素值，由较低分辨率的原始图像层保留的对应区域的图像的各个像素值 ，将图像放大到差分图像层的分辨率。 随着时间的流逝，要设置为差分图像层的层被切换到另一层。

公开(公告)号：US10469829B2

公开(公告)日：2019-11-05

申请号：US14397654

申请日：2013-04-11

Applicant: Sony Computer Entertainment Inc.

Inventor： Akio Ohba ,  Hiroyuki Segawa ,  Tetsugo Inada

IPC: H04N13/239 ,  H04N13/128

Abstract: An information processor acquires a stereo image from an imaging device. A detection plane definition portion defines a detection plane in a three-dimensional space of a camera coordinate system of a first camera. A feature quantity calculation portion generates feature point image of left and right images. A parallax correction area derivation portion derives an area as a parallax correction area, which is obtained by moving, to a left, an area of the right image identical to the detection area of the left image. A matching portion performs matching for the feature point images of each area, thus deriving a highly rated feature point. A position information output portion generates information to be used by an output information generation section based on the matching result.

公开(公告)号：US10334237B2

公开(公告)日：2019-06-25

申请号：US14992522

申请日：2016-01-11

Applicant: Sony Computer Entertainment Inc.

Inventor： Tetsugo Inada ,  Shoichi Ikenoue

IPC: G06T19/00 ,  H04N13/279 ,  H04N13/332 ,  H04N13/366

Abstract: An information processing device includes: an information processing section configured to detect a figure of a target object from an image captured from a movie of the target object so as to perform information processing on the detected image; a main data generating section configured to generate data of a main image to be displayed as a result of the information processing; an auxiliary data generating section configured to generate data of an auxiliary image including the captured image; and an output data transmitting section configured to transmit to an output device the main image data and the auxiliary image data in relation to each other such that the main image and the auxiliary image are displayed together.

公开(公告)号：US09373308B2

公开(公告)日：2016-06-21

申请号：US14360969

申请日：2012-10-24

Applicant: Sony Computer Entertainment Inc.

Inventor： Akio Ohba ,  Tetsugo Inada ,  Hiroyuki Segawa

IPC: G09G5/377 ,  G09G5/00 ,  G09G5/14 ,  G09G5/36 ,  G09G5/38 ,  G09G5/391 ,  G06F3/0485 ,  G09G5/34 ,  G09G5/393

CPC classification number: G09G5/377 ,  G06F3/0485 ,  G06F2203/04806 ,  G09G5/00 ,  G09G5/14 ,  G09G5/34 ,  G09G5/36 ,  G09G5/38 ,  G09G5/391 ,  G09G5/393 ,  G09G2340/02 ,  G09G2340/0407 ,  G09G2340/045 ,  G09G2340/12 ,  G09G2350/00

Abstract: An input information obtaining portion of a control section obtains requests input from an input device by a user, which requests include a display region moving request to enlarge/reduce or scroll an image displayed on a display device and a request to generate/erase a viewport, change the size of a viewport, or move a viewport. A viewport control portion successively determines the number, arrangement, and size of viewports accordingly. A display region determining portion determines the region of an image to be displayed next in each viewport. A loading portion determines tile images to be newly loaded, and loads the data of the tile images from a hard disk drive. A decoding portion decodes the data of tile images used for rendering the image in each viewport. A display image processing portion updates the display region independently for each viewport.

Abstract translation: 控制部分的输入信息获取部分获得用户从输入装置输入的请求，该请求包括用于放大/缩小或滚动显示在显示装置上的图像的显示区域移动请求以及生成/删除视口的请求 ，更改视口的大小，或移动视口。 视口控制部分相应地依次确定视口的数量，布置和尺寸。 显示区域确定部分确定要在每个视口中显示的图像的区域。 加载部分确定要新加载的瓦片图像，并从硬盘驱动器加载瓦片图像的数据。 解码部分解码用于在每个视口中呈现图像的平铺图像的数据。 显示图像处理部分针对每个视口独立地更新显示区域。

公开(公告)号：US09148564B2

公开(公告)日：2015-09-29

申请号：US14250677

申请日：2014-04-11

Applicant: Sony Computer Entertainment Inc.

Inventor： Akio Ohba ,  Hiroyuki Segawa ,  Hideyuki Saito ,  Hidehiko Ogasawara ,  Tetsugo Inada

IPC: H04N5/232 ,  H04N5/33 ,  H04N9/04 ,  H04N13/00 ,  G06T3/40

CPC classification number: H04N5/23229 ,  G06T3/4038 ,  H04N5/332 ,  H04N9/045 ,  H04N13/161

Abstract: An image pickup apparatus includes: an image data production unit configured to produce data of a plurality of kinds of images from a picked up image and successively output the data; an image synthesis unit configured to cyclically connect the data of the plurality of kinds of images for each pixel string within a range set in advance for each of the kinds of the images and output the connected data as a stream to produce a virtual synthetic image; and an image sending unit configured to accept, from a host terminal, a data transmission request that designates a rectangular region in the virtual synthetic image, extract and connect data from the stream and transmit the connected data as a new stream to the host terminal.

Abstract translation: 图像拾取装置包括：图像数据生成单元，被配置为从拾取图像生成多种图像的数据，并连续地输出数据; 图像合成单元，被配置为将每个像素串的多种图像的数据循环地连接到针对各种图像的预先设定的范围内，并将连接的数据作为流输出以产生虚拟合成图像; 以及图像发送单元，被配置为从主机终端接收指定所述虚拟合成图像中的矩形区域的数据发送请求，从所述流中提取和连接数据，并将连接的数据作为新流发送到所述主机终端。