公开(公告)号：US20150124883A1

公开(公告)日：2015-05-07

申请号：US14366498

申请日：2012-10-24

Applicant: Sony Computer Entertainment Inc.

Inventor： Tetsugo Inada ,  Akio Ohba ,  Hiroyuki Segawa

IPC: H04N19/51

CPC classification number: H04N19/51 ,  H04N19/105 ,  H04N19/137 ,  H04N19/14 ,  H04N19/167 ,  H04N19/174 ,  H04N19/198 ,  H04N19/428 ,  H04N19/587 ,  H04N19/59 ,  H04N19/593

Abstract: A frame sequence of moving picture data is divided into a tile image sequence 250, and the color space of the tile image sequence 250 is converted to generate a YCbCr image sequence 252 (S10). Each frame is reduced to ½ time in the vertical and horizontal directions (S12), and a compression process is carried out to generate compression data 260 of a reference image (S14). The compression data 260 of the reference image is decoded and decompressed similarly as upon image display to restore a YCbCr image as the reference image, and a difference image sequence 262 is generated from the reference image and the original YCbCr image 252 (S16). Then, compression data 266 of a difference image is generated (S18), and compression data 268 obtained by connecting the compression data 260 of the reference image and the compression data 266 of the difference image is generated for every four frames of a tile image (S20).

Abstract translation: 运动图像数据的帧序列被划分为瓦片图像序列250，并且将图像图像序列250的颜色空间转换为生成YCbCr图像序列252（S10）。 每个帧在垂直和水平方向上减少到1/2时间（S12），并执行压缩处理以产生参考图像的压缩数据260（S14）。 参考图像的压缩数据260与图像显示类似地进行解码和解压缩，以恢复作为参考图像的YCbCr图像，并且从参考图像和原始YCbCr图像252生成差分图像序列262（S16）。 然后，生成差分图像的压缩数据266（S18），并且通过连接参考图像的压缩数据260和差分图像的压缩数据266获得的压缩数据268针对瓦片图像的每四帧产生 S20）。

公开(公告)号：US20150077520A1

公开(公告)日：2015-03-19

申请号：US14397654

申请日：2013-04-11

Applicant: Sony Computer Entertainment Inc.

Inventor： Akio Ohba ,  Hiroyuki Segawa ,  Tetsugo Inada

IPC: H04N13/02 ,  H04N13/00

CPC classification number: H04N13/239 ,  A63F13/213 ,  G06F3/011 ,  G06F3/017 ,  G06F3/0304 ,  G06T7/593 ,  G06T2207/10012 ,  H04N13/128

Abstract: An information processor includes a detection plane definition portion defining a detection plane in a 3D space of a camera coordinate system of a first camera and calculates vertex coordinates of a detection area by projecting the detection plane onto a plane of a left image shot by the first camera. A feature quantity calculation portion generates feature point image of left and right images. A parallax correction area derivation portion derives an area as a parallax correction area. The parallax correction area is obtained by moving, to a left, an area of a right image identical to the detection area of the left image by as much as the parallax appropriate to a position of the detection plane in a depth direction. A matching portion performs block matching for the feature point images of each area, thus deriving a highly rated feature point. A position information output portion generates information to be used by an output information generation section based on the matching result and output that information.

Abstract translation: 信息处理器包括检测平面定义部分，其定义第一相机的相机坐标系的3D空间中的检测平面，并通过将检测平面投影到由第一相机拍摄的左图像的平面上来计算检测区域的顶点坐标 相机。 特征量计算部分生成左图像和右图像的特征点图像。 视差校正区域导出部分将区域导出为视差校正区域。 视差校正区域通过向与左侧图像的检测区域相同的右侧图像的区域向左移动与在深度方向上的检测平面的位置相适应的视差来获得。 匹配部分对每个区域的特征点图像执行块匹配，从而导出高度评价的特征点。 位置信息输出部根据匹配结果生成要由输出信息生成部使用的信息，并输出该信息。

公开(公告)号：US20140153634A1

公开(公告)日：2014-06-05

申请号：US14234492

申请日：2012-07-02

Applicant: Sony Computer Entertainment Inc.

Inventor： Tetsugo Inada ,  Akio Ohba ,  Hiroyuki Segawa

IPC: H04N19/30

CPC classification number: H04N19/30 ,  H04N5/76 ,  H04N9/8042 ,  H04N19/115 ,  H04N19/162 ,  H04N19/174 ,  H04N19/187 ,  H04N19/33 ,  H04N19/59 ,  H04N21/234327 ,  H04N21/23439 ,  H04N21/8456

Abstract: Frames of a moving image are configured as a hierarchical structure where each frame is represented with a plurality of resolutions. Some layers are set as original image layers, and the other layers are set as difference image layers in hierarchical data representing a frame at each time step. In the case that an area is to be displayed in the resolution of the difference image layer, to respective pixel values of a difference image of the area, respective pixel values of an image of a corresponding area retained by the original image layer of lower resolution, the image enlarged to the resolution of the difference image layer, are added. A layer to be set as a difference image layer is switched to another layer as time passes.

Abstract translation: 运动图像的帧被配置为其中每个帧以多个分辨率表示的分层结构。 一些层被设置为原始图像层，并且其他层被设置为表示每个时间步长的帧的分层数据中的差分图像层。 在以差分图像层的分辨率显示区域的情况下，对于区域的差分图像的各个像素值，由较低分辨率的原始图像层保留的对应区域的图像的各个像素值 ，将图像放大到差分图像层的分辨率。 随着时间的流逝，要设置为差分图像层的层被切换到另一层。

公开(公告)号：US10469829B2

公开(公告)日：2019-11-05

申请号：US14397654

申请日：2013-04-11

Applicant: Sony Computer Entertainment Inc.

Inventor： Akio Ohba ,  Hiroyuki Segawa ,  Tetsugo Inada

IPC: H04N13/239 ,  H04N13/128

Abstract: An information processor acquires a stereo image from an imaging device. A detection plane definition portion defines a detection plane in a three-dimensional space of a camera coordinate system of a first camera. A feature quantity calculation portion generates feature point image of left and right images. A parallax correction area derivation portion derives an area as a parallax correction area, which is obtained by moving, to a left, an area of the right image identical to the detection area of the left image. A matching portion performs matching for the feature point images of each area, thus deriving a highly rated feature point. A position information output portion generates information to be used by an output information generation section based on the matching result.

公开(公告)号：US10334237B2

公开(公告)日：2019-06-25

申请号：US14992522

申请日：2016-01-11

Applicant: Sony Computer Entertainment Inc.

Inventor： Tetsugo Inada ,  Shoichi Ikenoue

IPC: G06T19/00 ,  H04N13/279 ,  H04N13/332 ,  H04N13/366

Abstract: An information processing device includes: an information processing section configured to detect a figure of a target object from an image captured from a movie of the target object so as to perform information processing on the detected image; a main data generating section configured to generate data of a main image to be displayed as a result of the information processing; an auxiliary data generating section configured to generate data of an auxiliary image including the captured image; and an output data transmitting section configured to transmit to an output device the main image data and the auxiliary image data in relation to each other such that the main image and the auxiliary image are displayed together.

公开(公告)号：US10063838B2

公开(公告)日：2018-08-28

申请号：US14802709

申请日：2015-07-17

Applicant: SONY CORPORATION ,  Sony Computer Entertainment Inc.

Inventor： Hiroyuki Segawa ,  Akio Ohba ,  Tetsugo Inada ,  Hirofumi Okamoto ,  Atsushi Kimura ,  Takashi Kohashi ,  Takashi Itou

IPC: H04N13/02 ,  G06F3/01 ,  G06T1/20 ,  G06F3/03 ,  G06T7/593 ,  H04N13/00

CPC classification number: H04N13/239 ,  G06F3/011 ,  G06F3/0304 ,  G06T1/20 ,  G06T7/593 ,  G06T2207/20016 ,  G06T2207/20021 ,  H04N2013/0081

Abstract: An information processor includes: a similarity data generation portion generating similarity data that represents the calculated similarity to the image in the reference block in association with a position within the search range; a result evaluation portion detecting a position with a maximum similarity value for each piece of the similarity data and screening the detection result by making a given evaluation of the similarity; a depth image generation portion finding a parallax for each of the reference blocks using the detection result validated as a result of screening, calculating a position of a subject in a depth direction on a basis of the parallax, and generating a depth image by associating the position of the subject in the depth direction with an image plane; and an output information generation section performing given information processing on a basis of the subject position in a three-dimensional space using the depth image and outputting the result of information processing.

公开(公告)号：US09373308B2

公开(公告)日：2016-06-21

申请号：US14360969

申请日：2012-10-24

Applicant: Sony Computer Entertainment Inc.

Inventor： Akio Ohba ,  Tetsugo Inada ,  Hiroyuki Segawa

IPC: G09G5/377 ,  G09G5/00 ,  G09G5/14 ,  G09G5/36 ,  G09G5/38 ,  G09G5/391 ,  G06F3/0485 ,  G09G5/34 ,  G09G5/393

CPC classification number: G09G5/377 ,  G06F3/0485 ,  G06F2203/04806 ,  G09G5/00 ,  G09G5/14 ,  G09G5/34 ,  G09G5/36 ,  G09G5/38 ,  G09G5/391 ,  G09G5/393 ,  G09G2340/02 ,  G09G2340/0407 ,  G09G2340/045 ,  G09G2340/12 ,  G09G2350/00

Abstract: An input information obtaining portion of a control section obtains requests input from an input device by a user, which requests include a display region moving request to enlarge/reduce or scroll an image displayed on a display device and a request to generate/erase a viewport, change the size of a viewport, or move a viewport. A viewport control portion successively determines the number, arrangement, and size of viewports accordingly. A display region determining portion determines the region of an image to be displayed next in each viewport. A loading portion determines tile images to be newly loaded, and loads the data of the tile images from a hard disk drive. A decoding portion decodes the data of tile images used for rendering the image in each viewport. A display image processing portion updates the display region independently for each viewport.

Abstract translation: 控制部分的输入信息获取部分获得用户从输入装置输入的请求，该请求包括用于放大/缩小或滚动显示在显示装置上的图像的显示区域移动请求以及生成/删除视口的请求 ，更改视口的大小，或移动视口。 视口控制部分相应地依次确定视口的数量，布置和尺寸。 显示区域确定部分确定要在每个视口中显示的图像的区域。 加载部分确定要新加载的瓦片图像，并从硬盘驱动器加载瓦片图像的数据。 解码部分解码用于在每个视口中呈现图像的平铺图像的数据。 显示图像处理部分针对每个视口独立地更新显示区域。

公开(公告)号：US09148564B2

公开(公告)日：2015-09-29

申请号：US14250677

申请日：2014-04-11

Applicant: Sony Computer Entertainment Inc.

Inventor： Akio Ohba ,  Hiroyuki Segawa ,  Hideyuki Saito ,  Hidehiko Ogasawara ,  Tetsugo Inada

IPC: H04N5/232 ,  H04N5/33 ,  H04N9/04 ,  H04N13/00 ,  G06T3/40

CPC classification number: H04N5/23229 ,  G06T3/4038 ,  H04N5/332 ,  H04N9/045 ,  H04N13/161

Abstract: An image pickup apparatus includes: an image data production unit configured to produce data of a plurality of kinds of images from a picked up image and successively output the data; an image synthesis unit configured to cyclically connect the data of the plurality of kinds of images for each pixel string within a range set in advance for each of the kinds of the images and output the connected data as a stream to produce a virtual synthetic image; and an image sending unit configured to accept, from a host terminal, a data transmission request that designates a rectangular region in the virtual synthetic image, extract and connect data from the stream and transmit the connected data as a new stream to the host terminal.

Abstract translation: 图像拾取装置包括：图像数据生成单元，被配置为从拾取图像生成多种图像的数据，并连续地输出数据; 图像合成单元，被配置为将每个像素串的多种图像的数据循环地连接到针对各种图像的预先设定的范围内，并将连接的数据作为流输出以产生虚拟合成图像; 以及图像发送单元，被配置为从主机终端接收指定所述虚拟合成图像中的矩形区域的数据发送请求，从所述流中提取和连接数据，并将连接的数据作为新流发送到所述主机终端。

公开(公告)号：US08928694B2

公开(公告)日：2015-01-06

申请号：US13741448

申请日：2013-01-15

Applicant: Sony Computer Entertainment Inc.

Inventor： Tetsugo Inada ,  Akio Ohba ,  Hiroyuki Segawa

IPC: G09G5/00 ,  G06T11/60 ,  G09G5/395

CPC classification number: G06T11/60 ,  G09G5/395

Abstract: An original image to be edited is displayed using hierarchical data. As a user draws a figure in a region of the image as an edit action, an image data updating unit generates a layer having a hierarchical structure composed of the rendered region only. More specifically, the image of the region to be edited is used as the lowermost hierarchical level, and upper hierarchical levels than this lowermost level are generated by reducing the lowermost level, as appropriate, so as to produce hierarchical data. As, during image display, it is checked that the updated region is contained in a frame to be displayed anew, the image of the layer is displayed by superposing the frame on the original hierarchical data.

Abstract translation: 使用分层数据显示要编辑的原始图像。 当用户在图像的区域中绘制图形作为编辑动作时，图像数据更新单元生成仅由渲染区域构成的层次结构的层。 更具体地说，将要编辑的区域的图像用作最下层级，并且通过适当地减小最低级别来产生比最低级别的上层级别，以便产生分层数据。 因为，在图像显示期间，检查更新的区域是否包含在要重新显示的帧中，通过将帧叠加在原始分层数据上来显示层的图像。

公开(公告)号：US20140247285A1

公开(公告)日：2014-09-04

申请号：US14128027

申请日：2012-05-22

Applicant: SONY COMPUTER ENTERTAINMENT INC.

Inventor： Akio Ohba ,  Hiroyuki Segawa ,  Tetsugo Inada

IPC: G06T3/40 ,  G06T11/20

CPC classification number: G06T3/40 ,  G06T11/00 ,  G06T11/20 ,  G06T2200/16 ,  G06T2210/08 ,  G06T2210/36 ,  H04N21/234327 ,  H04N21/234345 ,  H04N21/2662 ,  H04N21/45455 ,  H04N21/4728 ,  H04N21/816

Abstract: Links are set among three hierarchical data 170, 172, and 174 and one moving image data 182. When a display area overlaps with a link area 176 while an image is being displayed by using the hierarchical data 170, switching to display by use of the 0-th hierarchical level of the hierarchical data 172 is made (link a). When the display area overlaps with a link area 178 while an image is being displayed by using the hierarchical data 172, switching to display by use of the 0-th hierarchical level of the hierarchical data 174 is made (link b). The link destination of another link area 180 of the hierarchical data 170 is the moving image data 182 (link c) and moving image reproduction is started as a result of zoom-up of this area. The hierarchical data 170 and 172 are held on the client terminal side and the data existing on the other side of a switching boundary 184 are transmitted by a server to the client terminal in a data stream format.

Abstract translation: 在三个分层数据170,172和174中设置链接以及一个运动图像数据182.当通过使用分层数据170显示图像时，当显示区域与链接区域176重叠时，通过使用 进行分层数据172的0级分级（链接a）。 当通过使用分级数据172显示图像时，当显示区域与链接区域178重叠时，进行通过使用分级数据174的第0级分级进行显示的切换（链接b）。 层次数据170的另一链接区域180的链接目的地是运动图像数据182（链接c），并且作为该区域的放大的结果开始运动图像再现。 分层数据170和172被保存在客户终端侧，存在于切换边界184的另一侧的数据由服务器以数据流格式发送到客户终端。