公开(公告)号：US20230062756A1

公开(公告)日：2023-03-02

申请号：US17411432

申请日：2021-08-25

Applicant: SONY GROUP CORPORATION ,  Sony Corporation of America

Inventor： HIROYUKI TAKEDA ,  KENDAI FURUKAWA ,  MOHAMMAD GHARAVI-ALKHANSARI

IPC: G06T13/40 ,  G06T17/20 ,  G06T7/246 ,  H04N5/04 ,  H04N5/247

Abstract: An electronic device and method of preservation of geometry details in tracked meshes is provided. A set of three-dimensional (3D) scans and a sequence of tracked meshes of an object of interest are acquired. The sequence of tracked meshes comprises a set of tracked meshes which temporally corresponds to the set of 3D scans. Based on differences between the set of tracked meshes and the set of 3D scans, a set of displacement maps is generated. A plurality of vectors is computed, each of which includes surface tension values associated with mesh vertices of a corresponding tracked mesh. Based on the set of displacement maps and a corresponding set of vectors, a neural network is trained on a task of displacement map generation. The trained neural network model is applied on the plurality of vectors to generate displacement maps. Each tracked mesh is updated based on a corresponding displacement map.

公开(公告)号：US20190238819A1

公开(公告)日：2019-08-01

申请号：US16318431

申请日：2017-07-14

Applicant: SONY CORPORATION

Inventor： KENDAI FURUKAWA ,  JUNICHI TANAKA ,  HIROSHI ORYOJI ,  YUICHI HASEGAWA ,  GOH KOBAYASHI

IPC: H04N13/117 ,  H04N13/282

CPC classification number: H04N13/117 ,  G06T15/205 ,  G06T19/00 ,  H04N13/00 ,  H04N13/282

Abstract: The present disclosure relates to an image processing apparatus and an image processing method that make it possible to generate a texture image of high picture quality at a predetermined viewpoint using an omnidirectional image. A plurality of real cameras image a plurality of reference images at a plurality of viewpoint positions in a plurality of sight line directions. A great weight is applied to a reference image in a sight line direction close to a virtual viewpoint specified in response to a movement of a head mounted display and having a virtual viewpoint position and a sight line direction to generate a virtual viewpoint image by weighted averaging, and the virtual viewpoint image is displayed on the head mounted display. The present disclosure can be applied, for example, to a home server or the like that generates a display image of a predetermined viewpoint from an omnidirectional image.

公开(公告)号：US20190268612A1

公开(公告)日：2019-08-29

申请号：US16319909

申请日：2017-07-21

Applicant: SONY CORPORATION

Inventor： TETSUYA FUKUYASU ,  KENDAI FURUKAWA

IPC: H04N19/30 ,  G09G5/14 ,  H04N13/00 ,  H04N19/597 ,  H04N21/462

Abstract: The present disclosure relates to an image processing apparatus and an image processing method that make it possible to suppress deterioration of picture quality of an image within a viewing range of a viewer. An image processing apparatus includes an image processing section configured to perform, based on priorities between a plurality of encoded streams obtained by encoding a plurality of projection images that are obtained by projecting an omnidirectional image to a plurality of faces or a plurality of viewpoint images from different viewpoints, decoding of the encoded streams and generation or selection of an image to be used for generation of a display image, and a drawing section configured to generate the display image based on the generated or selected image. The present disclosure can be applied to a home server and so forth that generate a display image within a viewing range of a viewer from an omnidirectional image.