公开(公告)号：US12062215B2

公开(公告)日：2024-08-13

申请号：US18015858

申请日：2021-07-13

Applicant: Samsung Electronics Co., Ltd.

Inventor： Eric Yip ,  Hyunkoo Yang ,  Jaeyeon Song

IPC: G06F3/01 ,  G06T9/00 ,  G06T15/10 ,  G06T19/00

CPC classification number: G06T9/001 ,  G06F3/012 ,  G06T15/10 ,  G06T19/00 ,  G06T2210/56

Abstract: The present disclosure relates to a method and device for using latency compensatory pose prediction with respect to three-dimensional (3D) media data to perform rendering in a communication system supporting mixed reality (XR)/augmented reality (AR). According to an embodiment of the present disclosure, a method for a first device, which receives 3D media data from a media server in a communication system, to perform rendering comprises the steps of: receiving, from AR glasses, pose prediction-related information including pose information of a first point in time; performing pose prediction of a second point in time, at which 2-dimensional (2D) rendering is to be performed in the AR glasses, on the basis of the pose prediction-related information; rendering one or a plurality of 2D pose prediction rendering views with respect to the received 3D media data on the basis of one or a plurality of pieces of predicted pose information of the second point in time; and transmitting, to the AR glasses, 2D media data compressed by encoding the one or plurality of 2D pose prediction rendering views.

公开(公告)号：US11606576B2

公开(公告)日：2023-03-14

申请号：US17278951

申请日：2019-10-08

Applicant: Samsung Electronics Co., Ltd.

Inventor： Eric Yip ,  Jaehyeon Bae ,  Hyunkoo Yang

IPC: H04N19/597 ,  H04N19/70 ,  G06T15/00 ,  H04N21/84 ,  H04N21/845 ,  G06T15/10

Abstract: The present disclosure relates to a method and a device for generating and transmitting a media file containing three-dimensional (3D) video content. The present disclosure also relates to a method and a device for reconstructing and reproducing three-dimensional video content from a received media file. According to an aspect of an embodiment of the present disclosure, a method of generating a media file containing three-dimensional video content may include inserting, into a media data box in the media file, a plurality of components contained in a two-dimensional video frame in which the three-dimensional video content is compressed; inserting, into a metadata box in the media file, first tracks respectively corresponding to the components and a second track containing metadata; and inserting, into the second track, information about an entry point for each of the plurality of components.

公开(公告)号：US11516454B2

公开(公告)日：2022-11-29

申请号：US16981119

申请日：2019-04-02

Applicant: Samsung Electronics Co., Ltd.

Inventor： Eric Yip ,  Hyunkoo Yang ,  Youngwan So ,  Jaehyeon Bae

IPC: H04N13/178 ,  H04N13/194 ,  H04N13/282

Abstract: Provided is a method for transmitting metadata for omnidirectional content including a plurality of viewpoints. The method comprises identifying the metadata for the omnidirectional content including the plurality of viewpoints; and transmitting the identified metadata, wherein the metadata includes information about an identifier (ID) of a viewpoint group including at least one viewpoint of the plurality of viewpoints, and wherein the at least one viewpoint in the viewpoint group shares a common reference coordinate system.

公开(公告)号：US11381885B2

公开(公告)日：2022-07-05

申请号：US17299157

申请日：2019-12-03

Applicant: Samsung Electronics Co., Ltd.

Inventor： Jaehyeon Bae ,  Hyunkoo Yang ,  Eric Yip

IPC: H04N7/173 ,  H04N21/647 ,  G06F9/48 ,  H04N21/6371

Abstract: A media content processing management method according to an embodiment of the disclosure includes: obtaining, from a network based media processing (NBMP) source, workflow information for media content processing; identifying whether to use a feedback task, based on the workflow information, obtaining, from a function repository, function information about a function of the feedback task or about a function of at least one media task for the media content processing, based on the workflow information, obtaining task information based on at least one of the workflow information and the function information, delivering the task information to each of tasks, obtaining client feedback information, and updating the task information based on the client feedback information, wherein the task information includes at least one of input information, output information, configuration information, or connection information of each of the tasks, and the connection information includes connection information of a media processing task and the feedback task, the media processing task using client assistance information from among the at least one media task.

公开(公告)号：US11348307B2

公开(公告)日：2022-05-31

申请号：US17256505

申请日：2019-07-09

Applicant: Samsung Electronics Co., Ltd.

Inventor： Jaehyeon Bae ,  Youngwan So ,  Hyunkoo Yang ,  Eric Yip

IPC: G06T15/20 ,  G06T11/00 ,  G06F3/0346

Abstract: According to an embodiment of the present disclosure, there is provided a method of receiving a multimedia service, in which, by using user feedback information in a large-volume 6 degrees of freedom (6DoF) media transmission service using network-based media processing (NBMP), it is possible to reduce network traffic through efficient media transmission and a burden of rendering media content on a terminal. According to an embodiment of the present disclosure, a method of processing content includes receiving content regarding an object in a three-dimensional (3D) space, the content including media data and metadata, performing pre-rendering on the media data based on user information, and outputting pre-rendered data.

公开(公告)号：US11223813B2

公开(公告)日：2022-01-11

申请号：US15867064

申请日：2018-01-10

Applicant: Samsung Electronics Co., Ltd.

Inventor： Eric Yip

IPC: H04N13/178 ,  H04N13/194 ,  H04N21/235 ,  H04N21/81

Abstract: Disclosed are a method and apparatus for generating metadata for a three dimensional (3D) image. The method includes generating metadata for an image rendered to be shaped as a sphere and transmitting the generated metadata, wherein the metadata includes information representing a region of the image.

公开(公告)号：US10863235B2

公开(公告)日：2020-12-08

申请号：US15702367

申请日：2017-09-12

Applicant: Samsung Electronics Co., Ltd.

Inventor： Eric Yip ,  Byeong-Doo Choi

IPC: H04N21/44 ,  H04N13/178 ,  H04N13/194 ,  H04N13/117 ,  H04N13/111 ,  H04N5/232 ,  H04N21/41 ,  H04N21/81 ,  H04N13/344 ,  G06F3/0482 ,  H04N21/4728

Abstract: Disclosed is a technology for a sensor network, Machine to Machine (M2M) communication, Machine Type Communication (MTC), and Internet of Things (IoT). The present disclosure can be used for intelligent services based on the technology (services related to smart home, smart building, smart city, smart car, connected car, health care, digital education, retail business, security, and safety). A method of reproducing content by a virtual reality device is provided. The method includes transmitting parameters related to functions of a user device; receiving interest metadata related to content that matches a set of the transmitted parameters; receiving and decoding the content corresponding to a version that matches the set of transmitted parameters in a unit of at least one tile corresponding to a view area to be displayed in accordance with a user's viewpoint based on the interest metadata; and rendering the decoded tile based on the interest metadata.

公开(公告)号：US10685467B2

公开(公告)日：2020-06-16

申请号：US15702387

申请日：2017-09-12

Applicant: Samsung Electronics Co., Ltd.

Inventor： Byeong-Doo Choi ,  Jae-Yun Jeong ,  Eric Yip

IPC: G06T11/60 ,  H04N7/18 ,  H04N5/357 ,  H04N13/106 ,  H04N13/204 ,  H04N13/156 ,  H04N13/178 ,  H04N13/194 ,  H04N5/232 ,  H04N5/38

Abstract: A method for transmitting virtual reality (VR) content by a device is provided. The method includes obtaining at least two images captured from a target, arranging the at least two images and projecting the at least two images onto a planar surface to configure a 360-degree image corresponding to the VR content, detecting an overlapped region of the at least two images projected and generating rearrangement information about the overlapped region, and transmitting the rearrangement information and the at least two images.

公开(公告)号：US12255960B2

公开(公告)日：2025-03-18

申请号：US17741864

申请日：2022-05-11

Applicant: Samsung Electronics Co., Ltd.

Inventor： Eric Yip ,  Hyunkoo Yang ,  Jaeyeon Song

IPC: H04L67/131 ,  H04L67/141 ,  H04N21/44

Abstract: The disclosure relates to a 5G or 6G communication system for supporting a higher data transmission rate. According to embodiment, the method includes receiving, from a server, an SD based on URL information obtained from an AR/MR application, processing the SD, configuring at least one media buffer pipeline for a media object of a scene, based on the processed SD, and establishing transport sessions for components of the media object.

公开(公告)号：US12056809B2

公开(公告)日：2024-08-06

申请号：US17662987

申请日：2022-05-11

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Eric Yip ,  Hyunkoo Yang ,  Jaeyeon Song

IPC: G06T15/00 ,  G06T7/73 ,  G06T15/20 ,  G06T19/00

CPC classification number: G06T15/205 ,  G06T7/75 ,  G06T19/006

Abstract: A method for augmented reality (AR) remote rendering process performed by a remote rendering device. The method includes performing 3D scene compositing based on a live geometry information and an anchor information; receiving, from an AR device, a pose information; rendering 2D frame of the composited 3D scene based on the pose information; performing 2D frame processing on the rendered 2D frame; creating a first metadata associated with the 2D frame processing, a second metadata associated with the rendered 2D frame and a third metadata associated with AR frame compositing of the rendered 2D frame; and transmitting, to the AR device, the rendered 2D frame, the first metadata, the second metadata and the third metadata.