公开(公告)号：US20240276347A1

公开(公告)日：2024-08-15

申请号：US18436384

申请日：2024-02-08

Applicant: Samsung Electronics Co., Ltd.

Inventor： Eric YIP ,  Hyunkoo YANG

IPC: H04W48/04 ,  H04L65/65 ,  H04W8/22

CPC classification number: H04W48/04 ,  H04L65/65 ,  H04W8/22

Abstract: A method and device for efficiently providing an artificial intelligence/machine learning (AI/ML) media service using AI/ML model split processing in a wireless communication system is provided. The method and device are related to a 5th generation (5G) or 6th generation (6G) communication system for supporting a higher data transmission rate. The method includes receiving, from a network server providing the AI/ML media service, service access information including at least one of information for media session handling and information for media streaming access, obtaining information on client AI media inferencing capabilities and functions, negotiating with the network server for splitting an AI media inference processing, based on the received service access information and the obtained information on client AI media inferencing capabilities and functions, and receiving, from the network server, either intermediate data or inference output data by AI model split inferencing.

公开(公告)号：US20230351705A1

公开(公告)日：2023-11-02

申请号：US18023179

申请日：2021-08-26

Applicant: Samsung Electronics Co., Ltd.

Inventor： Eric YIP ,  Hyunkoo YANG ,  Jaeyeon SONG

IPC: G06T19/00

CPC classification number: G06T19/006

Abstract: The present disclosure relates to a 5G communication system or a 6G communication system for supporting higher data rates beyond a 4G communication system such as long term evolution (LTE). The present disclosure provides a method and apparatus for anchor based rendering modes, related parameters and metadata. The method for performing rendering for an augmented reality (AR) media object in a communication system is provided, the method comprises obtaining metadata including information for determining a rendering mode of the AR media object, the information including first information indicating whether the AR object include a translational motion, receving, from a server, AR media data including an AR media object, determining a rendering mode for rendering the AR media object based on the metadata including the first information, and rendering the AR media object based on the determined rendering mode.

公开(公告)号：US20230316583A1

公开(公告)日：2023-10-05

申请号：US18015858

申请日：2021-07-13

Applicant: Samsung Electronics Co., Ltd.

Inventor： Eric YIP ,  Hyunkoo YANG ,  Jaeyeon SONG

IPC: G06T9/00 ,  G06T19/00 ,  G06T15/10 ,  G06F3/01

CPC classification number: G06T9/001 ,  G06F3/012 ,  G06T15/10 ,  G06T19/00 ,  G06T2210/56

Abstract: The present disclosure relates to a method and device for using latency compensatory pose prediction with respect to three-dimensional (3D) media data to perform rendering in a communication system supporting mixed reality (XR)/augmented reality (AR). According to an embodiment of the present disclosure, a method for a first device, which receives 3D media data from a media server in a communication system, to perform rendering comprises the steps of receiving, from AR glasses, pose prediction-related information including pose information of a first point in time; performing pose prediction of a second point in time, at which 2-dimensional (2D) rendering is to be performed in the AR glasses, on the basis of the pose prediction-related information; rendering one or a plurality of 2D pose prediction rendering views with respect to the received 3D media data on the basis of one or a plurality of pieces of predicted pose information of the second point in time; and transmitting, to the AR glasses, 2D media data compressed by encoding the one or plurality of 2D pose prediction rendering views.

公开(公告)号：US20220366641A1

公开(公告)日：2022-11-17

申请号：US17662987

申请日：2022-05-11

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Eric YIP ,  Hyunkoo YANG ,  Jaeyeon SONG

IPC: G06T15/20 ,  G06T19/00 ,  G06T7/73

Abstract: A method for augmented reality (AR) remote rendering process performed by a remote rendering device. The method includes performing 3D scene compositing based on a live geometry information and an anchor information; receiving, from an AR device, a pose information; rendering 2D frame of the composited 3D scene based on the pose information; performing 2D frame processing on the rendered 2D frame; creating a first metadata associated with the 2D frame processing, a second metadata associated with the rendered 2D frame and a third metadata associated with AR frame compositing of the rendered 2D frame; and transmitting, to the AR device, the rendered 2D frame, the first metadata, the second metadata and the third metadata.

公开(公告)号：US20220078215A1

公开(公告)日：2022-03-10

申请号：US17469265

申请日：2021-09-08

Applicant: Samsung Electronics Co., Ltd.

Inventor： Eric YIP ,  Hyunkoo YANG ,  Jaeyeon SONG

IPC: H04L29/06 ,  H04W28/20

Abstract: The disclosure relates to a fifth generation (5G) communication system or a sixth generation (6G) communication system for supporting higher data rates beyond a fourth generation (4G) communication system such as long term evolution (LTE). The disclosure provides rendering of fisheye 360 degree video contents, including fisheye circular image videos. A method of a transmitting device is provided. The method includes transmitting, to a receiving device, a Session Description Protocol (SDP) offer message for negotiation of parameter associated with a fisheye image, and receiving, from the receiving device, a fisheye SDP answer message including second fisheye image related information generated based on first fisheye image related information included in the SDP offer message. wherein the first fisheye image related information includes first maximum packing information indicating a maximum number of fisheye images that is available to be packed into one stream.

公开(公告)号：US20210279945A1

公开(公告)日：2021-09-09

申请号：US17256505

申请日：2019-07-09

Applicant: Samsung Electronics Co., Ltd.

Inventor： Jaehyeon BAE ,  Youngwan SO ,  Hyunkoo YANG ,  Eric YIP

IPC: G06T15/20 ,  G06F3/0346 ,  G06T11/00

Abstract: According to an embodiment of the present disclosure, there is provided a method of receiving a multimedia service, in which, by using user feedback information in a large-volume 6 degrees of freedom (6DoF) media transmission service using network-based media processing (NBMP), it is possible to reduce network traffic through efficient media transmission and a burden of rendering media content on a terminal. According to an embodiment of the present disclosure, a method of processing content includes receiving content regarding an object in a three-dimensional (3D) space, the content including media data and metadata, performing pre-rendering on the media data based on user information, and outputting pre-rendered data.

公开(公告)号：US20210235058A1

公开(公告)日：2021-07-29

申请号：US16958438

申请日：2020-01-08

Applicant: Samsung Electronics Co., Ltd.

Inventor： Eric YIP ,  Jaehyeon BAE ,  Hyunkoo YANG

IPC: H04N13/194 ,  H04N13/178 ,  H04N21/854 ,  H04N21/845

Abstract: A method of transmitting three-dimensional (3D) video content, according to an embodiment of the present disclosure, includes: defining a 3D space; obtaining placement information about at least one 3D object to be placed in the 3D space; dividing the at least one 3D object; compressing 3D video content including the divided at least one 3D object into a two-dimensional (2D) video frame; obtaining, from the 2D video frame, location information about compressed data corresponding to the divided at least one 3D object; encoding the 2D video frame; generating a media file including the encoded 2D video frame and the location information; and transmitting the media file.

公开(公告)号：US20200302680A1

公开(公告)日：2020-09-24

申请号：US16818345

申请日：2020-03-13

Applicant: Samsung Electronics Co., Ltd.

Inventor： Eric YIP ,  Jaehyeon BAE ,  Hyunkoo YANG

IPC: G06T15/20 ,  H04L29/06 ,  G06T3/00

Abstract: A method and an apparatus for transmitting and receiving video content including 3D data are provided. According to an embodiment, a method for transmitting data related to content including an omnidirectional image and a point cloud object is provided. The method includes generating media data and metadata for the content including the omnidirectional image and the point cloud object; and transmitting the generated media data and the generated metadata, wherein the metadata comprises information for specifying sub-spaces of a bounding space related to the point cloud object.

公开(公告)号：US20190206032A1

公开(公告)日：2019-07-04

申请号：US15770673

申请日：2016-10-27

Applicant: Samsung Electronics Co., Ltd.

Inventor： Eric YIP ,  Dong-Yeon KIM

IPC: G06T5/00 ,  G06T5/40 ,  G06T7/11 ,  G06T7/13

CPC classification number: G06T5/008 ,  G06T5/40 ,  G06T7/11 ,  G06T7/13 ,  G06T2207/20208 ,  H04N5/235 ,  H04N5/355

Abstract: An apparatus and a method for controlling a contrast ratio of content in an electronic device are disclosed. The method for controlling a contrast ratio of content in an electronic device, presented in one embodiment of the present disclosure, comprises the steps of: identifying one or more highlight regions on the basis of brightness information of a frame forming the content; determining thresholds for detecting the one or more highlight regions from the frame; generating one or more masks corresponding to the one or more highlight regions on the basis of the thresholds; and generating a contrast ratio-controlled frame on the basis of the one or more masks and one or more boosting factors for the content.

公开(公告)号：US20190052858A1

公开(公告)日：2019-02-14

申请号：US16076917

申请日：2017-02-13

Applicant: Samsung Electronics Co., Ltd.

Inventor： Eric YIP ,  Byeong-Doo CHOI ,  Jae-Yeon SONG

IPC: H04N13/139 ,  H04N13/194 ,  H04N5/232 ,  G06T3/00 ,  H04N13/161

Abstract: A communication technique for merging, with an IoT technology, a 5G communication system for supporting a data transmission rate higher than that of a 4G system is provided. The communication technique can be applied to an intelligent service (for example, smart home, smart building, smart city, smart car or connected car, health care, digital education, retail business, and security and safety-related services, and the like) on the basis of a 5G communication technology and an IoT-related technology. A method for processing a 360-degree image is provided. The method includes determining a three-dimensional (3D) model for mapping a 360-degree image; determining a partition size for the 360-degree image; determining a rotational angle for each of the x, y, and z axes of the 360-degree image; determining an interpolation method to be applied when mapping the 360-degree image to a two-dimensional (2D) image; and converting the 360-degree image into the 2D image.