公开(公告)号：US20170302972A1

公开(公告)日：2017-10-19

申请号：US15130885

申请日：2016-04-15

Applicant: Advanced Micro Devices, Inc. ,  ATI Technologies ULC

Inventor： Lei Zhang ,  Gabor Sines ,  Khaled Mammou ,  David Glen ,  Layla A. Mah ,  Rajabali M. Koduri ,  Bruce Montag

IPC: H04N21/2343 ,  H04N21/434 ,  H04N21/43 ,  H04N21/414 ,  H04L29/06 ,  H04N21/2368 ,  H04N21/236 ,  H04N21/437 ,  H04N21/422

CPC classification number: H04N21/2343 ,  H04L65/602 ,  H04L65/607 ,  H04L67/38 ,  H04L69/24 ,  H04N21/234345 ,  H04N21/23605 ,  H04N21/2368 ,  H04N21/41407 ,  H04N21/422 ,  H04N21/42202 ,  H04N21/4307 ,  H04N21/4341 ,  H04N21/4343 ,  H04N21/437 ,  H04N21/44218 ,  H04N21/6582 ,  H04N21/816

Abstract: Virtual Reality (VR) systems, apparatuses and methods of processing data are provided which include predicting, at a server, a user viewpoint of a next frame of video data based on received user feedback information sensed at a client, rendering a portion of the next frame using the prediction, encoding the portion, formatting the encoded portion into packets and transmitting the video data. At a client, the encoded and packetized A/V data is received and depacketized. The portion of video data and corresponding audio data is decoded and controlled to be displayed and aurally provided in synchronization. Latency may be minimized by utilizing handshaking between hardware components and/or software components such as a 3D server engine, one or more client processors, one or more client processors, a video encoder, a server NIC, a video decoder, a client NIC; and a 3D client engine.

公开(公告)号：US20170302918A1

公开(公告)日：2017-10-19

申请号：US15130873

申请日：2016-04-15

Applicant: Advanced Micro Devices, Inc. ,  ATI Technologies ULC

Inventor： Khaled Mammou ,  Ihab Amer ,  Gabor Sines ,  Lei Zhang ,  Layla A. Mah ,  Guennadi Riguer ,  David Glen

IPC: H04N19/103 ,  H04N19/597 ,  H04N19/167 ,  H04N19/124 ,  H04N19/162 ,  H04N19/147 ,  G06K9/00 ,  H04N19/172

CPC classification number: H04N19/103 ,  G06K9/0061 ,  G06K9/00744 ,  H04N19/124 ,  H04N19/162 ,  H04N19/167 ,  H04N19/17 ,  H04N19/597

Abstract: Systems, methods and apparatuses of processing data of a VR system are disclosed that comprise receiving tracking information which includes at least one of user position information and eye gaze point information. One or more processors may be used to predict, based on the user tracking information, a user viewpoint of a next frame of a sequence of frames of video data to be displayed. Using the prediction, a portion of the next frame of video data to be displayed is rendered at an estimated location in the next frame. A corresponding matching portion in a previously encoded frame is determined based on the estimated location of the portion in the next frame and the portion of the next frame of video data is encoded.

公开(公告)号：US11503310B2

公开(公告)日：2022-11-15

申请号：US16176826

申请日：2018-10-31

Applicant: ATI TECHNOLOGIES ULC ,  ADVANCED MICRO DEVICES, INC.

Inventor： Lei Zhang ,  David Glen ,  Kim A. Meinerth

IPC: H04N19/186 ,  H04N19/156 ,  H04N19/124 ,  G06T5/00 ,  G06T7/90 ,  H04N19/70

Abstract: A device includes an encoder, decoder, codec or combination thereof and inline hardware conversion units that are operative to convert stored image data into one of: an HDR/WCG format and an SDR/SCG format during the conversion process. Each of the inline hardware conversion units is operative to perform the conversion process independent of another read operation with the memory that stores the image data to be converted. In one example, an encoding unit is operative to perform a write operation with a memory to store the converted image data after completing the conversion process. In another example, a decoding unit is operative to perform a read operation with the memory to retrieve the image data from the memory before initiating the conversion process. In another example, an encoder/decoder unit is operative to perform at least one of: the read operation and the write operation.

公开(公告)号：US10432988B2

公开(公告)日：2019-10-01

申请号：US15130885

申请日：2016-04-15

Applicant: Advanced Micro Devices, Inc. ,  ATI Technologies ULC

Inventor： Lei Zhang ,  Gabor Sines ,  Khaled Mammou ,  David Glen ,  Layla A. Mah ,  Rajabali M. Koduri ,  Bruce Montag

IPC: G06F15/16 ,  H04N21/2343 ,  H04L29/06 ,  H04N21/2368 ,  H04N21/236 ,  H04N21/414 ,  H04N21/422 ,  H04N21/434 ,  H04N21/43 ,  H04N21/437

Abstract: Virtual Reality (VR) systems, apparatuses and methods of processing data are provided which include predicting, at a server, a user viewpoint of a next frame of video data based on received user feedback information sensed at a client, rendering a portion of the next frame using the prediction, encoding the portion, formatting the encoded portion into packets and transmitting the video data. At a client, the encoded and packetized A/V data is received and depacketized. The portion of video data and corresponding audio data is decoded and controlled to be displayed and aurally provided in synchronization. Latency may be minimized by utilizing handshaking between hardware components and/or software components such as a 3D server engine, one or more client processors, one or more client processors, a video encoder, a server NIC, a video decoder, a client NIC; and a 3D client engine.

公开(公告)号：US20210112289A1

公开(公告)日：2021-04-15

申请号：US17132304

申请日：2020-12-23

Applicant: Advanced Micro Devices, Inc. ,  ATI Technologies ULC

Inventor： Lei Zhang ,  Gabor Sines ,  Khaled Mammou ,  David Glen ,  Layla A. Mah ,  Rajabali M. Koduri ,  Bruce Montag

IPC: H04N21/2343 ,  H04L29/06 ,  H04N21/2368 ,  H04N21/434 ,  H04N21/414 ,  H04N21/422 ,  H04N21/43 ,  H04N21/437 ,  H04N21/236

Abstract: Virtual Reality (VR) processing devices and methods are provided for transmitting user feedback information comprising at least one of user position information and user orientation information, receiving encoded audio-video (A/V) data, which is generated based on the transmitted user feedback information, separating the A/V data into video data and audio data corresponding to a portion of a next frame of a sequence of frames of the video data to be displayed, decoding the portion of a next frame of the video data and the corresponding audio data, providing the audio data for aural presentation and controlling the portion of the next frame of the video data to be displayed in synchronization with the corresponding audio data.

公开(公告)号：US20190394503A1

公开(公告)日：2019-12-26

申请号：US16561982

申请日：2019-09-05

Applicant: Advanced Micro Devices, Inc. ,  ATI Technologies ULC

Inventor： Lei Zhang ,  Gabor Sines ,  Khaled Mammou ,  David Glen ,  Layla A. Mah ,  Rajabali M. Koduri ,  Bruce Montag

IPC: H04N21/2343 ,  H04L29/06 ,  H04N21/2368 ,  H04N21/236 ,  H04N21/414 ,  H04N21/422 ,  H04N21/434 ,  H04N21/43 ,  H04N21/437

Abstract: Virtual Reality (VR) processing devices and methods are provided for transmitting user feedback information comprising at least one of user position information and user orientation information, receiving encoded audio-video (A/V) data, which is generated based on the transmitted user feedback information, separating the A/V data into video data and audio data corresponding to a portion of a next frame of a sequence of frames of the video data to be displayed, decoding the portion of a next frame of the video data and the corresponding audio data, providing the audio data for aural presentation and controlling the portion of the next frame of the video data to be displayed in synchronization with the corresponding audio data.

公开(公告)号：US12120364B2

公开(公告)日：2024-10-15

申请号：US18094161

申请日：2023-01-06

Applicant: Advanced Micro Devices, Inc. ,  ATI Technologies ULC

Inventor： Lei Zhang ,  Gabor Sines ,  Khaled Mammou ,  David Glen ,  Layla A. Mah ,  Rajabali M. Koduri ,  Bruce Montag

IPC: G06F15/16 ,  H04L65/70 ,  H04L65/75 ,  H04L67/131 ,  H04L69/24 ,  H04N21/2343 ,  H04N21/236 ,  H04N21/2368 ,  H04N21/414 ,  H04N21/422 ,  H04N21/43 ,  H04N21/434 ,  H04N21/437

CPC classification number: H04N21/2343 ,  H04L65/70 ,  H04L65/762 ,  H04L67/131 ,  H04L69/24 ,  H04N21/23605 ,  H04N21/2368 ,  H04N21/41407 ,  H04N21/42202 ,  H04N21/43072 ,  H04N21/4341 ,  H04N21/4343 ,  H04N21/437

Abstract: A device and method for processing Virtual Reality (VR) data is disclosed. The method comprises transmitting feedback information from the device to a server, wherein the feedback information is captured in the device, receiving data from the server to be presented on the device based on the feedback information, wherein the data includes video data and audio data where the video data is a frame of video data in a sequence of frames and the audio data is the corresponding audio data of the frame, decoding the video data and corresponding audio data of the frame, and controlling the presentation of the video data and corresponding audio data on the device such that the video data is synchronized with the corresponding audio data.

公开(公告)号：US20230156250A1

公开(公告)日：2023-05-18

申请号：US18094161

申请日：2023-01-06

Applicant: Advanced Micro Devices, Inc. ,  ATI Technologies ULC

Inventor： Lei Zhang ,  Gabor Sines ,  Khaled Mammou ,  David Glen ,  Layla A. Mah ,  Rajabali M. Koduri ,  Bruce Montag

IPC: H04N21/2343 ,  H04N21/2368 ,  H04N21/236 ,  H04N21/414 ,  H04N21/422 ,  H04N21/434 ,  H04N21/437 ,  H04L69/24 ,  H04N21/43 ,  H04L65/70 ,  H04L65/75 ,  H04L67/131

CPC classification number: H04N21/2343 ,  H04N21/2368 ,  H04N21/23605 ,  H04N21/41407 ,  H04N21/42202 ,  H04N21/4341 ,  H04N21/437 ,  H04N21/4343 ,  H04L69/24 ,  H04N21/43072 ,  H04L65/70 ,  H04L65/762 ,  H04L67/131

Abstract: Virtual Reality (VR) processing devices and methods are provided for transmitting user feedback information comprising at least one of user position information and user orientation information, receiving encoded audio-video (AN) data, which is generated based on the transmitted user feedback information, separating the A/V data into video data and audio data corresponding to a portion of a next frame of a sequence of frames of the video data to be displayed, decoding the portion of a next frame of the video data and the corresponding audio data, providing the audio data for aural presentation and controlling the portion of the next frame of the video data to be displayed in synchronization with the corresponding audio data.

公开(公告)号：US11553222B2

公开(公告)日：2023-01-10

申请号：US17132304

申请日：2020-12-23

Applicant: Advanced Micro Devices, Inc. ,  ATI Technologies ULC

Inventor： Lei Zhang ,  Gabor Sines ,  Khaled Mammou ,  David Glen ,  Layla A. Mah ,  Rajabali M. Koduri ,  Bruce Montag

IPC: G06F15/16 ,  H04N21/2343 ,  H04N21/2368 ,  H04N21/236 ,  H04N21/414 ,  H04N21/422 ,  H04N21/434 ,  H04N21/437 ,  H04L69/24 ,  H04N21/43 ,  H04L65/70 ,  H04L65/75 ,  H04L67/131

Abstract: Virtual Reality (VR) processing devices and methods are provided for transmitting user feedback information comprising at least one of user position information and user orientation information, receiving encoded audio-video (A/V) data, which is generated based on the transmitted user feedback information, separating the A/V data into video data and audio data corresponding to a portion of a next frame of a sequence of frames of the video data to be displayed, decoding the portion of a next frame of the video data and the corresponding audio data, providing the audio data for aural presentation and controlling the portion of the next frame of the video data to be displayed in synchronization with the corresponding audio data.

公开(公告)号：US10341650B2

公开(公告)日：2019-07-02

申请号：US15130873

申请日：2016-04-15

Applicant: Advanced Micro Devices, Inc. ,  ATI Technologies ULC

Inventor： Khaled Mammou ,  Ihab Amer ,  Gabor Sines ,  Lei Zhang ,  Layla A. Mah ,  Guennadi Riguer ,  David Glen

IPC: H04N19/103 ,  H04N19/167 ,  H04N19/597 ,  H04N19/162 ,  H04N19/124 ,  G06K9/00 ,  H04N19/17

Abstract: Systems, methods and apparatuses of processing data of a VR system are disclosed that comprise receiving tracking information which includes at least one of user position information and eye gaze point information. One or more processors may be used to predict, based on the user tracking information, a user viewpoint of a next frame of a sequence of frames of video data to be displayed. Using the prediction, a portion of the next frame of video data to be displayed is rendered at an estimated location in the next frame. A corresponding matching portion in a previously encoded frame is determined based on the estimated location of the portion in the next frame and the portion of the next frame of video data is encoded.