-
公开(公告)号:US12120364B2
公开(公告)日:2024-10-15
申请号:US18094161
申请日:2023-01-06
发明人: Lei Zhang , Gabor Sines , Khaled Mammou , David Glen , Layla A. Mah , Rajabali M. Koduri , Bruce Montag
IPC分类号: G06F15/16 , H04L65/70 , H04L65/75 , H04L67/131 , H04L69/24 , H04N21/2343 , H04N21/236 , H04N21/2368 , H04N21/414 , H04N21/422 , H04N21/43 , H04N21/434 , H04N21/437
CPC分类号: H04N21/2343 , H04L65/70 , H04L65/762 , H04L67/131 , H04L69/24 , H04N21/23605 , H04N21/2368 , H04N21/41407 , H04N21/42202 , H04N21/43072 , H04N21/4341 , H04N21/4343 , H04N21/437
摘要: A device and method for processing Virtual Reality (VR) data is disclosed. The method comprises transmitting feedback information from the device to a server, wherein the feedback information is captured in the device, receiving data from the server to be presented on the device based on the feedback information, wherein the data includes video data and audio data where the video data is a frame of video data in a sequence of frames and the audio data is the corresponding audio data of the frame, decoding the video data and corresponding audio data of the frame, and controlling the presentation of the video data and corresponding audio data on the device such that the video data is synchronized with the corresponding audio data.
-
公开(公告)号:US20230156250A1
公开(公告)日:2023-05-18
申请号:US18094161
申请日:2023-01-06
发明人: Lei Zhang , Gabor Sines , Khaled Mammou , David Glen , Layla A. Mah , Rajabali M. Koduri , Bruce Montag
IPC分类号: H04N21/2343 , H04N21/2368 , H04N21/236 , H04N21/414 , H04N21/422 , H04N21/434 , H04N21/437 , H04L69/24 , H04N21/43 , H04L65/70 , H04L65/75 , H04L67/131
CPC分类号: H04N21/2343 , H04N21/2368 , H04N21/23605 , H04N21/41407 , H04N21/42202 , H04N21/4341 , H04N21/437 , H04N21/4343 , H04L69/24 , H04N21/43072 , H04L65/70 , H04L65/762 , H04L67/131
摘要: Virtual Reality (VR) processing devices and methods are provided for transmitting user feedback information comprising at least one of user position information and user orientation information, receiving encoded audio-video (AN) data, which is generated based on the transmitted user feedback information, separating the A/V data into video data and audio data corresponding to a portion of a next frame of a sequence of frames of the video data to be displayed, decoding the portion of a next frame of the video data and the corresponding audio data, providing the audio data for aural presentation and controlling the portion of the next frame of the video data to be displayed in synchronization with the corresponding audio data.
-
公开(公告)号:US10432988B2
公开(公告)日:2019-10-01
申请号:US15130885
申请日:2016-04-15
发明人: Lei Zhang , Gabor Sines , Khaled Mammou , David Glen , Layla A. Mah , Rajabali M. Koduri , Bruce Montag
IPC分类号: G06F15/16 , H04N21/2343 , H04L29/06 , H04N21/2368 , H04N21/236 , H04N21/414 , H04N21/422 , H04N21/434 , H04N21/43 , H04N21/437
摘要: Virtual Reality (VR) systems, apparatuses and methods of processing data are provided which include predicting, at a server, a user viewpoint of a next frame of video data based on received user feedback information sensed at a client, rendering a portion of the next frame using the prediction, encoding the portion, formatting the encoded portion into packets and transmitting the video data. At a client, the encoded and packetized A/V data is received and depacketized. The portion of video data and corresponding audio data is decoded and controlled to be displayed and aurally provided in synchronization. Latency may be minimized by utilizing handshaking between hardware components and/or software components such as a 3D server engine, one or more client processors, one or more client processors, a video encoder, a server NIC, a video decoder, a client NIC; and a 3D client engine.
-
公开(公告)号:US20230403415A1
公开(公告)日:2023-12-14
申请号:US17838552
申请日:2022-06-13
发明人: Ihab Amer , Gabor Sines , Haibo Liu , Khaled Mammou , Arun Sundaresan Iyer
IPC分类号: H04N21/2343 , H04N21/4402 , H04N21/442
CPC分类号: H04N21/2343 , H04N21/4402 , H04N21/44209
摘要: Adaptive decoder-drive encoder reconfiguration techniques are described. In one example, techniques include detecting an operational condition at a consumer using a sensor, the consumer receiving a communication of digital content from an encoder; generating an adaptation instruction by the decoder based on the detecting; transmitting the adaptation instruction by the decoder for receipt by the encoder; and receiving an adapted communication of the digital content generated by the encoder, the adapted communication caused by reconfiguration of the encoder based on the adaptation instruction received from the decoder.
-
公开(公告)号:US20210112289A1
公开(公告)日:2021-04-15
申请号:US17132304
申请日:2020-12-23
发明人: Lei Zhang , Gabor Sines , Khaled Mammou , David Glen , Layla A. Mah , Rajabali M. Koduri , Bruce Montag
IPC分类号: H04N21/2343 , H04L29/06 , H04N21/2368 , H04N21/434 , H04N21/414 , H04N21/422 , H04N21/43 , H04N21/437 , H04N21/236
摘要: Virtual Reality (VR) processing devices and methods are provided for transmitting user feedback information comprising at least one of user position information and user orientation information, receiving encoded audio-video (A/V) data, which is generated based on the transmitted user feedback information, separating the A/V data into video data and audio data corresponding to a portion of a next frame of a sequence of frames of the video data to be displayed, decoding the portion of a next frame of the video data and the corresponding audio data, providing the audio data for aural presentation and controlling the portion of the next frame of the video data to be displayed in synchronization with the corresponding audio data.
-
公开(公告)号:US20190394503A1
公开(公告)日:2019-12-26
申请号:US16561982
申请日:2019-09-05
发明人: Lei Zhang , Gabor Sines , Khaled Mammou , David Glen , Layla A. Mah , Rajabali M. Koduri , Bruce Montag
IPC分类号: H04N21/2343 , H04L29/06 , H04N21/2368 , H04N21/236 , H04N21/414 , H04N21/422 , H04N21/434 , H04N21/43 , H04N21/437
摘要: Virtual Reality (VR) processing devices and methods are provided for transmitting user feedback information comprising at least one of user position information and user orientation information, receiving encoded audio-video (A/V) data, which is generated based on the transmitted user feedback information, separating the A/V data into video data and audio data corresponding to a portion of a next frame of a sequence of frames of the video data to be displayed, decoding the portion of a next frame of the video data and the corresponding audio data, providing the audio data for aural presentation and controlling the portion of the next frame of the video data to be displayed in synchronization with the corresponding audio data.
-
公开(公告)号:US10097835B2
公开(公告)日:2018-10-09
申请号:US14638503
申请日:2015-03-04
IPC分类号: H04N19/136 , H04N19/177 , H04N19/50 , H04N19/147 , H04N19/114 , H04N19/19
摘要: A method of video encoding is disclosed which is content adaptive. The encoding method is automatically adjusted to optimize the encoding, the adjusting depending on the content of the pictures being encoded. A system for implementing the method and a non-transitory computer-readable storage medium for storing instructions of the method are also disclosed.
-
公开(公告)号:US11553222B2
公开(公告)日:2023-01-10
申请号:US17132304
申请日:2020-12-23
发明人: Lei Zhang , Gabor Sines , Khaled Mammou , David Glen , Layla A. Mah , Rajabali M. Koduri , Bruce Montag
IPC分类号: G06F15/16 , H04N21/2343 , H04N21/2368 , H04N21/236 , H04N21/414 , H04N21/422 , H04N21/434 , H04N21/437 , H04L69/24 , H04N21/43 , H04L65/70 , H04L65/75 , H04L67/131
摘要: Virtual Reality (VR) processing devices and methods are provided for transmitting user feedback information comprising at least one of user position information and user orientation information, receiving encoded audio-video (A/V) data, which is generated based on the transmitted user feedback information, separating the A/V data into video data and audio data corresponding to a portion of a next frame of a sequence of frames of the video data to be displayed, decoding the portion of a next frame of the video data and the corresponding audio data, providing the audio data for aural presentation and controlling the portion of the next frame of the video data to be displayed in synchronization with the corresponding audio data.
-
9.
公开(公告)号:US10805643B2
公开(公告)日:2020-10-13
申请号:US15085562
申请日:2016-03-30
发明人: Ihab Amer , Gabor Sines , Khaled Mammou , Haibo Liu , Arun Sundaresan Iyer
IPC分类号: G06F1/32 , H04N19/895 , H04N19/66 , H04N19/70
摘要: Various codecs and methods of using the same are disclosed. In one aspect, a method of processing video data is provided that includes encoding or decoding the video data with a codec in aggressive deployment and correcting one or more errors in the encoding or decoding wherein the error correction includes re-encoding or re-decoding the video data in a non-aggressive deployment or generating a skip picture.
-
公开(公告)号:US20190278083A1
公开(公告)日:2019-09-12
申请号:US16426898
申请日:2019-05-30
发明人: Khaled Mammou , Layla A. Mah
摘要: Described is a method and system to efficiently compress and stream texture-space rendered content that enables low latency wireless virtual reality applications. In particular, camera motion, object motion/deformation, and shading information are decoupled and each type of information is then compressed as needed and streamed separately, while taking into account its tolerance to delays.
-
-
-
-
-
-
-
-
-