公开(公告)号：US20140092209A1

公开(公告)日：2014-04-03

申请号：US13632210

申请日：2012-10-01

Applicant: NVIDIA CORPORATION

Inventor： Hassane S. Azar ,  Stefan Eckart ,  Dawid Pajak ,  Bryan Dudash ,  Swagat Mohapatra

IPC: H04N7/50 ,  H04N13/00 ,  H04N7/30

CPC classification number: G06T19/00 ,  H04N19/115 ,  H04N19/124 ,  H04N19/14 ,  H04N19/176 ,  H04N19/597

Abstract: A system and method are provided for improving video encoding using content information. A three-dimensional (3D) modeling system produces an encoded video stream. The system includes a content engine, a renderer, and a video encoder. The renderer receives 3D model information from the content engine relating and to produces corresponding two-dimensional (2D) images. The video encoder receives the 2D images and produce a corresponding encoded video stream. The video encoder receives content information from the content engine, transforms the content information into encoder control information, and controls the video encoder using the encoder control information.

Abstract translation: 提供一种用于使用内容信息来改进视频编码的系统和方法。 三维（3D）建模系统产生编码视频流。 该系统包括内容引擎，渲染器和视频编码器。 渲染器从相关的内容引擎接收3D模型信息并产生相应的二维（2D）图像。 视频编码器接收2D图像并产生相应的编码视频流。 视频编码器从内容引擎接收内容信息，将内容信息转换为编码器控制信息，并使用编码器控制信息来控制视频编码器。

公开(公告)号：US09483845B2

公开(公告)日：2016-11-01

申请号：US13871180

申请日：2013-04-26

Applicant: Nvidia Corporation

Inventor： Hassane S Azar ,  Dawid Pajak ,  Stefan Eckart ,  Swagat Mohapatra

IPC: G06T9/00 ,  H04N19/61 ,  H04N19/20 ,  H04N19/54

CPC classification number: G06T9/00 ,  G06T9/001 ,  H04N19/20 ,  H04N19/54 ,  H04N19/61

Abstract: A video frame compression system includes a rendering engine that provides a current video frame and current additional rendering information. Additionally, the video frame compression system includes a warping engine that generates a warped video frame, wherein the warped video frame is a transformation of a previous video frame that is based on the current additional rendering information. Further, the video frame compression system includes a video encoder that compresses the current video frame by using the warped video frame as a reference frame and separately compresses the current additional rendering information. Still further, the video frame compression system includes a packetizer that provides main and auxiliary data streams corresponding to the compressed current video frame and the compressed current additional rendering information, respectively. A video frame decompression system and methods of video frame compression and decompression are also provided.

Abstract translation: 视频帧压缩系统包括提供当前视频帧和当前附加渲染信息的渲染引擎。 此外，视频帧压缩系统包括产生翘曲视频帧的翘曲引擎，其中翘曲视频帧是基于当前附加渲染信息的先前视频帧的变换。 此外，视频帧压缩系统包括视频编码器，其通过使用扭曲的视频帧作为参考帧来压缩当前视频帧，并分别压缩当前的附加渲染信息。 此外，视频帧压缩系统包括分别化器，其分别提供与压缩的当前视频帧和压缩的当前附加渲染信息相对应的主和辅助数据流。 还提供了视频帧解压缩系统和视频帧压缩和解压缩的方法。

公开(公告)号：US09984504B2

公开(公告)日：2018-05-29

申请号：US13632210

申请日：2012-10-01

Applicant: Nvidia Corporation

Inventor： Hassane S. Azar ,  Stefan Eckart ,  Dawid Pajak ,  Bryan Dudash ,  Swagat Mohapatra

IPC: H04N13/00 ,  G06T19/00 ,  H04N19/597 ,  H04N19/176 ,  H04N19/115 ,  H04N19/124 ,  H04N19/14

CPC classification number: G06T19/00 ,  H04N19/115 ,  H04N19/124 ,  H04N19/14 ,  H04N19/176 ,  H04N19/597

Abstract: A system and method are provided for improving video encoding using content information. A three-dimensional (3D) modeling system produces an encoded video stream. The system includes a content engine, a renderer, and a video encoder. The renderer receives 3D model information from the content engine relating and to produces corresponding two-dimensional (2D) images. The video encoder receives the 2D images and produce a corresponding encoded video stream. The video encoder receives content information from the content engine, transforms the content information into encoder control information, and controls the video encoder using the encoder control information.

公开(公告)号：US20140321757A1

公开(公告)日：2014-10-30

申请号：US13871180

申请日：2013-04-26

Applicant: NVIDIA CORPORATION

Inventor： Hassane S Azar ,  Dawid Pajak ,  Stefan Eckart ,  Swagat Mohapatra

IPC: G06T9/00

CPC classification number: G06T9/00 ,  G06T9/001 ,  H04N19/20 ,  H04N19/54 ,  H04N19/61

Abstract: A video frame compression system includes a rendering engine that provides a current video frame and current additional rendering information. Additionally, the video frame compression system includes a warping engine that generates a warped video frame, wherein the warped video frame is a transformation of a previous video frame that is based on the current additional rendering information. Further, the video frame compression system includes a video encoder that compresses the current video frame by using the warped video frame as a reference frame and separately compresses the current additional rendering information. Still further, the video frame compression system includes a packetizer that provides main and auxiliary data streams corresponding to the compressed current video frame and the compressed current additional rendering information, respectively. A video frame decompression system and methods of video frame compression and decompression are also provided.

Abstract translation: 视频帧压缩系统包括提供当前视频帧和当前附加渲染信息的渲染引擎。 此外，视频帧压缩系统包括产生翘曲视频帧的翘曲引擎，其中翘曲视频帧是基于当前附加渲染信息的先前视频帧的变换。 此外，视频帧压缩系统包括视频编码器，其通过使用扭曲的视频帧作为参考帧来压缩当前视频帧，并分别压缩当前的附加渲染信息。 此外，视频帧压缩系统包括分别化器，其分别提供与压缩的当前视频帧和压缩的当前附加渲染信息相对应的主和辅助数据流。 还提供了视频帧解压缩系统和视频帧压缩和解压缩的方法。

公开(公告)号：US20140187331A1

公开(公告)日：2014-07-03

申请号：US13728296

申请日：2012-12-27

Applicant: NVIDIA CORPORATION

Inventor： Taekhyun Kim ,  Swagat Mohapatra ,  Mukta Gore ,  Alok Ahuja

IPC: A63F13/12 ,  H04N7/26

CPC classification number: A63F13/12 ,  A63F2300/538 ,  A63F2300/66

Abstract: A cloud gaming system includes a cloud gaming server that provides rendering for a video frame employed in cloud gaming. The cloud gaming system also includes a video frame latency reduction pipeline coupled to the cloud gaming server, having a slice generator that provides a set of separately-rendered video frame slices required for a video frame, a slice encoder that encodes each of the set of separately-rendered video frame slices into corresponding separately-encoded video frame slices of the video frame and a slice packetizer that packages each separately-encoded video frame slice into slice transmission packets. The cloud gaming system further includes a cloud network that transmits the slice transmission packets and a cloud gaming client that processes the slice transmission packets to construct the video frame. A video frame latency reduction method is also provided.

Abstract translation: 云游戏系统包括云游戏服务器，为云端游戏中使用的视频帧提供渲染。 云游戏系统还包括耦合到云游戏服务器的视频帧延迟减少流水线，具有提供视频帧所需的一组单独呈现的视频帧片段的片生成器，编码每一个 单独渲染的视频帧片段转换成视频帧的相应的单独编码的视频帧片段以及将每个单独编码的视频片段片段封装成片传输包的片包分组器。 云游戏系统还包括传输切片传输分组的云网络和处理切片传输分组以构建视频帧的云游戏客户端。 还提供了视频帧延迟降低方法。