公开(公告)号：US20240226731A1

公开(公告)日：2024-07-11

申请号：US18559200

申请日：2022-08-12

Applicant: GOOGLE LLC

Inventor： Danny Hong ,  Ramachandra Tahasildar ,  Alex Sukhanov

IPC: A63F13/355 ,  A63F13/358 ,  G06T9/00

CPC classification number: A63F13/355 ,  A63F13/358 ,  G06T9/00

Abstract: A multi-pass encoding operation using a shared reference frame is implemented to encode one or more gaming frames into a game stream. The multi-pass encoding operation includes producing a shared reference frame based upon a second-pass reference frame used by a second pass encoding of the multi-pass encoding operation. The encoding operation also includes performing a first encoding pass on a current frame using the shared reference frame. As a result of the first encoding pass, an estimated complexity for the current frame is determined. A second pass encoding is then performed on the current frame according to the second-pass reference frame and the estimated complexity, resulting in an encoded frame. This encoded frame is then transmitted as part of a stream to a client system.

公开(公告)号：US20230013997A1

公开(公告)日：2023-01-19

申请号：US17376423

申请日：2021-07-15

Applicant: GOOGLE LLC

Inventor： Danny Hong ,  Ramachandra Tahasildar ,  Alex Sukhanov

IPC: H04N19/194 ,  H04N19/124 ,  H04N19/154 ,  H04N19/14 ,  H04N19/172

Abstract: A two-pass encoding operation is implemented to encode one or more gaming frames into a game stream. The two-pass encoding operation includes a first encoding pass performed on a current frame. As a result of the first encoding pass, an estimated complexity for the current frame is determined. The resulting estimated complexity is then modulated according to a quality difference between reference frames used during the first pass encoding and a subsequent second pass encoding. Based on the modulated complexity, a quantization parameter is determined for the current frame that is then used to perform a second pass encoding on the current frame, resulting in an encoded frame. This encoded frame is then transmitted as part of a stream to a client system.

公开(公告)号：US20250142069A1

公开(公告)日：2025-05-01

申请号：US18683383

申请日：2021-09-03

Applicant: GOOGLE LLC

Inventor： Danny Hong ,  Yinqing Zhao ,  Ramachandra Tahasildar ,  In Suk Chong

IPC: H04N19/126 ,  A63F13/52 ,  H04N19/14 ,  H04N19/164 ,  H04N19/172

Abstract: A multi-try encoding operation is implemented to encode one or more game frames into a game stream. The multi-try encoding operation includes determining an initial quantization parameter for a current frame. From the determined initial quantization parameter, one or more alternative quantization parameters are derived. Multiple encoders then perform multiple encodings on the current frame based on the initial quantization parameter and the alternative quantization parameters, respectively, to produce a plurality of encoded frames. An applicable encoded frame is then selected from the plurality of encoded frames according to a streaming application. The applicable encoded frame is then transmitted as part of a game stream to a client system.

公开(公告)号：US20230396766A1

公开(公告)日：2023-12-07

申请号：US18033473

申请日：2020-11-25

Applicant: GOOGLE LLC

Inventor： Richard Xie ,  Ramachandra Tahasildar ,  Alex Sukhanov ,  Danny Hong ,  Beril Erkin

IPC: H04N19/124 ,  H04N19/172 ,  H04N19/463 ,  H04N19/42 ,  H04N19/132 ,  H04N19/136 ,  A63F13/355

CPC classification number: H04N19/124 ,  H04N19/172 ,  H04N19/463 ,  A63F13/355 ,  H04N19/132 ,  H04N19/136 ,  H04N19/42

Abstract: Techniques for encoding game content for real-time cloud-gaming, and more specifically to using an adaptive statistical model in a moving window of previous frames up to a current frame to adaptively compute a lower-bound of a quantization parameter (QP) that corresponds to a chosen peak signal to noise ratio (PSNR) target. The result of this PSNR-guided encoding is significantly reducing the size of encoded frames (i.e., undershooting a target bit rate when there are no subjective quality losses on those frames using their PSNR as the guidance). These reductions mitigate bandwidth issues and improve the overall user experience because less bits transferred results in faster network transmission and decoding, as well as less platform overhead.

公开(公告)号：US20240388728A1

公开(公告)日：2024-11-21

申请号：US18684430

申请日：2021-08-18

Applicant: GOOGLE LLC

Inventor： Richard Xie ,  Ramachandra Tahasildar ,  Danny Hong ,  Jani Huoponen

IPC: H04N19/70 ,  H04N19/30 ,  H04N19/63

Abstract: An encoding operation is implemented to encode one or more frames, for example, gaming frames into a gaming stream. The encoding operation includes decomposing a current frame into a base layer and an enhancement layer. The resulting base layer and enhancement layer are then each encoded to produce an encoded base layer and an encoded enhancement layer. The encoded enhancement layer is truncated, for example, according to a comparison of the sum of the size of the encoded base layer and encoded enhancement layer to a threshold value. In an example embodiment, a multiplexer combines the encoded base layer and truncated enhancement layer to produce the encoded frame. The encoded frame may then be transmitted as part of a stream to a client device.

公开(公告)号：US20240129468A1

公开(公告)日：2024-04-18

申请号：US18276580

申请日：2021-02-12

Applicant: GOOGLE LLC

Inventor： Danny Hong ,  Richard Xie ,  Ramachandra Tahasildar

IPC: H04N19/124 ,  H04N19/70

CPC classification number: H04N19/124 ,  H04N19/70

Abstract: Pre-encoding noise parameterization techniques mitigate or eliminate banding and other graphical artifacts in video frames for decoding and presentation by a client device. For one or more input video frames, a quantization parameter associated with the input video frames is identified. Noise synthesis parameters are determined based on the identified quantization parameter, and the input video frames are encoded for transmission. The encoded video frames are transmitted to the client device along with the determined noise synthesis parameters, for use by the client device in generating synthetic noise to add to resulting video frames decoded by the client device.

公开(公告)号：US20240009556A1

公开(公告)日：2024-01-11

申请号：US18217776

申请日：2023-07-03

Applicant: GOOGLE LLC

Inventor： Danny Hong ,  Sam John

IPC: A63F13/355

CPC classification number: A63F13/355 ,  A63F2300/538

Abstract: A cloud-based gaming server renders a set of game frames at a first frame rate for a current client gaming session. An encoder of the server then determines whether the first frame rate is lower than a second frame rate associated with the encoder. In response to the first frame rate being lower, the encoder is configured to generate skip frames, with each skip frame indicating that a game frame of the set of game frames is to be repeated. The encoder also encodes the set of game frames to produce a set of encoded game frames and inserts one or more skip frames between two or more encoded game frames of the set of encoded game frames to produce a game stream. The server then packetizes the game stream and transmits the packetized game stream to a client system associated with the current client system.

公开(公告)号：US20250080728A1

公开(公告)日：2025-03-06

申请号：US18241496

申请日：2023-09-01

Applicant: GOOGLE LLC

Inventor： Danny Hong ,  Zhuo Chen

IPC: H04N19/115 ,  G06T7/50 ,  H04N19/124

Abstract: A cloud-based extended reality (XR) system includes a server configured to encode a set of frames each associated with an XR scene to be displayed. To encode the set of frames, the server estimates a total number of encoded output bits for the set of frames based on a set of quantization parameters (QPs). The set of QPs includes a corresponding QP for each frame of the set of frames and one or more predetermined relationships between the corresponding QPs. The server then compares the estimated total number of encoded output bits to a target frame size threshold. Based on the estimated total number of encoded bits being outside the target frame size threshold, the server updates the set of QPs so as to maintain the predetermined relationships between the QPs.

公开(公告)号：US20240155160A1

公开(公告)日：2024-05-09

申请号：US18280551

申请日：2021-03-10

Applicant: GOOGLE LLC

Inventor： Richard Xie ,  Ramachandra Tahasildar ,  Danny Hong ,  Alex Sukhanov ,  Albert Julius Liu ,  Beril Erkin

IPC: H04N19/86 ,  A63F13/355 ,  H04N19/119 ,  H04N19/186

CPC classification number: H04N19/86 ,  A63F13/355 ,  H04N19/119 ,  H04N19/186 ,  A63F13/358

Abstract: Real-time pre-encoding dithering techniques mitigate or eliminate banding and other graphical artifacts in video frames prior to such video frames being encoded for transmission to and display by one or more client devices. For each of one or more input video frames, one or more random seeds and a frame identifier are received, and a dithering process is initiated for each of one or more pixels of the input video frame. The dithering process includes generating a YUV noise vector based on the random seeds and on the frame identifier, computing a YUV representation of the input pixel based on RGB color information for the input pixel, and generating a dithered output pixel by adding the generated YUV noise vector to the YUV representation of the input pixel.

公开(公告)号：US11902547B2

公开(公告)日：2024-02-13

申请号：US17376423

申请日：2021-07-15

Applicant: GOOGLE LLC

Inventor： Danny Hong ,  Ramachandra Tahasildar ,  Alex Sukhanov

IPC: H04N19/194 ,  H04N19/124 ,  H04N19/172 ,  H04N19/14 ,  H04N19/154

CPC classification number: H04N19/194 ,  H04N19/124 ,  H04N19/14 ,  H04N19/154 ,  H04N19/172

Abstract: A two-pass encoding operation is implemented to encode one or more gaming frames into a game stream. The two-pass encoding operation includes a first encoding pass performed on a current frame. As a result of the first encoding pass, an estimated complexity for the current frame is determined. The resulting estimated complexity is then modulated according to a quality difference between reference frames used during the first pass encoding and a subsequent second pass encoding. Based on the modulated complexity, a quantization parameter is determined for the current frame that is then used to perform a second pass encoding on the current frame, resulting in an encoded frame. This encoded frame is then transmitted as part of a stream to a client system.