GRAPHICS PROCESSING UNIT (GPU) COMMAND STREAMING

    公开(公告)号:US20240342595A1

    公开(公告)日:2024-10-17

    申请号:US18615289

    申请日:2024-03-25

    申请人: Netflix, Inc.

    发明人: Gregoire Pean

    IPC分类号: A63F13/355 G06T1/20 G06T15/80

    CPC分类号: A63F13/355 G06T1/20 G06T15/80

    摘要: The disclosed computer-implemented method includes accessing media frame generation input events produced as part of a multimedia application on a media server, selecting at least one media frame that is to be rendered according to the media frame generation input events, determining graphics processing capabilities of a client device on which the selected media frame is to be rendered, and generating a render command for the selected media frame based on the determined graphics processing capabilities of the client device. The render command includes contextual graphics information and graphics processing unit (GPU) pipeline information for use in rendering the selected media frame on the client device. The method also includes transmitting the generated render command to the client device to initiate rendering of the selected media frame using the contextual graphics information and the GPU pipeline information. Various other methods, systems, and computer-readable media are also disclosed.

    GRAPHICS PROCESSING SYSTEM AND METHOD OF RENDERING

    公开(公告)号:US20240193868A1

    公开(公告)日:2024-06-13

    申请号:US18388562

    申请日:2023-11-10

    发明人: Enrique de Lucas

    IPC分类号: G06T17/20 G06T15/04 G06T15/80

    CPC分类号: G06T17/20 G06T15/04 G06T15/80

    摘要: A method of rendering a frame showing a scene formed by primitives in a tile-based graphics processing system includes a geometry processing phase tiling the primitives in the scene, to determine which primitives at least partially overlap which tiles of the frame to be rendered. A rendering phase obtains a fragment density map defining one or more texels, each texel corresponding to an area of the frame to be rendered and having an associated fragment size, wherein for each of the texels, the texel's height is an integer multiple of a native tile height used in the tile-based graphics processing system and the texel's width is an integer multiple of a native tile width used in the tile-based graphics processing system. The rendering phase also determines from the fragment density map a fragment size to be used to render the tile, performing sampling using the determined fragment size and performing fragment shading using the determined fragment size.

    Relighting images and video using learned lighting and geometry

    公开(公告)号:US11948245B2

    公开(公告)日:2024-04-02

    申请号:US17455167

    申请日:2021-11-16

    申请人: Apple Inc.

    IPC分类号: G06T15/50 G06N3/08 G06T15/80

    CPC分类号: G06T15/506 G06N3/08 G06T15/80

    摘要: Novel machine learning (ML) models are introduced for image reconstruction training and inference workflows, which are able to estimate intrinsic components of single view images, including albedo, normal, and lighting components. According to some embodiments, such models may be trained on a mix of real and synthetic image datasets. For training on real datasets, both reconstruction and cross-relighting consistency terms may be imposed. The use of a cross-relighting consistency term allows for the use of multiple images of the same scene—although lit under different lighting conditions—to be used during training. At inference time, the model is able to operate on single or multiple images. According to other embodiments, adversarial training (e.g., in the form of a generative adversarial network (GAN)) may optionally be incorporated into the training workflow, e.g., in order to better refine the re-rendered images from the individual lighting and geometric components estimated by the model.