SEMANTIC-GUIDED TRANSFORMER FOR OBJECT RECOGNITION AND RADIANCE FIELD-BASED NOVEL VIEW

    公开(公告)号:US20240029455A1

    公开(公告)日:2024-01-25

    申请号:US18475353

    申请日:2023-09-27

    CPC classification number: G06V20/64 G06V20/70 G06T15/20 G06V10/56 G06V10/774

    Abstract: Systems, apparatuses and methods may provide for technology that encodes multi-view visual data into latent features via an aggregator encoder, decodes the latent features into one or more novel target views different from views of the multi-view visual data via a rendering decoder, and decodes the latent features into an object label via a label decoder. The operation to decode the latent features via the rendering decoder and to decode the latent features via the label decoder occur at least partially at the same time. The operation to encode, via the aggregator encoder, the multi-view visual data into the latent features further includes operations to: perform, via the aggregator encoder, semantic object recognition operations based on radiance field view synthesis operations, and perform, via the aggregator encoder, radiance field view synthesis operations based on semantic object recognition operations.

    UV SPACE RENDERING AND AI PROCESSING
    7.
    发明公开

    公开(公告)号:US20240312113A1

    公开(公告)日:2024-09-19

    申请号:US18607243

    申请日:2024-03-15

    CPC classification number: G06T15/04 G06T3/4053 G06T7/20 G06T15/506

    Abstract: Described herein are techniques to render frame data in UV space and process the UV space data via a machine learning model. One embodiment provides an apparatus including a parallel processor having first circuitry configured to execute operations associated with a three-dimensional (3D) application programming interface (API) to render scene data for a frame in a UV coordinate space, second circuitry configured to execute instructions to perform a matrix multiply accumulate operation associated with a machine learning model that is trained to process the scene data in the UV coordinate space to generate processed scene data in the UV coordinate space, and third circuitry to rasterize the processed scene data in the UV coordinate space into a screen space representation of the scene data.

    INFERRED SHADING MECHANISM
    9.
    发明申请

    公开(公告)号:US20220101597A1

    公开(公告)日:2022-03-31

    申请号:US17032348

    申请日:2020-09-25

    Abstract: An apparatus to facilitate inferred object shading is disclosed. The apparatus comprises one or more processors to receive rasterized pixel data and hierarchical data associated with one or more objects and perform an inferred shading operation on the rasterized pixel data, including using one or more trained neural networks to perform texture and lighting on the rasterized pixel data to generate a pixel output, wherein the one or more trained neural networks uses the hierarchical data to learn a three-dimensional (3D) geometry, latent space and representation of the one or more objects.

Patent Agency Ranking