PLOTTING BEHIND THE SCENES WITH LEARNABLE GAME ENGINES

    公开(公告)号:US20240307783A1

    公开(公告)日:2024-09-19

    申请号:US18121268

    申请日:2023-03-14

    申请人: Snap Inc.

    IPC分类号: A63F13/67 A63F13/57

    CPC分类号: A63F13/67 A63F13/57

    摘要: A framework trains game-engine-like neural models from annotated videos to generate a Learnable Game Engine (LGE) that maintains states of the scene, objects and agents in it, and enables rendering the environment from a controllable viewpoint. The LGE models the logic of the game and the rules of physics, making it possible for the user to play the game by specifying both high- and low-level action sequences. The LGE also unlocks a director's mode where the game is played by plotting behind the scenes, specifying high-level actions and goals for the agents using text-based instructions. To implement the director's mode, a trained diffusion-based animation model navigates the scene using high-level constraints, to enable play against an adversary, and to devise the strategy to win a point. To render the resulting state of the environment and its agents, a compositional neural radiance field (NeRF) representation is used in a synthesis model.

    REAL TIME REWIND PLAYBACK
    44.
    发明公开

    公开(公告)号:US20240305858A1

    公开(公告)日:2024-09-12

    申请号:US18118762

    申请日:2023-03-08

    申请人: Snap Inc.

    摘要: A media player providing real time rewind playback of a played media file having segments of frames. A last segment N of the played media file is cached and rendered on a device, such as a mobile device, then a previous segment N−1 is cached and rendered, and the process continues until there are no more segments of the played media file to cache and render. Only a segment of the played media file is cached at a time, rather than the whole media file, such that the played media file can be replayed on the fly.

    Saving ephemeral media to a conversation thread

    公开(公告)号:US12088544B2

    公开(公告)日:2024-09-10

    申请号:US17991539

    申请日:2022-11-21

    申请人: Snap Inc.

    摘要: Systems and methods herein save ephemeral media content to a conversation thread between two users who are bidirectional connections on a social media platform. The systems and methods receive, on a first device associated with a first user, media content item from a second device associated with a second user, display the received media content item on the first user device, and while causing display of the received media content item, receive a selection from the first user device. In response to receiving the selection, the systems and methods save the media content item to a conversation thread between the first user and the second user and display an indication that the media content item is saved within the conversation thread.