Method and system for interactive imitation learning in video games

    公开(公告)号:US11900233B2

    公开(公告)日:2024-02-13

    申请号:US17826050

    申请日:2022-05-26

    申请人: Unity IPR ApS

    摘要: In example embodiments, a method of interactive imitation learning method is disclosed. An input is received from an input device. The input includes data describing a first set of example actions defining a behavior for a virtual character. Inverse reinforcement learning is used to estimate a reward function for the set of example actions. The reward function and the set of example actions is used as input to a reinforcement learning model to train a machine learning agent to mimic the behavior in a training environment. Based on a measure of failure of the training of the machine learning agent reaching a threshold, the training of the machine learning agent is paused to request a second set of example actions from the input device. The second set of example actions is used in addition to the first set of example actions to estimate a new reward function.

    Method and system for populating a digital environment using a semantic map

    公开(公告)号:US11562517B2

    公开(公告)日:2023-01-24

    申请号:US17236954

    申请日:2021-04-21

    申请人: Unity IPR ApS

    IPC分类号: G06T11/60 G06T7/11 A63F13/57

    摘要: A method of populating a digital environment with digital content is disclosed. Environment data describing the digital environment is accessed. Populator data describing a populator digital object is accessed. The populator data includes semantic data describing the populator digital object. The populator digital object is placed within the digital environment. A semantic map representation of the populator digital object is generated. The semantic map representation is divided into a plurality of cells. A target cell of the plurality of cells is selected as a placeholder in the digital environment for a digital object that is optionally subsequently instantiated. The selecting of the target cell is based on an analysis of the environment data, the populator data, and the semantic map representation. Placeholder data is recorded in the semantic map representation. The placeholder data includes properties corresponding to the digital object that is optionally subsequently instantiated.

    Method and system for aligning a digital model of a structure with a video stream

    公开(公告)号:US11380073B2

    公开(公告)日:2022-07-05

    申请号:US17166598

    申请日:2021-02-03

    申请人: Unity IPR ApS

    IPC分类号: G06T19/00 G06T7/73 G06T17/00

    摘要: A method of aligning a digital model of a structure with a displayed portion of the structure within a video stream is disclosed. An approximate position of the camera device in the digital model is determined. A position and an orientation are determined for a plurality of digital surfaces within the digital model visible from the approximate position of the camera device. A position and an orientation of a plurality of object surfaces visible in a video stream are determined. A 3D translation, a 3D scale, and a 3D rotation that maximize an alignment of the position and orientation of the plurality of digital surfaces with the position and orientation of the plurality of object surfaces are determined. The 3D translation, the 3D scale, and the 3D rotation are applied to the digital model and the digital model is displayed contemporaneously with a display of the video stream.

    System and method for creating personalized game experiences

    公开(公告)号:US11351460B2

    公开(公告)日:2022-06-07

    申请号:US17025837

    申请日:2020-09-18

    申请人: Unity IPR ApS

    IPC分类号: A63F13/67

    摘要: A method for optimizing a computer-implemented game for a target metric is disclosed. Based on a detecting that an optimization point has been reached during a runtime of the computer game, user data, game state data, and personalized gaming experience (PGE) question data is communicated to a PGE server. The PGE question data is linked to the optimization point. An answer corresponding to the PGE question data is received from the PGE server. The answer is selected from a plurality of answers linked to the optimization point based on an application of a machine-learned model to the user data, game state data, and PGE question data. The received answer is implemented within the computer-implemented game.

    SYSTEM AND METHOD FOR GENERATING CHARACTER POSES USING DEEP LEARNING

    公开(公告)号:US20220076472A1

    公开(公告)日:2022-03-10

    申请号:US17326211

    申请日:2021-05-20

    申请人: Unity IPR ApS

    IPC分类号: G06T13/40 G06N20/00 G06T7/70

    摘要: A method of generating or modifying poses in an animation of a character are disclosed. Variable numbers and types of supplied inputs are combined into a single input. The variable numbers and types of supplied inputs correspond to one or more effector constraints for one or more joints of the character. The single input is transformed into a pose embedding. The pose embedding includes a machine-learned representation of the single input. The pose embedding is expanded into a pose representation output. The pose representation output includes local rotation data and global position data for the one or more joints of the character.

    Method and system for synchronizing a plurality of augmented reality devices to a virtual reality device

    公开(公告)号:US11132842B2

    公开(公告)日:2021-09-28

    申请号:US16231064

    申请日:2018-12-21

    申请人: Unity IPR ApS

    摘要: A method of synchronizing digital content between a first mobile device and a second mobile device is disclosed. Device position and orientation data is received at a first application executing in an operating system of the first mobile device. Sensor data is used to determine at least two 3D points associated with a physical location of the second mobile device. At least two 3D points are used to determine an offset for the position, orientation and scale of the first mobile device relative to the second mobile device. The offset and digital content data captured by the first mobile device are shared over a network with a second application executing in an operating system of the second mobile device. The second mobile device uses the offset to display the digital content captured by the first mobile device together with digital content data captured by the second mobile device.