TRACKING ALGORITHM FOR CONTINUOUS AR EXPERIENCES

    公开(公告)号:US20230359286A1

    公开(公告)日:2023-11-09

    申请号:US18312448

    申请日:2023-05-04

    Applicant: Google LLC

    CPC classification number: G06F3/0346 G06T7/70 G06T2207/20084

    Abstract: A tracking system and associated algorithms are disclosed that can provide a user with a continuous, reset-free augmented reality (AR) experience. When the user wears an AR headset equipped with a camera and an inertial measurement unit (IMU), motion sensor data from the IMU can be combined with image data from the camera to create a device pose, representing a position and an orientation of the headset relative to its environment. In some implementations, when a reset occurs, a six-degrees-of-freedom (6DoF) algorithm can be configured to support the pose until a re-initialization is completed. In some implementations, a neural network can be used to correct for IMU integration drifts in the 6DoF algorithm. In some implementations, the IMU-based 6DoF uses a neural network that exploits the device's past motion to infer its future motion.

    Compute amortization heuristics for lighting estimation for augmented reality

    公开(公告)号:US11288844B2

    公开(公告)日:2022-03-29

    申请号:US15733376

    申请日:2019-10-16

    Applicant: Google LLC

    Abstract: Systems, methods, and computer program products are described that implement obtaining, at an electronic computing device and for at least one image of a scene rendered in an Augmented Reality (AR) environment, a scene lighting estimation captured at a first time period. The scene lighting estimation may include at least a first image measurement associated with the scene. The implementations may include determining, at the electronic computing device, a second image measurement associated with the scene at a second time period, determining a function of the first image measurement and the second image measurement. Based on the determined function, the implementations may also include triggering calculation of a partial lighting estimation update or triggering calculation of a full lighting estimation update and rendering, on a screen of the electronic computing device and for the scene, the scene using the partial lighting estimation update or the full lighting estimation update.

    DECREASING SIZE OF USER INTERFACE ELEMENT IN DISPLAY OF HEAD-MOUNTED DEVICE

    公开(公告)号:US20240272433A1

    公开(公告)日:2024-08-15

    申请号:US18168770

    申请日:2023-02-14

    Applicant: GOOGLE LLC

    CPC classification number: G02B27/0172 G02B27/0179 G02B2027/0178

    Abstract: A head-mounted device may present a first user interface element and a second user interface element within a user interface that is included in a display of the head-mounted device. The head-mounted device may, in response to movement of the head-mounted device, move the first user interface element and the second user interface element within the display, the movement of the first user interface element decreasing a boundary distance below a threshold distance, the boundary distance being based on a distance between the first user interface element and a boundary associated with the user interface. The head-mounted device may decrease a size of the first user interface element while the boundary distance is decreasing and is below the threshold distance.

Patent Agency Ranking