LOW LATENCY HAND-TRACKING IN AUGMENTED REALITY SYSTEMS

    公开(公告)号:US20240273843A1

    公开(公告)日:2024-08-15

    申请号:US18645277

    申请日:2024-04-24

    申请人: Snap Inc.

    IPC分类号: G06T19/00 G06T7/20 G06T15/00

    摘要: A method for reducing motion-to-photon latency for hand tracking is described. In one aspect, a method includes accessing a first frame from a camera of an Augmented Reality (AR) device, tracking a first image of a hand in the first frame, rendering virtual content based on the tracking of the first image of the hand in the first frame, accessing a second frame from the camera before the rendering of the virtual content is completed, the second frame immediately following the first frame, tracking, using the computer vision engine of the AR device, a second image of the hand in the second frame, generating an annotation based on tracking the second image of the hand in the second frame, forming an annotated virtual content based on the annotation and the virtual content, and displaying the annotated virtual content in a display of the AR device.

    Low latency hand-tracking in augmented reality systems

    公开(公告)号:US12002168B2

    公开(公告)日:2024-06-04

    申请号:US17844541

    申请日:2022-06-20

    申请人: Snap Inc.

    IPC分类号: G06T19/00 G06T7/20 G06T15/00

    摘要: A method for reducing motion-to-photon latency for hand tracking is described. In one aspect, a method includes accessing a first frame from a camera of an Augmented Reality (AR) device, tracking a first image of a hand in the first frame, rendering virtual content based on the tracking of the first image of the hand in the first frame, accessing a second frame from the camera before the rendering of the virtual content is completed, the second frame immediately following the first frame, tracking, using the computer vision engine of the AR device, a second image of the hand in the second frame, generating an annotation based on tracking the second image of the hand in the second frame, forming an annotated virtual content based on the annotation and the virtual content, and displaying the annotated virtual content in a display of the AR device.