Late warping to minimize latency of moving objects

    公开(公告)号:US12067693B2

    公开(公告)日:2024-08-20

    申请号:US17518828

    申请日:2021-11-04

    申请人: Snap Inc.

    摘要: A method for minimizing latency of moving objects in an augmented reality (AR) display device is described. In one aspect, the method includes determining an initial pose of a visual tracking device, identifying an initial location of an object in an image that is generated by an optical sensor of the visual tracking device, the image corresponding to the initial pose of the visual tracking device, rendering virtual content based on the initial pose and the initial location of the object, retrieving an updated pose of the visual tracking device, tracking an updated location of the object in an updated image that corresponds to the updated pose, and applying a time warp transformation to the rendered virtual content based on the updated pose and the updated location of the object to generate transformed virtual content.

    WRITING SURFACE BOUNDARY MARKERS FOR COMPUTER VISION

    公开(公告)号:US20240249378A1

    公开(公告)日:2024-07-25

    申请号:US18426228

    申请日:2024-01-29

    摘要: A system for capturing, organizing, and storing handwritten notes includes a plurality of boundary markers. The boundary markers are configured to be positioned on a writing surface. The system also includes a tangible non-transitory computer readable medium encoded with instructions which, when run on a camera-equipped computing device, causes the camera-equipped computing device to execute processes. The processes include capturing an image of the writing surface with the markers thereon. The processes also include detecting the boundary markers in the captured image. Additionally, the processes include identifying a virtual boundary in the captured image based on the positions of the boundary markers. The processes then unwarp a portion of the captured image within the virtual boundary to produce an unwarped image.

    Filter independent L1 mapping of convolution data into general purpose register

    公开(公告)号:US12026801B2

    公开(公告)日:2024-07-02

    申请号:US17326913

    申请日:2021-05-21

    发明人: Zhou Hong Yufei Zhang

    摘要: The disclosed technology relates to graphics processing units (GPU), In one aspect, a GPU includes a general purpose register (GPR) including registers, an arithmetic logic unit (ALU) reading pixels of an image independently of a shared memory, and a level 1 (L1) cache storing pixels to implement a pixel mapping that maps the pixels read from the L1 cache into the registers of the GPR. The pixel mapping includes separating pixels of an image into three regions, with each region including a set of pixels. A first and second set of the pixels are loaded into registers corresponding to two of the three regions horizontally, and a third set of the pixels are loaded into registers corresponding to the third of the three regions vertically. Each of the registers in the first, second, and third registers are loaded as a contiguous ordered number of registers in the GPR.

    Warped Perspective Correction
    9.
    发明公开

    公开(公告)号:US20240202866A1

    公开(公告)日:2024-06-20

    申请号:US18286522

    申请日:2022-03-29

    申请人: Apple Inc.

    IPC分类号: G06T3/18 G02B27/01 G06T7/55

    CPC分类号: G06T3/18 G02B27/017 G06T7/55

    摘要: In one implementation, a method of performing perspective correction of an image is performed by a device including an image sensor, a display, one or more processors, and non-transitory memory. The method includes capturing, using the image sensor, an image of a physical environment. The method includes obtaining a plurality of initial depths respectively associated with a plurality of pixels of the image of the physical environment. The method includes generating a depth map for the image of the physical environment based on the plurality of initial depths and a respective plurality of confidences of the plurality of initial depths. The method includes transforming, using the one or more processors, the image of the physical environment based on the depth map and a difference between a perspective of the image sensor and a perspective of a user. The method includes displaying, on the display, the transformed image.