Augmented reality systems and methods utilizing reflections

    公开(公告)号:US10430985B2

    公开(公告)日:2019-10-01

    申请号:US15409430

    申请日:2017-01-18

    Abstract: A display system comprises a wearable display device for displaying augmented reality content. The display device comprises a display area comprising light redirecting features that are configured to direct light to a user. The display area is at least partially transparent and is configured to provide a view of an ambient environment through the display area. The display device is configured to determine that a reflection of the user is within the user's field of view through the display area. After making this determination, augmented reality content is displayed in the display area with the augmented reality content augmenting the user's view of the reflection. In some embodiments, the augmented reality content may overlie on the user's view of the reflection, thereby allowing all or portions of the reflection to appear to be modified to provide a realistic view of the user with various modifications made to their appearance.

    Eyelid shape estimation
    172.
    发明授权

    公开(公告)号:US10282611B2

    公开(公告)日:2019-05-07

    申请号:US16146228

    申请日:2018-09-28

    Abstract: Systems and methods for eyelid shape estimation are disclosed. In one aspect, after receiving an eye image of an eye (e.g., from an image capture device), an eye-box is generated over an iris of the eye in the eye image. A plurality of radial lines can be generated from approximately the center of the eye-box to an upper edge or a lower edge of the eye box. Candidate points can be determined to have local maximum derivatives along the plurality of radial lines. From the candidate points, an eyelid shape curve (e.g., for an upper eyelid or a lower eyelid) can be determined by fitting a curve (e.g., a parabola or a polynomial) to the candidate points or a subset of the candidate points.

    PERSONALIZED NEURAL NETWORK FOR EYE TRACKING
    173.
    发明申请

    公开(公告)号:US20190087973A1

    公开(公告)日:2019-03-21

    申请号:US16134600

    申请日:2018-09-18

    Abstract: Disclosed herein is a wearable display system for capturing retraining eye images of an eye of a user for retraining a neural network for eye tracking. The system captures retraining eye images using an image capture device when user interface (UI) events occur with respect to UI devices displayed at display locations of a display. The system can generate a retraining set comprising the retraining eye images and eye poses of the eye of the user in the retraining eye images (e.g., related to the display locations of the UI devices) and obtain a retrained neural network that is retrained using the retraining set.

    EYELID SHAPE ESTIMATION USING EYE POSE MEASUREMENT

    公开(公告)号:US20190087634A1

    公开(公告)日:2019-03-21

    申请号:US16179541

    申请日:2018-11-02

    Inventor: Adrian Kaehler

    Abstract: Systems and methods for eyelid shape estimation are disclosed. In one aspect, after receiving an eye image of an eye (e.g., from an image capture device), an eye pose of the eye in the eye image is determined. From the eye pose, an eyelid shape (of an upper eyelid or a lower eyelid) can be estimated using an eyelid shape mapping model. The eyelid shape mapping model relates the eye pose and the eyelid shape. In another aspect, the eyelid shape mapping model is learned (e.g., using a neural network).

    SECURE EXCHANGE OF CRYPTOGRAPHICALLY SIGNED RECORDS

    公开(公告)号:US20180034642A1

    公开(公告)日:2018-02-01

    申请号:US15661990

    申请日:2017-07-27

    Inventor: Adrian Kaehler

    Abstract: Systems and methods for securely exchanging cryptographically signed records are disclosed. In one aspect, after receiving a content request, a sender device can send a record to a receiver device (e.g., an agent device) making the request. The record can be sent via a short range link in a decentralized (e.g., peer-to-peer) manner while the devices may not be in communication with a centralized processing platform. The record can comprise a sender signature created using the sender device's private key. The receiver device can verify the authenticity of the sender signature using the sender device's public key. After adding a cryptography-based receiver signature, the receiver device can redeem the record with the platform. Upon successful verification of the record, the platform can perform as instructed by a content of the record (e.g., modifying or updating a user account).

    HEAD MOUNTED DISPLAY SYSTEM CONFIGURED TO EXCHANGE BIOMETRIC INFORMATION

    公开(公告)号:US20170278122A1

    公开(公告)日:2017-09-28

    申请号:US15462426

    申请日:2017-03-17

    Inventor: Adrian Kaehler

    Abstract: Head mounted display systems configured to facilitate the exchange of biometric information between the head mounted display system and another computing device are disclosed. The head mounted display system can comprise a virtual or augmented reality device. After displaying a consent request regarding biometric information with the head mounted display system, a response to the consent request that includes a consent indication regarding an aspect of the biometric information can be determined. After obtaining biometric information from a wearer utilizing e.g., a camera of the head mounted display, and processing the biometric information, a biometric information processing result can be generated. The result can be communicated from the head mounted display system to another computing device.

Patent Agency Ranking