-
公开(公告)号:US20180157398A1
公开(公告)日:2018-06-07
申请号:US15829249
申请日:2017-12-01
Applicant: Magic Leap, Inc.
Inventor: Adrian Kaehler , John Adam Croston
IPC: G06F3/0481 , G06T19/00 , G06F3/01 , G06K9/46 , G06N3/02
Abstract: A wearable display system can automatically recognize a physical remote or a device that the remote serves using computer vision techniques. The wearable system can generate a virtual remote with a virtual control panel viewable and interactable by user of the wearable system. The virtual remote can emulate the functionality of the physical remote. The user can select a virtual remote for interaction, for example, by looking or pointing at the parent device or its remote control, or by selecting from a menu of known devices. The virtual remote may include a virtual button, which is associated with a volume in the physical space. The wearable system can detect that a virtual button is actuated by determining whether a portion of the user's body (e.g., the user's finger) has penetrated the volume associated with the virtual button.
-
公开(公告)号:US20230315250A1
公开(公告)日:2023-10-05
申请号:US18331308
申请日:2023-06-08
Applicant: Magic Leap, Inc.
Inventor: Adrian Kaehler , John Adam Croston
CPC classification number: G06F3/04815 , G06T19/006 , G06N3/02 , G06F3/017 , G06N20/00 , G06V10/464 , G06V20/20 , G06V40/107
Abstract: A wearable display system includes a mixed reality display for presenting a virtual image to a user, an outward-facing imaging system configured to image an environment of the user, and a hardware processor operably coupled to the mixed reality display and to the imaging system. The hardware processor is programmed to generate a virtual remote associated with a parent device, render the virtual remote and the virtual control element on the mixed reality display, determine when the user of the wearable system interacts with the virtual control element of the virtual remote, and perform certain functions in response to user interaction with a virtual control element of the virtual remote. These functions may include generation the virtual control element to move on the mixed reality display; and when movement of the virtual control element surpasses a threshold condition, generate a focus indicator for the virtual control element.
-
公开(公告)号:US20220083198A1
公开(公告)日:2022-03-17
申请号:US17482256
申请日:2021-09-22
Applicant: Magic Leap, Inc.
Inventor: Adrian Kaehler , John Adam Croston
Abstract: A wearable display system can automatically recognize a physical remote or a device that the remote serves using computer vision techniques. The wearable system can generate a virtual remote with a virtual control panel viewable and interactable by user of the wearable system. The virtual remote can emulate the functionality of the physical remote. The user can select a virtual remote for interaction, for example, by looking or pointing at the parent device or its remote control, or by selecting from a menu of known devices. The virtual remote may include a virtual button, which is associated with a volume in the physical space. The wearable system can detect that a virtual button is actuated by determining whether a portion of the user's body (e.g., the user's finger) has penetrated the volume associated with the virtual button.
-
公开(公告)号:US20250068292A1
公开(公告)日:2025-02-27
申请号:US18948996
申请日:2024-11-15
Applicant: Magic Leap, Inc.
Inventor: Adrian Kaehler , John Adam Croston
Abstract: A wearable display system includes a mixed reality display for presenting a virtual image to a user, an outward-facing imaging system configured to image an environment of the user, and a hardware processor operably coupled to the mixed reality display and to the imaging system. The hardware processor is programmed to generate a virtual remote associated with a parent device, render the virtual remote and the virtual control element on the mixed reality display, determine when the user of the wearable system interacts with the virtual control element of the virtual remote, and perform certain functions in response to user interaction with a virtual control element of the virtual remote. These functions may include generation the virtual control element to move on the mixed reality display; and when movement of the virtual control element surpasses a threshold condition, generate a focus indicator for the virtual control element.
-
公开(公告)号:US11150777B2
公开(公告)日:2021-10-19
申请号:US15829249
申请日:2017-12-01
Applicant: Magic Leap, Inc.
Inventor: Adrian Kaehler , John Adam Croston
Abstract: A wearable display system can automatically recognize a physical remote or a device that the remote serves using computer vision techniques. The wearable system can generate a virtual remote with a virtual control panel viewable and interactable by user of the wearable system. The virtual remote can emulate the functionality of the physical remote. The user can select a virtual remote for interaction, for example, by looking or pointing at the parent device or its remote control, or by selecting from a menu of known devices. The virtual remote may include a virtual button, which is associated with a volume in the physical space. The wearable system can detect that a virtual button is actuated by determining whether a portion of the user's body (e.g., the user's finger) has penetrated the volume associated with the virtual button.
-
公开(公告)号:US12175054B2
公开(公告)日:2024-12-24
申请号:US18331308
申请日:2023-06-08
Applicant: Magic Leap, Inc.
Inventor: Adrian Kaehler , John Adam Croston
Abstract: A wearable display system includes a mixed reality display for presenting a virtual image to a user, an outward-facing imaging system configured to image an environment of the user, and a hardware processor operably coupled to the mixed reality display and to the imaging system. The hardware processor is programmed to generate a virtual remote associated with a parent device, render the virtual remote and the virtual control element on the mixed reality display, determine when the user of the wearable system interacts with the virtual control element of the virtual remote, and perform certain functions in response to user interaction with a virtual control element of the virtual remote. These functions may include generation the virtual control element to move on the mixed reality display; and when movement of the virtual control element surpasses a threshold condition, generate a focus indicator for the virtual control element.
-
公开(公告)号:US11720223B2
公开(公告)日:2023-08-08
申请号:US17482256
申请日:2021-09-22
Applicant: Magic Leap, Inc.
Inventor: Adrian Kaehler , John Adam Croston
CPC classification number: G06F3/04815 , G06F3/017 , G06N3/02 , G06N20/00 , G06T19/006 , G06V10/464 , G06V20/20 , G06V40/107
Abstract: A wearable display system can automatically recognize a physical remote or a device that the remote serves using computer vision techniques. The wearable system can generate a virtual remote with a virtual control panel viewable and interactable by user of the wearable system. The virtual remote can emulate the functionality of the physical remote. The user can select a virtual remote for interaction, for example, by looking or pointing at the parent device or its remote control, or by selecting from a menu of known devices. The virtual remote may include a virtual button, which is associated with a volume in the physical space. The wearable system can detect that a virtual button is actuated by determining whether a portion of the user's body (e.g., the user's finger) has penetrated the volume associated with the virtual button.
-
-
-
-
-
-